2023-10-18T10:43:15.877 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-18T10:43:15.878 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303 --name vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi --owner scheduled_vshankar@teuthology --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/orig.config.yaml 2023-10-18T10:43:15.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T10:43:16.012 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303 branch: wip-vshankar-testing-20231013.093215-1 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} email: vshankar@redhat.com first_in_suite: false job_id: '7431303' kernel: client: branch: testing flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20231013.093215-1 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 ms die on skipped message: false osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 189714d033726ae2ce7d2d105c75781f0aec48f4 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 189714d033726ae2ce7d2d105c75781f0aec48f4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231013.093215-1 sha1: 189714d033726ae2ce7d2d105c75781f0aec48f4 owner: scheduled_vshankar@teuthology priority: 20 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 8887 sha1: 189714d033726ae2ce7d2d105c75781f0aec48f4 sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20231013.093215-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 189714d033726ae2ce7d2d105c75781f0aec48f4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+obz1e7R6QP2qenWQIXMio16vXMm5EOLaNoRO+C5Io5yhLFk7H9GvwojfSrvi39nhPHCRenawVKB1AUDLwSpM= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz6kA2y2qL6G3bCydVes/q74K36e4w2Bk4w0f/Uay1pakoMGKFE88xVrNBU9Gb8S9MvTekLxvqdQcs11txniWM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 202b180cb047e798fb131047314a862593f45403 timestamp: 2023-10-18_10:33:40 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-18T10:43:16.013 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa; will attempt to use it 2023-10-18T10:43:16.013 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa/tasks 2023-10-18T10:43:16.014 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-18T10:43:16.016 INFO:teuthology.task.internal:Checking packages... 2023-10-18T10:43:16.040 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '189714d033726ae2ce7d2d105c75781f0aec48f4' 2023-10-18T10:43:16.040 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T10:43:16.040 INFO:teuthology.packaging:ref: None 2023-10-18T10:43:16.041 INFO:teuthology.packaging:tag: None 2023-10-18T10:43:16.041 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231013.093215-1 2023-10-18T10:43:16.041 INFO:teuthology.packaging:sha1: 189714d033726ae2ce7d2d105c75781f0aec48f4 2023-10-18T10:43:16.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20231013.093215-1 2023-10-18T10:43:16.191 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6713.g189714d0 2023-10-18T10:43:16.191 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-18T10:43:16.198 INFO:teuthology.task.internal:no buildpackages task found 2023-10-18T10:43:16.199 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-18T10:43:16.208 INFO:teuthology.task.internal:Saving configuration 2023-10-18T10:43:16.225 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-18T10:43:16.231 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T10:43:16.260 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 10:37:53.093062', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+obz1e7R6QP2qenWQIXMio16vXMm5EOLaNoRO+C5Io5yhLFk7H9GvwojfSrvi39nhPHCRenawVKB1AUDLwSpM='} 2023-10-18T10:43:16.281 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 10:37:53.094983', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz6kA2y2qL6G3bCydVes/q74K36e4w2Bk4w0f/Uay1pakoMGKFE88xVrNBU9Gb8S9MvTekLxvqdQcs11txniWM='} 2023-10-18T10:43:16.281 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-18T10:43:16.287 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-18T10:43:16.288 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-18T10:43:16.288 INFO:teuthology.run_tasks:Running task console_log... 2023-10-18T10:43:16.358 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4c3dc97b80>, signals=[15]) 2023-10-18T10:43:16.359 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-18T10:43:16.370 INFO:teuthology.task.internal:Opening connections... 2023-10-18T10:43:16.371 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T10:43:16.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T10:43:16.458 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T10:43:16.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T10:43:16.543 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-18T10:43:16.550 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-10-18T10:43:16.568 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-10-18T10:43:16.568 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-18T10:43:16.624 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-10-18T10:43:16.624 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2023-10-18T10:43:16.624 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-10-18T10:43:16.624 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-10-18T10:43:16.625 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2023-10-18T10:43:16.625 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2023-10-18T10:43:16.625 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T10:43:16.625 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-10-18T10:43:16.626 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2023-10-18T10:43:16.626 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T10:43:16.626 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-10-18T10:43:16.626 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T10:43:16.626 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T10:43:16.627 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T10:43:16.628 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-18T10:43:16.652 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-10-18T10:43:16.671 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-10-18T10:43:16.671 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-18T10:43:16.728 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-10-18T10:43:16.728 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2023-10-18T10:43:16.729 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-10-18T10:43:16.729 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-10-18T10:43:16.729 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2023-10-18T10:43:16.730 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2023-10-18T10:43:16.730 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T10:43:16.730 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-10-18T10:43:16.730 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2023-10-18T10:43:16.731 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T10:43:16.731 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-10-18T10:43:16.731 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T10:43:16.731 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T10:43:16.732 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T10:43:16.732 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-18T10:43:16.752 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-18T10:43:16.762 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-18T10:43:16.768 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-18T10:43:16.768 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-10-18T10:43:16.771 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2023-10-18T10:43:16.787 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-18T10:43:16.793 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-18T10:43:16.793 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-10-18T10:43:16.828 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2023-10-18T10:43:16.929 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-18T10:43:16.980 INFO:teuthology.run_tasks:Running task kernel... 2023-10-18T10:43:16.996 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-18T10:43:16.997 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-10-18T10:43:16.997 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-10-18T10:43:16.998 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T10:43:17.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T10:43:17.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-10-18T10:43:17.175 DEBUG:teuthology.task.kernel:sha1 for client.0 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T10:43:17.175 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-18T10:43:17.176 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-10-18T10:43:17.193 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-361.el9.x86_64 2023-10-18T10:43:17.193 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T10:43:17.194 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-18T10:43:17.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum upgrade -y linux-firmware 2023-10-18T10:43:19.362 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 15 MB/s | 6.3 MB 00:00 2023-10-18T10:43:20.712 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2023-10-18T10:43:22.497 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 7.9 MB 00:01 2023-10-18T10:43:38.211 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 18 MB 00:14 2023-10-18T10:43:41.905 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 13 MB/s | 5.7 MB 00:00 2023-10-18T10:43:43.362 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 14 kB 00:00 2023-10-18T10:43:44.480 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 19 MB/s | 19 MB 00:01 2023-10-18T10:43:48.972 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2023-10-18T10:43:51.126 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-18T10:43:51.134 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-18T10:43:51.134 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-18T10:43:51.134 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-18T10:43:51.135 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-10-18T10:43:51.135 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-18T10:43:51.135 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T10:43:51.135 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-18T10:43:51.135 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-18T10:43:51.136 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 1 Package 2023-10-18T10:43:51.136 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T10:43:51.136 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 326 M 2023-10-18T10:43:51.136 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-18T10:43:58.698 INFO:teuthology.orchestra.run.smithi151.stdout:linux-firmware-20230926-140.el9.noarch.rpm 43 MB/s | 326 MB 00:07 2023-10-18T10:43:58.699 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-18T10:43:58.699 INFO:teuthology.orchestra.run.smithi151.stdout:Total 43 MB/s | 326 MB 00:07 2023-10-18T10:43:58.700 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-18T10:43:58.803 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-18T10:43:58.803 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-18T10:44:00.954 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-18T10:44:00.955 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-18T10:44:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-18T10:44:07.334 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-18T10:44:07.454 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-18T10:44:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-18T10:44:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-18T10:44:08.850 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-18T10:44:08.850 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T10:44:08.851 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-10-18T10:44:08.851 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-18T10:44:08.851 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T10:44:08.851 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-18T10:44:09.146 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-18T10:44:09.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T10:44:09.293 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-18T10:44:09.294 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-18T10:44:09.297 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi151.front.sepia.ceph.com to complete... 2023-10-18T10:44:20.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18 10:44:20 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-18T10:44:20.419 INFO:teuthology.orchestra.run.smithi151.stderr:FINISHED --2023-10-18 10:44:20-- 2023-10-18T10:44:20.419 INFO:teuthology.orchestra.run.smithi151.stderr:Total wall clock time: 11s 2023-10-18T10:44:20.419 INFO:teuthology.orchestra.run.smithi151.stderr:Downloaded: 1 files, 306M in 11s (28.4 MB/s) 2023-10-18T10:44:20.420 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-18T10:44:20.420 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-18T10:44:22.264 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying... ######################################## 2023-10-18T10:44:22.347 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing... ######################################## 2023-10-18T10:44:22.427 INFO:teuthology.orchestra.run.smithi151.stdout:Updating / installing... 2023-10-18T10:44:29.544 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-18T10:44:45.659 INFO:teuthology.orchestra.run.smithi151.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-18T10:45:06.915 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-18T10:45:06.915 DEBUG:teuthology.orchestra.run.smithi151:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-18T10:45:06.984 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T10:45:06.985 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-18T10:45:06.985 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T10:45:06.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-18T10:45:06.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-18T10:45:06.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-18T10:45:06.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-18T10:45:06.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-18T10:45:06.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-18T10:45:06.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-18T10:45:06.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-18T10:45:06.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-18T10:45:06.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-18T10:45:06.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-18T10:45:06.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-18T10:45:06.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-18T10:45:06.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-18T10:45:06.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-18T10:45:06.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-18T10:45:06.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-18T10:45:06.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-18T10:45:06.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-18T10:45:06.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-18T10:45:06.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-18T10:45:06.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-18T10:45:06.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-18T10:45:06.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-18T10:45:06.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-18T10:45:06.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-18T10:45:06.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-18T10:45:06.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-18T10:45:06.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-18T10:45:06.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-18T10:45:06.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-18T10:45:06.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-18T10:45:06.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-18T10:45:06.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-18T10:45:06.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-18T10:45:06.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-18T10:45:06.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-18T10:45:06.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-18T10:45:06.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-18T10:45:06.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-18T10:45:06.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-18T10:45:06.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-18T10:45:06.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-18T10:45:06.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-18T10:45:06.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-18T10:45:06.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-18T10:45:06.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-18T10:45:06.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-18T10:45:06.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-18T10:45:06.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-18T10:45:06.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-18T10:45:06.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-18T10:45:06.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-18T10:45:06.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-18T10:45:06.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-18T10:45:06.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-18T10:45:06.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-18T10:45:06.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-18T10:45:06.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-18T10:45:06.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-18T10:45:06.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-18T10:45:06.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-18T10:45:06.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-18T10:45:06.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-18T10:45:06.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-18T10:45:06.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-18T10:45:06.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-18T10:45:06.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-18T10:45:06.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-18T10:45:06.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-18T10:45:06.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-18T10:45:06.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-18T10:45:07.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-18T10:45:07.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-18T10:45:07.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-18T10:45:07.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-18T10:45:07.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-18T10:45:07.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-18T10:45:07.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-18T10:45:07.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-18T10:45:07.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-18T10:45:07.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-18T10:45:07.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-18T10:45:07.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-18T10:45:07.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-18T10:45:07.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-18T10:45:07.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-18T10:45:07.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-18T10:45:07.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-18T10:45:07.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-18T10:45:07.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-18T10:45:07.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-18T10:45:07.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-18T10:45:07.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-18T10:45:07.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-18T10:45:07.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-18T10:45:07.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-18T10:45:07.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-18T10:45:07.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-18T10:45:07.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-18T10:45:07.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-18T10:45:07.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-18T10:45:07.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-18T10:45:07.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-18T10:45:07.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-18T10:45:07.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-18T10:45:07.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-18T10:45:07.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-18T10:45:07.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-18T10:45:07.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-18T10:45:07.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-18T10:45:07.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-18T10:45:07.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-18T10:45:07.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-18T10:45:07.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-18T10:45:07.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-18T10:45:07.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-18T10:45:07.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-18T10:45:07.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-18T10:45:07.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-18T10:45:07.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-18T10:45:07.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-18T10:45:07.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-18T10:45:07.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-18T10:45:07.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-18T10:45:07.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-18T10:45:07.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-18T10:45:07.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-18T10:45:07.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-18T10:45:07.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-18T10:45:07.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-18T10:45:07.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-18T10:45:07.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-18T10:45:07.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-18T10:45:07.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-18T10:45:07.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-18T10:45:07.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-18T10:45:07.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-18T10:45:07.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-18T10:45:07.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-18T10:45:07.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-18T10:45:07.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-18T10:45:07.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-18T10:45:07.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-18T10:45:07.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-18T10:45:07.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-18T10:45:07.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-18T10:45:07.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-18T10:45:07.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-18T10:45:07.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-18T10:45:07.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-18T10:45:07.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-18T10:45:07.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-18T10:45:07.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-18T10:45:07.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-18T10:45:07.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-18T10:45:07.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-18T10:45:07.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-18T10:45:07.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-18T10:45:07.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-18T10:45:07.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-18T10:45:07.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-18T10:45:07.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-18T10:45:07.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-18T10:45:07.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-18T10:45:07.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-18T10:45:07.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-18T10:45:07.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-18T10:45:07.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-18T10:45:07.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-18T10:45:07.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-18T10:45:07.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-18T10:45:07.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-18T10:45:07.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-18T10:45:07.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-18T10:45:07.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-18T10:45:07.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-18T10:45:07.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-18T10:45:07.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-18T10:45:07.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-18T10:45:07.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-18T10:45:07.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-18T10:45:07.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-18T10:45:07.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-18T10:45:07.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-18T10:45:07.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-18T10:45:07.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-18T10:45:07.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-18T10:45:07.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-18T10:45:07.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-18T10:45:07.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-18T10:45:07.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-18T10:45:07.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-18T10:45:07.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-18T10:45:07.024 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-18T10:45:07.024 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-18T10:45:07.024 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-18T10:45:07.024 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-18T10:45:07.024 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-18T10:45:07.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-18T10:45:07.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-18T10:45:07.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-18T10:45:07.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-18T10:45:07.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-18T10:45:07.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-18T10:45:07.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-18T10:45:07.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-18T10:45:07.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-18T10:45:07.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-18T10:45:07.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-18T10:45:07.027 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-18T10:45:07.027 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-18T10:45:07.027 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-18T10:45:07.027 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-18T10:45:07.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-18T10:45:07.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-18T10:45:07.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-18T10:45:07.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-18T10:45:07.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-18T10:45:07.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-18T10:45:07.029 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-18T10:45:07.029 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-18T10:45:07.029 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-18T10:45:07.029 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-18T10:45:07.029 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-18T10:45:07.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-18T10:45:07.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-18T10:45:07.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-18T10:45:07.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-18T10:45:07.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-18T10:45:07.031 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-18T10:45:07.031 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-18T10:45:07.031 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-18T10:45:07.031 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-18T10:45:07.031 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-18T10:45:07.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-18T10:45:07.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-18T10:45:07.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-18T10:45:07.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-18T10:45:07.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-18T10:45:07.033 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-18T10:45:07.033 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-18T10:45:07.033 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-18T10:45:07.033 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-18T10:45:07.034 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-18T10:45:07.034 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-18T10:45:07.034 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-18T10:45:07.034 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-18T10:45:07.034 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-18T10:45:07.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-18T10:45:07.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-18T10:45:07.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-18T10:45:07.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-18T10:45:07.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-18T10:45:07.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-18T10:45:07.036 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-18T10:45:07.036 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-18T10:45:07.036 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-18T10:45:07.036 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-18T10:45:07.036 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-18T10:45:07.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-18T10:45:07.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-18T10:45:07.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-18T10:45:07.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-18T10:45:07.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-18T10:45:07.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-18T10:45:07.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-18T10:45:07.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-18T10:45:07.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-18T10:45:07.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-18T10:45:07.039 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-18T10:45:07.039 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-18T10:45:07.039 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-18T10:45:07.039 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-18T10:45:07.039 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-18T10:45:07.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-18T10:45:07.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-18T10:45:07.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-18T10:45:07.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-18T10:45:07.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-18T10:45:07.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-18T10:45:07.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-18T10:45:07.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-18T10:45:07.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-18T10:45:07.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-18T10:45:07.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-18T10:45:07.042 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-18T10:45:07.042 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-18T10:45:07.042 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-18T10:45:07.042 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-18T10:45:07.042 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-18T10:45:07.043 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-18T10:45:07.043 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-18T10:45:07.043 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-18T10:45:07.043 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-18T10:45:07.043 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-18T10:45:07.044 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-18T10:45:07.044 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-18T10:45:07.044 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-18T10:45:07.044 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-18T10:45:07.044 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-18T10:45:07.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-18T10:45:07.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-18T10:45:07.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-18T10:45:07.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-18T10:45:07.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-18T10:45:07.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-18T10:45:07.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-18T10:45:07.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-18T10:45:07.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-18T10:45:07.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-18T10:45:07.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-18T10:45:07.047 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-18T10:45:07.047 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-18T10:45:07.047 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-18T10:45:07.047 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-18T10:45:07.047 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-18T10:45:07.048 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-18T10:45:07.048 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-18T10:45:07.048 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-18T10:45:07.048 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-18T10:45:07.048 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-18T10:45:07.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-18T10:45:07.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-18T10:45:07.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-18T10:45:07.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-18T10:45:07.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-18T10:45:07.050 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-18T10:45:07.050 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-18T10:45:07.050 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-18T10:45:07.050 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-18T10:45:07.050 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-18T10:45:07.051 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-18T10:45:07.051 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-18T10:45:07.051 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-18T10:45:07.051 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-18T10:45:07.051 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-18T10:45:07.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-18T10:45:07.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-18T10:45:07.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-18T10:45:07.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-18T10:45:07.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-18T10:45:07.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-18T10:45:07.053 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-18T10:45:07.053 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-18T10:45:07.053 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-18T10:45:07.053 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-18T10:45:07.053 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-18T10:45:07.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-18T10:45:07.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-18T10:45:07.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-18T10:45:07.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-18T10:45:07.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-18T10:45:07.055 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-18T10:45:07.055 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-18T10:45:07.055 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-18T10:45:07.055 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-18T10:45:07.055 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-18T10:45:07.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-18T10:45:07.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-18T10:45:07.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-18T10:45:07.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-18T10:45:07.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-18T10:45:07.057 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-18T10:45:07.057 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-18T10:45:07.057 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-18T10:45:07.057 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-18T10:45:07.057 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-18T10:45:07.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-18T10:45:07.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-18T10:45:07.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-18T10:45:07.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-18T10:45:07.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-18T10:45:07.059 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-18T10:45:07.059 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-18T10:45:07.059 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-18T10:45:07.059 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-18T10:45:07.059 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-18T10:45:07.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-18T10:45:07.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-18T10:45:07.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-18T10:45:07.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-18T10:45:07.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-18T10:45:07.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-18T10:45:07.061 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-18T10:45:07.061 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-18T10:45:07.061 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-18T10:45:07.061 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-18T10:45:07.061 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-18T10:45:07.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-18T10:45:07.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-18T10:45:07.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-18T10:45:07.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-18T10:45:07.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-18T10:45:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-18T10:45:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-18T10:45:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-18T10:45:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-18T10:45:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-18T10:45:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-18T10:45:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-18T10:45:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-18T10:45:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-18T10:45:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-18T10:45:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-18T10:45:07.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-18T10:45:07.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-18T10:45:07.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-18T10:45:07.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-18T10:45:07.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-18T10:45:07.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-18T10:45:07.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-18T10:45:07.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-18T10:45:07.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-18T10:45:07.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-18T10:45:07.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-18T10:45:07.067 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-18T10:45:07.067 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-18T10:45:07.067 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-18T10:45:07.067 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-18T10:45:07.067 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-18T10:45:07.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-18T10:45:07.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-18T10:45:07.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-18T10:45:07.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-18T10:45:07.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-18T10:45:07.069 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-18T10:45:07.069 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-18T10:45:07.069 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-18T10:45:07.069 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-18T10:45:07.069 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-18T10:45:07.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-18T10:45:07.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-18T10:45:07.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-18T10:45:07.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-18T10:45:07.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-18T10:45:07.071 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-18T10:45:07.071 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-18T10:45:07.071 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-18T10:45:07.071 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-18T10:45:07.071 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-18T10:45:07.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-18T10:45:07.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-18T10:45:07.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-18T10:45:07.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-18T10:45:07.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-18T10:45:07.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-18T10:45:07.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-18T10:45:07.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-18T10:45:07.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-18T10:45:07.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-18T10:45:07.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-18T10:45:07.074 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-18T10:45:07.074 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-18T10:45:07.074 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-18T10:45:07.074 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-18T10:45:07.074 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-18T10:45:07.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-18T10:45:07.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-18T10:45:07.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-18T10:45:07.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-18T10:45:07.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-18T10:45:07.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-18T10:45:07.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-18T10:45:07.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-18T10:45:07.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-18T10:45:07.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-18T10:45:07.077 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-18T10:45:07.077 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-18T10:45:07.077 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-18T10:45:07.077 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-18T10:45:07.077 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-18T10:45:07.078 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-18T10:45:07.078 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-18T10:45:07.078 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-18T10:45:07.078 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-18T10:45:07.078 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-18T10:45:07.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-18T10:45:07.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-18T10:45:07.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-18T10:45:07.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-18T10:45:07.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-18T10:45:07.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-18T10:45:07.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-18T10:45:07.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-18T10:45:07.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-18T10:45:07.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-18T10:45:07.081 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-18T10:45:07.081 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-18T10:45:07.081 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-18T10:45:07.081 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-18T10:45:07.081 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-18T10:45:07.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-18T10:45:07.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-18T10:45:07.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-18T10:45:07.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-18T10:45:07.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-18T10:45:07.083 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-18T10:45:07.083 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-18T10:45:07.083 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-18T10:45:07.083 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-18T10:45:07.083 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-18T10:45:07.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-18T10:45:07.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-18T10:45:07.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-18T10:45:07.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-18T10:45:07.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-18T10:45:07.085 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-18T10:45:07.085 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-18T10:45:07.085 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-18T10:45:07.085 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-18T10:45:07.085 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-18T10:45:07.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-18T10:45:07.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-18T10:45:07.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-18T10:45:07.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-18T10:45:07.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-18T10:45:07.087 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-18T10:45:07.087 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-18T10:45:07.087 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-18T10:45:07.087 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-18T10:45:07.087 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-18T10:45:07.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-18T10:45:07.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-18T10:45:07.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-18T10:45:07.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-18T10:45:07.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-18T10:45:07.089 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-18T10:45:07.089 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-18T10:45:07.089 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-18T10:45:07.089 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-18T10:45:07.089 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-18T10:45:07.090 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-18T10:45:07.090 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-18T10:45:07.090 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-18T10:45:07.090 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-18T10:45:07.090 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-18T10:45:07.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-18T10:45:07.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-18T10:45:07.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-18T10:45:07.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-18T10:45:07.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-18T10:45:07.092 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-18T10:45:07.092 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-18T10:45:07.092 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-18T10:45:07.092 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-18T10:45:07.092 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-18T10:45:07.093 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-18T10:45:07.093 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-18T10:45:07.093 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-18T10:45:07.093 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-18T10:45:07.093 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-18T10:45:07.094 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-18T10:45:07.094 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-18T10:45:07.094 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-18T10:45:07.094 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-18T10:45:07.094 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-18T10:45:07.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-18T10:45:07.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-18T10:45:07.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-18T10:45:07.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-18T10:45:07.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-18T10:45:07.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-18T10:45:07.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-18T10:45:07.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-18T10:45:07.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-18T10:45:07.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-18T10:45:07.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-18T10:45:07.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-18T10:45:07.097 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-18T10:45:07.097 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-18T10:45:07.097 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-18T10:45:07.097 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-18T10:45:07.097 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-18T10:45:07.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-18T10:45:07.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-18T10:45:07.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-18T10:45:07.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-18T10:45:07.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-18T10:45:07.099 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-18T10:45:07.099 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-18T10:45:07.099 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-18T10:45:07.099 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-18T10:45:07.099 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-18T10:45:07.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-18T10:45:07.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-18T10:45:07.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-18T10:45:07.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-18T10:45:07.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-18T10:45:07.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-18T10:45:07.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-18T10:45:07.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-18T10:45:07.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-18T10:45:07.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-18T10:45:07.102 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-18T10:45:07.102 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-18T10:45:07.102 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-18T10:45:07.102 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-18T10:45:07.102 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-18T10:45:07.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-18T10:45:07.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-18T10:45:07.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-18T10:45:07.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-18T10:45:07.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-18T10:45:07.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-18T10:45:07.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-18T10:45:07.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-18T10:45:07.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-18T10:45:07.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-18T10:45:07.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-18T10:45:07.105 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-18T10:45:07.105 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-18T10:45:07.105 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-18T10:45:07.105 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-18T10:45:07.105 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-18T10:45:07.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-18T10:45:07.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-18T10:45:07.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-18T10:45:07.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-18T10:45:07.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-18T10:45:07.107 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-18T10:45:07.107 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-18T10:45:07.107 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-18T10:45:07.107 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-18T10:45:07.107 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-18T10:45:07.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-18T10:45:07.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-18T10:45:07.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-18T10:45:07.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-18T10:45:07.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-18T10:45:07.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-18T10:45:07.109 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-18T10:45:07.109 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-18T10:45:07.109 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-18T10:45:07.109 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-18T10:45:07.109 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-18T10:45:07.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-18T10:45:07.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-18T10:45:07.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-18T10:45:07.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-18T10:45:07.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-18T10:45:07.111 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-18T10:45:07.111 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-18T10:45:07.111 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-18T10:45:07.111 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-18T10:45:07.111 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-18T10:45:07.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-18T10:45:07.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-18T10:45:07.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-18T10:45:07.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-18T10:45:07.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-18T10:45:07.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-18T10:45:07.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-18T10:45:07.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-18T10:45:07.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-18T10:45:07.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-18T10:45:07.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-18T10:45:07.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-18T10:45:07.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-18T10:45:07.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-18T10:45:07.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-18T10:45:07.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-18T10:45:07.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-18T10:45:07.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-18T10:45:07.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-18T10:45:07.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-18T10:45:07.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-18T10:45:07.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-18T10:45:07.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-18T10:45:07.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-18T10:45:07.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-18T10:45:07.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-18T10:45:07.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-18T10:45:07.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-18T10:45:07.117 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-18T10:45:07.117 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-18T10:45:07.117 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-18T10:45:07.117 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-18T10:45:07.117 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-18T10:45:07.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-18T10:45:07.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-18T10:45:07.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-18T10:45:07.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-18T10:45:07.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-18T10:45:07.119 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-18T10:45:07.119 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-18T10:45:07.119 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-18T10:45:07.119 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-18T10:45:07.119 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-18T10:45:07.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-18T10:45:07.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-18T10:45:07.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-18T10:45:07.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-18T10:45:07.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-18T10:45:07.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-18T10:45:07.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-18T10:45:07.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-18T10:45:07.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-18T10:45:07.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-18T10:45:07.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-18T10:45:07.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-18T10:45:07.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-18T10:45:07.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-18T10:45:07.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-18T10:45:07.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-18T10:45:07.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-18T10:45:07.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-18T10:45:07.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-18T10:45:07.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-18T10:45:07.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-18T10:45:07.124 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-18T10:45:07.124 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-18T10:45:07.124 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-18T10:45:07.124 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-18T10:45:07.124 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-18T10:45:07.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-18T10:45:07.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-18T10:45:07.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-18T10:45:07.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-18T10:45:07.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-18T10:45:07.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-18T10:45:07.126 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-18T10:45:07.126 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-18T10:45:07.126 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-18T10:45:07.126 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-18T10:45:07.126 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-18T10:45:07.127 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-18T10:45:07.127 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-18T10:45:07.127 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-18T10:45:07.127 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-18T10:45:07.127 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-18T10:45:07.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-18T10:45:07.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-18T10:45:07.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-18T10:45:07.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-18T10:45:07.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-18T10:45:07.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-18T10:45:07.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-18T10:45:07.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-18T10:45:07.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-18T10:45:07.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-18T10:45:07.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-18T10:45:07.130 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-18T10:45:07.130 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-18T10:45:07.130 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-18T10:45:07.130 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-18T10:45:07.130 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-18T10:45:07.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-18T10:45:07.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-18T10:45:07.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-18T10:45:07.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-18T10:45:07.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-18T10:45:07.132 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-18T10:45:07.132 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-18T10:45:07.132 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-18T10:45:07.132 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-18T10:45:07.132 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-18T10:45:07.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-18T10:45:07.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-18T10:45:07.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-18T10:45:07.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-18T10:45:07.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-18T10:45:07.134 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-18T10:45:07.134 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-18T10:45:07.134 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-18T10:45:07.134 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-18T10:45:07.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-18T10:45:07.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-18T10:45:07.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-18T10:45:07.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-18T10:45:07.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-18T10:45:07.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-18T10:45:07.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-18T10:45:07.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-18T10:45:07.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-18T10:45:07.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-18T10:45:07.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-18T10:45:07.137 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-18T10:45:07.137 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-18T10:45:07.137 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-18T10:45:07.137 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-18T10:45:07.137 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-18T10:45:07.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-18T10:45:07.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-18T10:45:07.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-18T10:45:07.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-18T10:45:07.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-18T10:45:07.139 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-18T10:45:07.139 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-18T10:45:07.139 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-18T10:45:07.139 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-18T10:45:07.139 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-18T10:45:07.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-18T10:45:07.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-18T10:45:07.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-18T10:45:07.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-18T10:45:07.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-18T10:45:07.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-18T10:45:07.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-18T10:45:07.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-18T10:45:07.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-18T10:45:07.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-18T10:45:07.142 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-18T10:45:07.142 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-18T10:45:07.142 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-18T10:45:07.142 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-18T10:45:07.142 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-18T10:45:07.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-18T10:45:07.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-18T10:45:07.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-18T10:45:07.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-18T10:45:07.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-18T10:45:07.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-18T10:45:07.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-18T10:45:07.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-18T10:45:07.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-18T10:45:07.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-18T10:45:07.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-18T10:45:07.145 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-18T10:45:07.145 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-18T10:45:07.145 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-18T10:45:07.145 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-18T10:45:07.145 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-18T10:45:07.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-18T10:45:07.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-18T10:45:07.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-18T10:45:07.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-18T10:45:07.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-18T10:45:07.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-18T10:45:07.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-18T10:45:07.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-18T10:45:07.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-18T10:45:07.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-18T10:45:07.148 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-18T10:45:07.148 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-18T10:45:07.148 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-18T10:45:07.148 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-18T10:45:07.148 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-18T10:45:07.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-18T10:45:07.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-18T10:45:07.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-18T10:45:07.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-18T10:45:07.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-18T10:45:07.150 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-18T10:45:07.150 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-18T10:45:07.150 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-18T10:45:07.150 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-18T10:45:07.150 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-18T10:45:07.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-18T10:45:07.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-18T10:45:07.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-18T10:45:07.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-18T10:45:07.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-18T10:45:07.152 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-18T10:45:07.152 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-18T10:45:07.152 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-18T10:45:07.152 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-18T10:45:07.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-18T10:45:07.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-18T10:45:07.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-18T10:45:07.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-18T10:45:07.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-18T10:45:07.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-18T10:45:07.154 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-18T10:45:07.154 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-18T10:45:07.154 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-18T10:45:07.154 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-18T10:45:07.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-18T10:45:07.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-18T10:45:07.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-18T10:45:07.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-18T10:45:07.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-18T10:45:07.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-18T10:45:07.156 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-18T10:45:07.156 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-18T10:45:07.156 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-18T10:45:07.156 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-18T10:45:07.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-18T10:45:07.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-18T10:45:07.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-18T10:45:07.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-18T10:45:07.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-18T10:45:07.158 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-18T10:45:07.158 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-18T10:45:07.158 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-18T10:45:07.158 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-18T10:45:07.158 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-18T10:45:07.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-18T10:45:07.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-18T10:45:07.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-18T10:45:07.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-18T10:45:07.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-18T10:45:07.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-18T10:45:07.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-18T10:45:07.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-18T10:45:07.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-18T10:45:07.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-18T10:45:07.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-18T10:45:07.161 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-18T10:45:07.161 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-18T10:45:07.161 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-18T10:45:07.161 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-18T10:45:07.161 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-18T10:45:07.162 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-18T10:45:07.162 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-18T10:45:07.162 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-18T10:45:07.162 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-18T10:45:07.162 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-18T10:45:07.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-18T10:45:07.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-18T10:45:07.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-18T10:45:07.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-18T10:45:07.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-18T10:45:07.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-18T10:45:07.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-18T10:45:07.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-18T10:45:07.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-18T10:45:07.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-18T10:45:07.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-18T10:45:07.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-18T10:45:07.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-18T10:45:07.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-18T10:45:07.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-18T10:45:07.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-18T10:45:07.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-18T10:45:07.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-18T10:45:07.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-18T10:45:07.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-18T10:45:07.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-18T10:45:07.167 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-18T10:45:07.167 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-18T10:45:07.167 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-18T10:45:07.167 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-18T10:45:07.167 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-18T10:45:07.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-18T10:45:07.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-18T10:45:07.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-18T10:45:07.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-18T10:45:07.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-18T10:45:07.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-18T10:45:07.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-18T10:45:07.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-18T10:45:07.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-18T10:45:07.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-18T10:45:07.170 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-18T10:45:07.170 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-18T10:45:07.170 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-18T10:45:07.170 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-18T10:45:07.170 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-18T10:45:07.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-18T10:45:07.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-18T10:45:07.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-18T10:45:07.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-18T10:45:07.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-18T10:45:07.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-18T10:45:07.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-18T10:45:07.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-18T10:45:07.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-18T10:45:07.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-18T10:45:07.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-18T10:45:07.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-18T10:45:07.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-18T10:45:07.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-18T10:45:07.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-18T10:45:07.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-18T10:45:07.174 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-18T10:45:07.174 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-18T10:45:07.174 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-18T10:45:07.174 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-18T10:45:07.174 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-18T10:45:07.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-18T10:45:07.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-18T10:45:07.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-18T10:45:07.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-18T10:45:07.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-18T10:45:07.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-18T10:45:07.176 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-18T10:45:07.176 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-18T10:45:07.176 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-18T10:45:07.176 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-18T10:45:07.176 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-18T10:45:07.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-18T10:45:07.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-18T10:45:07.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-18T10:45:07.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-18T10:45:07.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-18T10:45:07.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-18T10:45:07.178 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-18T10:45:07.178 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-18T10:45:07.178 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-18T10:45:07.178 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-18T10:45:07.178 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-18T10:45:07.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-18T10:45:07.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-18T10:45:07.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-18T10:45:07.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-18T10:45:07.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-18T10:45:07.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-18T10:45:07.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-18T10:45:07.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-18T10:45:07.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-18T10:45:07.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-18T10:45:07.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-18T10:45:07.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-18T10:45:07.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-18T10:45:07.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-18T10:45:07.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-18T10:45:07.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-18T10:45:07.182 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-18T10:45:07.182 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-18T10:45:07.182 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-18T10:45:07.182 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-18T10:45:07.182 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-18T10:45:07.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-18T10:45:07.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-18T10:45:07.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-18T10:45:07.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-18T10:45:07.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-18T10:45:07.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-18T10:45:07.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-18T10:45:07.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-18T10:45:07.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-18T10:45:07.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-18T10:45:07.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-18T10:45:07.185 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-18T10:45:07.185 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-18T10:45:07.185 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-18T10:45:07.185 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-18T10:45:07.185 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-18T10:45:07.186 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-18T10:45:07.186 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-18T10:45:07.186 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-18T10:45:07.186 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-18T10:45:07.186 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-18T10:45:07.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-18T10:45:07.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-18T10:45:07.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-18T10:45:07.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-18T10:45:07.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-18T10:45:07.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-18T10:45:07.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-18T10:45:07.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-18T10:45:07.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-18T10:45:07.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-18T10:45:07.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-18T10:45:07.189 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-18T10:45:07.189 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-18T10:45:07.189 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-18T10:45:07.189 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-18T10:45:07.189 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-18T10:45:07.190 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-18T10:45:07.190 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-18T10:45:07.190 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-18T10:45:07.190 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-18T10:45:07.190 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-18T10:45:07.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-18T10:45:07.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-18T10:45:07.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-18T10:45:07.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-18T10:45:07.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-18T10:45:07.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-18T10:45:07.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-18T10:45:07.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-18T10:45:07.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-18T10:45:07.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-18T10:45:07.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-18T10:45:07.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-18T10:45:07.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-18T10:45:07.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-18T10:45:07.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-18T10:45:07.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-18T10:45:07.194 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-18T10:45:07.194 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-18T10:45:07.194 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-18T10:45:07.194 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-18T10:45:07.194 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-18T10:45:07.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-18T10:45:07.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-18T10:45:07.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-18T10:45:07.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-18T10:45:07.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-18T10:45:07.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-18T10:45:07.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-18T10:45:07.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-18T10:45:07.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-18T10:45:07.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-18T10:45:07.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-18T10:45:07.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-18T10:45:07.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-18T10:45:07.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-18T10:45:07.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-18T10:45:07.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-18T10:45:07.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-18T10:45:07.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-18T10:45:07.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-18T10:45:07.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-18T10:45:07.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-18T10:45:07.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-18T10:45:07.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-18T10:45:07.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-18T10:45:07.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-18T10:45:07.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-18T10:45:07.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-18T10:45:07.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-18T10:45:07.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-18T10:45:07.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-18T10:45:07.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-18T10:45:07.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-18T10:45:07.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-18T10:45:07.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-18T10:45:07.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-18T10:45:07.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-18T10:45:07.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-18T10:45:07.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-18T10:45:07.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-18T10:45:07.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-18T10:45:07.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-18T10:45:07.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-18T10:45:07.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-18T10:45:07.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-18T10:45:07.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-18T10:45:07.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-18T10:45:07.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-18T10:45:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-18T10:45:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-18T10:45:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-18T10:45:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-18T10:45:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-18T10:45:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-18T10:45:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-18T10:45:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-18T10:45:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-18T10:45:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-18T10:45:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-18T10:45:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-18T10:45:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-18T10:45:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-18T10:45:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-18T10:45:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-18T10:45:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-18T10:45:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-18T10:45:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-18T10:45:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-18T10:45:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-18T10:45:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-18T10:45:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-18T10:45:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-18T10:45:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-18T10:45:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-18T10:45:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-18T10:45:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-18T10:45:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-18T10:45:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-18T10:45:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-18T10:45:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-18T10:45:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-18T10:45:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-18T10:45:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-18T10:45:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-18T10:45:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-18T10:45:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-18T10:45:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-18T10:45:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-18T10:45:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-18T10:45:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-18T10:45:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-18T10:45:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-18T10:45:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-18T10:45:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-18T10:45:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-18T10:45:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-18T10:45:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-18T10:45:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-18T10:45:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-18T10:45:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-18T10:45:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-18T10:45:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-18T10:45:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-18T10:45:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-18T10:45:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-18T10:45:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-18T10:45:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-18T10:45:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-18T10:45:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-18T10:45:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-18T10:45:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-18T10:45:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-18T10:45:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-18T10:45:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-18T10:45:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-18T10:45:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-18T10:45:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-18T10:45:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-18T10:45:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-18T10:45:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-18T10:45:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-18T10:45:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-18T10:45:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-18T10:45:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-18T10:45:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-18T10:45:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-18T10:45:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-18T10:45:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-18T10:45:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-18T10:45:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-18T10:45:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-18T10:45:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-18T10:45:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-18T10:45:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-18T10:45:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-18T10:45:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-18T10:45:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-18T10:45:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-18T10:45:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-18T10:45:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-18T10:45:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-18T10:45:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-18T10:45:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-18T10:45:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-18T10:45:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-18T10:45:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-18T10:45:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-18T10:45:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-18T10:45:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-18T10:45:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-18T10:45:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-18T10:45:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-18T10:45:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-18T10:45:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-18T10:45:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-18T10:45:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-18T10:45:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-18T10:45:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-18T10:45:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-18T10:45:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-18T10:45:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-18T10:45:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-18T10:45:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-18T10:45:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-18T10:45:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-18T10:45:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-18T10:45:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-18T10:45:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-18T10:45:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-18T10:45:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-18T10:45:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-18T10:45:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-18T10:45:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-18T10:45:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-18T10:45:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-18T10:45:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-18T10:45:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-18T10:45:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-18T10:45:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-18T10:45:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-18T10:45:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-18T10:45:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-18T10:45:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-18T10:45:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-18T10:45:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-18T10:45:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-18T10:45:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-18T10:45:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-18T10:45:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-18T10:45:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-18T10:45:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-18T10:45:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-18T10:45:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-18T10:45:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-18T10:45:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-18T10:45:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-18T10:45:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-18T10:45:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-18T10:45:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-18T10:45:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-18T10:45:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-18T10:45:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-18T10:45:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-18T10:45:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-18T10:45:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-18T10:45:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-18T10:45:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-18T10:45:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-18T10:45:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-18T10:45:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-18T10:45:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-18T10:45:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-18T10:45:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-18T10:45:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-18T10:45:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-18T10:45:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-18T10:45:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-18T10:45:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-18T10:45:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-18T10:45:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-18T10:45:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-18T10:45:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-18T10:45:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-18T10:45:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-18T10:45:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-18T10:45:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-18T10:45:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-18T10:45:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-18T10:45:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-18T10:45:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-18T10:45:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-18T10:45:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-18T10:45:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-18T10:45:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-18T10:45:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-18T10:45:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-18T10:45:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-18T10:45:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-18T10:45:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-18T10:45:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-18T10:45:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-18T10:45:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-18T10:45:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-18T10:45:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-18T10:45:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-18T10:45:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-18T10:45:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-18T10:45:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-18T10:45:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-18T10:45:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-18T10:45:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-18T10:45:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-18T10:45:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-18T10:45:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-18T10:45:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-18T10:45:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-18T10:45:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-18T10:45:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-18T10:45:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-18T10:45:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-18T10:45:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-18T10:45:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-18T10:45:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-18T10:45:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-18T10:45:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-18T10:45:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-18T10:45:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-18T10:45:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-18T10:45:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-18T10:45:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-18T10:45:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-18T10:45:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-18T10:45:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-18T10:45:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-18T10:45:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-18T10:45:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-18T10:45:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-18T10:45:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-18T10:45:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-18T10:45:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-18T10:45:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-18T10:45:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-18T10:45:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-18T10:45:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-18T10:45:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-18T10:45:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-18T10:45:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-18T10:45:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-18T10:45:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-18T10:45:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-18T10:45:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-18T10:45:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-18T10:45:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-18T10:45:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-18T10:45:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-18T10:45:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-18T10:45:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-18T10:45:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-18T10:45:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-18T10:45:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-18T10:45:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-18T10:45:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-18T10:45:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-18T10:45:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-18T10:45:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-18T10:45:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-18T10:45:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-18T10:45:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-18T10:45:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-18T10:45:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-18T10:45:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-18T10:45:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-18T10:45:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-18T10:45:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-18T10:45:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-18T10:45:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-18T10:45:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-18T10:45:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-18T10:45:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-18T10:45:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-18T10:45:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-18T10:45:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-18T10:45:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-18T10:45:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-18T10:45:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-18T10:45:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-18T10:45:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-18T10:45:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-18T10:45:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-18T10:45:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-18T10:45:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-18T10:45:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-18T10:45:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-18T10:45:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-18T10:45:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-18T10:45:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-18T10:45:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-18T10:45:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-18T10:45:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-18T10:45:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-18T10:45:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-18T10:45:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-18T10:45:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-18T10:45:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-18T10:45:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-18T10:45:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-18T10:45:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-18T10:45:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-18T10:45:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-18T10:45:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-18T10:45:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-18T10:45:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-18T10:45:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-18T10:45:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-18T10:45:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-18T10:45:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-18T10:45:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-18T10:45:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-18T10:45:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-18T10:45:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-18T10:45:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-18T10:45:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-18T10:45:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-18T10:45:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-18T10:45:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-18T10:45:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-18T10:45:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-18T10:45:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-18T10:45:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-18T10:45:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-18T10:45:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-18T10:45:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-18T10:45:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-18T10:45:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-18T10:45:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-18T10:45:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-18T10:45:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-18T10:45:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-18T10:45:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-18T10:45:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-18T10:45:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-18T10:45:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-18T10:45:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-18T10:45:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-18T10:45:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-18T10:45:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-18T10:45:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-18T10:45:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-18T10:45:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-18T10:45:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-18T10:45:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-18T10:45:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-18T10:45:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-18T10:45:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-18T10:45:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-18T10:45:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-18T10:45:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-18T10:45:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-18T10:45:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-18T10:45:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-18T10:45:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-18T10:45:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-18T10:45:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-18T10:45:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-18T10:45:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-18T10:45:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-18T10:45:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-18T10:45:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-18T10:45:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-18T10:45:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-18T10:45:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-18T10:45:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-18T10:45:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-18T10:45:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-18T10:45:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-18T10:45:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-18T10:45:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-18T10:45:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-18T10:45:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-18T10:45:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-18T10:45:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-18T10:45:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-18T10:45:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-18T10:45:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-18T10:45:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-18T10:45:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-18T10:45:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-18T10:45:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-18T10:45:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-18T10:45:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-18T10:45:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-18T10:45:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-18T10:45:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-18T10:45:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-18T10:45:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-18T10:45:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-18T10:45:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-18T10:45:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-18T10:45:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-18T10:45:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-18T10:45:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-18T10:45:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-18T10:45:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-18T10:45:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-18T10:45:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-18T10:45:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-18T10:45:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-18T10:45:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-18T10:45:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-18T10:45:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-18T10:45:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-18T10:45:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-18T10:45:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-18T10:45:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-18T10:45:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-18T10:45:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-18T10:45:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-18T10:45:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-18T10:45:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-18T10:45:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-18T10:45:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-18T10:45:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-18T10:45:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-18T10:45:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-18T10:45:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-18T10:45:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-18T10:45:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-18T10:45:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-18T10:45:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-18T10:45:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-18T10:45:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-18T10:45:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-18T10:45:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-18T10:45:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-18T10:45:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-18T10:45:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-18T10:45:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-18T10:45:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-18T10:45:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-18T10:45:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-18T10:45:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-18T10:45:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-18T10:45:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-18T10:45:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-18T10:45:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-18T10:45:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-18T10:45:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-18T10:45:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-18T10:45:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-18T10:45:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-18T10:45:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-18T10:45:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-18T10:45:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-18T10:45:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-18T10:45:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-18T10:45:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-18T10:45:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-18T10:45:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-18T10:45:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-18T10:45:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-18T10:45:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-18T10:45:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-18T10:45:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-18T10:45:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-18T10:45:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-18T10:45:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-18T10:45:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-18T10:45:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-18T10:45:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-18T10:45:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-18T10:45:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-18T10:45:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-18T10:45:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-18T10:45:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-18T10:45:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-18T10:45:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-18T10:45:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-18T10:45:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-18T10:45:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-18T10:45:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-18T10:45:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-18T10:45:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-18T10:45:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-18T10:45:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-18T10:45:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-18T10:45:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-18T10:45:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-18T10:45:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-18T10:45:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-18T10:45:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-18T10:45:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-18T10:45:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-18T10:45:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-18T10:45:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-18T10:45:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-18T10:45:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-18T10:45:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-18T10:45:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-18T10:45:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-18T10:45:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-18T10:45:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-18T10:45:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-18T10:45:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-18T10:45:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-18T10:45:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-18T10:45:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-18T10:45:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-18T10:45:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-18T10:45:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-18T10:45:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-18T10:45:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-18T10:45:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-18T10:45:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-18T10:45:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-18T10:45:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-18T10:45:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-18T10:45:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-18T10:45:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-18T10:45:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-18T10:45:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-18T10:45:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-18T10:45:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-18T10:45:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-18T10:45:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-18T10:45:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-18T10:45:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-18T10:45:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-18T10:45:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-18T10:45:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-18T10:45:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-18T10:45:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-18T10:45:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-18T10:45:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-18T10:45:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-18T10:45:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-18T10:45:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-18T10:45:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-18T10:45:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-18T10:45:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-18T10:45:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-18T10:45:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-18T10:45:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-18T10:45:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-18T10:45:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-18T10:45:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-18T10:45:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-18T10:45:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-18T10:45:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-18T10:45:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-18T10:45:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-18T10:45:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-18T10:45:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-18T10:45:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-18T10:45:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-18T10:45:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-18T10:45:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-18T10:45:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-18T10:45:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-18T10:45:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-18T10:45:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-18T10:45:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-18T10:45:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-18T10:45:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-18T10:45:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-18T10:45:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-18T10:45:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-18T10:45:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-18T10:45:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-18T10:45:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-18T10:45:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-18T10:45:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-18T10:45:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-18T10:45:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-18T10:45:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-18T10:45:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-18T10:45:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-18T10:45:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-18T10:45:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-18T10:45:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-18T10:45:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-18T10:45:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-18T10:45:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-18T10:45:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-18T10:45:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-18T10:45:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-18T10:45:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-18T10:45:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-18T10:45:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-18T10:45:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-18T10:45:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-18T10:45:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-18T10:45:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-18T10:45:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-18T10:45:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-18T10:45:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-18T10:45:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-18T10:45:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-18T10:45:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-18T10:45:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-18T10:45:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-18T10:45:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-18T10:45:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-18T10:45:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-18T10:45:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-18T10:45:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-18T10:45:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-18T10:45:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-18T10:45:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-18T10:45:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-18T10:45:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-18T10:45:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-18T10:45:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-18T10:45:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-18T10:45:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-18T10:45:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-18T10:45:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-18T10:45:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-18T10:45:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-18T10:45:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-18T10:45:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-18T10:45:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-18T10:45:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-18T10:45:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-18T10:45:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-18T10:45:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-18T10:45:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-18T10:45:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-18T10:45:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-18T10:45:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-18T10:45:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-18T10:45:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-18T10:45:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-18T10:45:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-18T10:45:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-18T10:45:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-18T10:45:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-18T10:45:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-18T10:45:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-18T10:45:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-18T10:45:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-18T10:45:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-18T10:45:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-18T10:45:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-18T10:45:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-18T10:45:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-18T10:45:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-18T10:45:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-18T10:45:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-18T10:45:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-18T10:45:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-18T10:45:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-18T10:45:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-18T10:45:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-18T10:45:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-18T10:45:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-18T10:45:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-18T10:45:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-18T10:45:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-18T10:45:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-18T10:45:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-18T10:45:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-18T10:45:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-18T10:45:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-18T10:45:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-18T10:45:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-18T10:45:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-18T10:45:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-18T10:45:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-18T10:45:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-18T10:45:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-18T10:45:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-18T10:45:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-18T10:45:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-18T10:45:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-18T10:45:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-18T10:45:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-18T10:45:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-18T10:45:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-18T10:45:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-18T10:45:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-18T10:45:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-18T10:45:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-18T10:45:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-18T10:45:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-18T10:45:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-18T10:45:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-18T10:45:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-18T10:45:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-18T10:45:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-18T10:45:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-18T10:45:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-18T10:45:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-18T10:45:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-18T10:45:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-18T10:45:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-18T10:45:07.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-18T10:45:07.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-18T10:45:07.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-18T10:45:07.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-18T10:45:07.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-18T10:45:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-18T10:45:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-18T10:45:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-18T10:45:07.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-18T10:45:07.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-18T10:45:07.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-18T10:45:07.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-18T10:45:07.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-18T10:45:07.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-18T10:45:07.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-18T10:45:07.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-18T10:45:07.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-18T10:45:07.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-18T10:45:07.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-18T10:45:07.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-18T10:45:07.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-18T10:45:07.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-18T10:45:07.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-18T10:45:07.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-18T10:45:07.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-18T10:45:07.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-18T10:45:07.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-18T10:45:07.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-18T10:45:07.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-18T10:45:07.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-18T10:45:07.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-18T10:45:07.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-18T10:45:07.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-18T10:45:07.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-18T10:45:07.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-18T10:45:07.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-18T10:45:07.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-18T10:45:07.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-18T10:45:07.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-18T10:45:07.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-18T10:45:07.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-18T10:45:07.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-18T10:45:07.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-18T10:45:07.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-18T10:45:07.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-18T10:45:07.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-18T10:45:07.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-18T10:45:07.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-18T10:45:07.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-18T10:45:07.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-18T10:45:07.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-18T10:45:07.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-18T10:45:07.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-18T10:45:07.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-18T10:45:07.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-18T10:45:07.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-18T10:45:07.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-18T10:45:07.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-18T10:45:07.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-18T10:45:07.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-18T10:45:07.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-18T10:45:07.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-18T10:45:07.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-18T10:45:07.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-18T10:45:07.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-18T10:45:07.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-18T10:45:07.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-18T10:45:07.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-18T10:45:07.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-18T10:45:07.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-18T10:45:07.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-18T10:45:07.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-18T10:45:07.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-18T10:45:07.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-18T10:45:07.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-18T10:45:07.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-18T10:45:07.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-18T10:45:07.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-18T10:45:07.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-18T10:45:07.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-18T10:45:07.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-18T10:45:07.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-18T10:45:07.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-18T10:45:07.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-18T10:45:07.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-18T10:45:07.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-18T10:45:07.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-18T10:45:07.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-18T10:45:07.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-18T10:45:07.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-18T10:45:07.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-18T10:45:07.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-18T10:45:07.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-18T10:45:07.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-18T10:45:07.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-18T10:45:07.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-18T10:45:07.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-18T10:45:07.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-18T10:45:07.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-18T10:45:07.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-18T10:45:07.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-18T10:45:07.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-18T10:45:07.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-18T10:45:07.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-18T10:45:07.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-18T10:45:07.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-18T10:45:07.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-18T10:45:07.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-18T10:45:07.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-18T10:45:07.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-18T10:45:07.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-18T10:45:07.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-18T10:45:07.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-18T10:45:07.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-18T10:45:07.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-18T10:45:07.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-18T10:45:07.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-18T10:45:07.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-18T10:45:07.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-18T10:45:07.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-18T10:45:07.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-18T10:45:07.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-18T10:45:07.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-18T10:45:07.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-18T10:45:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-18T10:45:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-18T10:45:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-18T10:45:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-18T10:45:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-18T10:45:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-18T10:45:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-18T10:45:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-18T10:45:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-18T10:45:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-18T10:45:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-18T10:45:07.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-18T10:45:07.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-18T10:45:07.363 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-18T10:45:07.363 DEBUG:teuthology.orchestra.run.smithi151:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-18T10:45:07.387 INFO:teuthology.orchestra.run.smithi151.stdout:postinstall scriptlet (using /bin/sh): 2023-10-18T10:45:07.387 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-18T10:45:07.387 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-18T10:45:07.388 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T10:45:07.388 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T10:45:07.388 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T10:45:07.388 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T10:45:07.388 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-10-18T10:45:07.389 INFO:teuthology.orchestra.run.smithi151.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-18T10:45:07.389 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-18T10:45:07.389 INFO:teuthology.orchestra.run.smithi151.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-18T10:45:07.389 INFO:teuthology.orchestra.run.smithi151.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-18T10:45:07.390 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-18T10:45:07.390 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-10-18T10:45:07.390 INFO:teuthology.orchestra.run.smithi151.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-18T10:45:07.390 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-18T10:45:07.390 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-18T10:45:07.391 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-10-18T10:45:07.391 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2023-10-18T10:45:07.463 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2023-10-18T10:45:07.464 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2023-10-18T10:45:07.464 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.06 2023-10-18T10:45:07.464 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 68.el9 2023-10-18T10:45:07.464 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2023-10-18T10:45:07.465 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-18T10:45:07.465 INFO:teuthology.orchestra.run.smithi151.stdout:Group : Unspecified 2023-10-18T10:45:07.465 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 8264254 2023-10-18T10:45:07.465 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2023-10-18T10:45:07.465 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-18T10:45:07.466 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-18T10:45:07.466 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-18T10:45:07.466 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-18T10:45:07.466 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : builder@centos.org 2023-10-18T10:45:07.466 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2023-10-18T10:45:07.467 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-18T10:45:07.467 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2023-10-18T10:45:07.467 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2023-10-18T10:45:07.467 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T10:45:07.467 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-18T10:45:07.468 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-18T10:45:07.468 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-18T10:45:07.468 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2023-10-18T10:45:07.468 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T10:45:07.468 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2023-10-18T10:45:07.469 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-18T10:45:07.470 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 6.6.0-rc5-g47672119149b 2023-10-18T10:45:07.470 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-18T10:45:08.091 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2023-10-18T10:45:09.560 INFO:teuthology.orchestra.run.smithi151.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-18T10:45:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:done 2023-10-18T10:45:09.604 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-10-18T10:45:09.620 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.iMydDTbYnt 2023-10-18T10:45:09.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iMydDTbYnt 2023-10-18T10:45:09.690 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.iMydDTbYnt 2023-10-18T10:45:09.833 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.iMydDTbYnt is 6KB 2023-10-18T10:45:09.881 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.iMydDTbYnt 2023-10-18T10:45:09.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2023-10-18T10:45:09.959 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-18T10:45:09.960 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-18T10:45:09.960 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-18T10:45:09.960 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-18T10:45:09.961 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-18T10:45:10.136 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2023-10-18T10:45:40.140 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-18T10:45:40.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T10:45:40.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T10:45:58.526 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-18T10:46:07.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T10:46:07.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T10:46:10.586 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-18T10:46:22.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T10:46:22.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T10:46:41.018 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-18T10:46:56.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T10:46:56.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T10:46:59.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-18T10:47:17.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T10:47:17.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T10:47:17.570 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-18T10:47:18.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T10:47:18.194 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g47672119149b"... 2023-10-18T10:47:18.195 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-10-18T10:47:18.239 INFO:teuthology.orchestra.run.smithi151.stdout:6.6.0-rc5-g47672119149b 2023-10-18T10:47:18.240 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-18T10:47:18.241 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-18T10:47:18.241 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-18T10:47:19.243 DEBUG:teuthology.parallel:result is None 2023-10-18T10:47:19.243 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-18T10:47:19.251 INFO:teuthology.task.internal:Creating test directory... 2023-10-18T10:47:19.251 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T10:47:19.261 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T10:47:19.307 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-18T10:47:19.314 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-18T10:47:19.321 INFO:teuthology.task.internal:Creating archive directory... 2023-10-18T10:47:19.322 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T10:47:19.326 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T10:47:19.393 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-18T10:47:19.408 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-18T10:47:19.408 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T10:47:19.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T10:47:19.425 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T10:47:19.433 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T10:47:19.522 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T10:47:19.544 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T10:47:19.572 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T10:47:19.637 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T10:47:19.641 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-18T10:47:19.649 INFO:teuthology.task.internal:Configuring sudo... 2023-10-18T10:47:19.649 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T10:47:19.655 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T10:47:19.738 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-18T10:47:19.747 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-18T10:47:19.747 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T10:47:19.752 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T10:47:19.789 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T10:47:19.906 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T10:47:20.115 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T10:47:20.203 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T10:47:20.283 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T10:47:20.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T10:47:20.362 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T10:47:20.407 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T10:47:20.464 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T10:47:20.549 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T10:47:20.592 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T10:47:20.592 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T10:47:20.660 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-10-18T10:47:20.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2023-10-18T10:47:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T10:47:20.792 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T10:47:21.214 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-18T10:47:21.223 INFO:teuthology.task.internal:Starting timer... 2023-10-18T10:47:21.223 INFO:teuthology.run_tasks:Running task pcp... 2023-10-18T10:47:21.291 INFO:teuthology.run_tasks:Running task selinux... 2023-10-18T10:47:21.300 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-10-18T10:47:21.452 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-10-18T10:47:21.456 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2023-10-18T10:47:21.520 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2023-10-18T10:47:21.522 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-18T10:47:21.523 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-10-18T10:47:21.587 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-10-18T10:47:21.587 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2023-10-18T10:47:21.610 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2023-10-18T10:47:21.610 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi151.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2023-10-18T10:47:21.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T10:47:21.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T10:47:21.712 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T10:47:21.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T10:47:21.742 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-18T10:47:21.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-10-18T10:47:21.856 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2023-10-18T10:47:21.887 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-18T10:47:21.936 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-18T10:47:21.941 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-18T10:47:22.063 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-18T10:47:22.085 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-18T10:47:22.087 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi151.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-18T10:59:40.068 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi151.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2023-10-18T10:59:40.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T10:59:40.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T10:59:40.212 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-18T10:59:40.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-18T10:59:40.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-18T10:59:40.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T10:59:40.462 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-10-18T10:59:40.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-18T10:59:40.537 INFO:teuthology.run_tasks:Running task clock... 2023-10-18T10:59:40.549 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-18T10:59:40.550 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T10:59:40.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T10:59:40.559 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T10:59:40.559 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T10:59:40.605 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T10:59:40.622 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T10:59:40.651 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2023-10-18T10:59:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T10:59:40.665 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2023-10-18T10:59:40.682 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T10:59:40.698 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T10:59:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T10:59:40.742 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2023-10-18T10:59:40.745 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T10:59:40.745 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2023-10-18T10:59:40.746 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T10:59:40.746 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T10:59:40.746 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T10:59:40.746 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T10:59:40.811 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-10-18T10:59:40.851 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-10-18T10:59:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T10:59:40.956 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T10:59:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-10-18T10:59:41.086 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T10:59:41.087 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-10-18T10:59:41.087 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T10:59:41.087 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T10:59:41.087 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T10:59:41.087 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T10:59:41.088 INFO:teuthology.run_tasks:Running task install... 2023-10-18T10:59:41.098 DEBUG:teuthology.task.install:project ceph 2023-10-18T10:59:41.098 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4'}} 2023-10-18T10:59:41.099 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4'} 2023-10-18T10:59:41.099 INFO:teuthology.task.install:Using flavor: default 2023-10-18T10:59:41.105 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-10-18T10:59:41.105 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-18T10:59:41.106 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4', 'tag': None, 'wait_for_package': False} 2023-10-18T10:59:41.106 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=189714d033726ae2ce7d2d105c75781f0aec48f4 2023-10-18T10:59:41.108 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4', 'tag': None, 'wait_for_package': False} 2023-10-18T10:59:41.109 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=189714d033726ae2ce7d2d105c75781f0aec48f4 2023-10-18T10:59:41.254 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231013.093215-1/189714d033726ae2ce7d2d105c75781f0aec48f4/centos/9/flavors/default/ 2023-10-18T10:59:41.254 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6713.g189714d0 2023-10-18T10:59:41.324 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231013.093215-1/189714d033726ae2ce7d2d105c75781f0aec48f4/centos/9/flavors/default/ 2023-10-18T10:59:41.325 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6713.g189714d0 2023-10-18T10:59:41.374 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231013.093215-1/189714d033726ae2ce7d2d105c75781f0aec48f4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231013.093215-1/189714d033726ae2ce7d2d105c75781f0aec48f4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231013.093215-1/189714d033726ae2ce7d2d105c75781f0aec48f4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T10:59:41.375 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T10:59:41.375 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T10:59:41.405 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-18T10:59:41.405 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/189714d033726ae2ce7d2d105c75781f0aec48f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T10:59:41.473 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T10:59:41.492 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231013.093215-1/189714d033726ae2ce7d2d105c75781f0aec48f4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231013.093215-1/189714d033726ae2ce7d2d105c75781f0aec48f4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231013.093215-1/189714d033726ae2ce7d2d105c75781f0aec48f4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T10:59:41.493 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T10:59:41.493 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T10:59:41.554 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T10:59:41.598 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-18T10:59:41.598 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/189714d033726ae2ce7d2d105c75781f0aec48f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T10:59:41.621 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2023-10-18T10:59:41.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2023-10-18T10:59:41.742 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T10:59:41.855 INFO:teuthology.orchestra.run.smithi169.stdout:72 files removed 2023-10-18T10:59:41.871 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T10:59:41.882 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-18T10:59:41.954 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-10-18T10:59:41.958 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-10-18T10:59:42.304 INFO:teuthology.orchestra.run.smithi151.stdout:72 files removed 2023-10-18T10:59:42.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-18T10:59:42.625 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 172 kB/s | 78 kB 00:00 2023-10-18T10:59:42.993 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-10-18T10:59:43.314 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 169 kB/s | 78 kB 00:00 2023-10-18T10:59:43.418 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2023-10-18T10:59:43.854 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS-9 - AppStream 15 MB/s | 6.3 MB 00:00 2023-10-18T10:59:43.873 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-10-18T10:59:44.415 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2023-10-18T10:59:45.135 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 9.7 MB/s | 6.3 MB 00:00 2023-10-18T10:59:45.279 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-10-18T10:59:46.685 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2023-10-18T10:59:46.812 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 7.9 MB 00:01 2023-10-18T10:59:47.632 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-10-18T10:59:48.779 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-10-18T10:59:52.824 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 18 MB 00:04 2023-10-18T10:59:54.230 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 5.7 MB 00:02 2023-10-18T10:59:56.472 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 14 kB 00:01 2023-10-18T10:59:56.975 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.7 MB 00:00 2023-10-18T10:59:57.265 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 28 MB/s | 19 MB 00:00 2023-10-18T10:59:58.500 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 14 kB 00:00 2023-10-18T11:00:00.257 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 12 MB/s | 19 MB 00:01 2023-10-18T11:00:01.815 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-10-18T11:00:04.044 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-18T11:00:04.044 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-18T11:00:04.075 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-18T11:00:04.076 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-18T11:00:04.077 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-18T11:00:04.078 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-18T11:00:04.080 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-18T11:00:04.083 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-18T11:00:04.084 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-18T11:00:04.156 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2023-10-18T11:00:04.171 INFO:teuthology.orchestra.run.smithi169.stdout:==================================================================================================== 2023-10-18T11:00:04.171 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2023-10-18T11:00:04.171 INFO:teuthology.orchestra.run.smithi169.stdout:==================================================================================================== 2023-10-18T11:00:04.171 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2023-10-18T11:00:04.172 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-18T11:00:04.172 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:18.0.0-6713.g189714d0.el9 ceph 6.5 k 2023-10-18T11:00:04.172 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:18.0.0-6713.g189714d0.el9 ceph 5.2 M 2023-10-18T11:00:04.172 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 74 M 2023-10-18T11:00:04.172 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 410 M 2023-10-18T11:00:04.173 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:18.0.0-6713.g189714d0.el9 ceph 855 k 2023-10-18T11:00:04.173 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 5.8 M 2023-10-18T11:00:04.173 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6713.g189714d0.el9 ceph 141 k 2023-10-18T11:00:04.173 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 1.4 M 2023-10-18T11:00:04.173 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 47 M 2023-10-18T11:00:04.174 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:18.0.0-6713.g189714d0.el9 ceph 1.5 M 2023-10-18T11:00:04.174 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 132 k 2023-10-18T11:00:04.174 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 1.8 M 2023-10-18T11:00:04.174 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 19 M 2023-10-18T11:00:04.175 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 7.4 M 2023-10-18T11:00:04.175 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 47 k 2023-10-18T11:00:04.175 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 112 M 2023-10-18T11:00:04.175 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 315 M 2023-10-18T11:00:04.175 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:18.0.0-6713.g189714d0.el9 ceph 8.6 M 2023-10-18T11:00:04.176 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 174 M 2023-10-18T11:00:04.176 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:18.0.0-6713.g189714d0.el9 ceph 41 M 2023-10-18T11:00:04.176 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 625 M 2023-10-18T11:00:04.176 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 262 k 2023-10-18T11:00:04.176 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 269 k 2023-10-18T11:00:04.177 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:18.0.0-6713.g189714d0.el9 ceph 218 k 2023-10-18T11:00:04.177 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 18 k 2023-10-18T11:00:04.177 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-18T11:00:04.177 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-18T11:00:04.177 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-18T11:00:04.178 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:18.0.0-6713.g189714d0.el9 ceph 31 k 2023-10-18T11:00:04.178 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 715 k 2023-10-18T11:00:04.178 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 5.1 M 2023-10-18T11:00:04.178 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:18.0.0-6713.g189714d0.el9 ceph 126 k 2023-10-18T11:00:04.178 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 108 k 2023-10-18T11:00:04.179 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 45 M 2023-10-18T11:00:04.179 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 51 M 2023-10-18T11:00:04.179 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-18T11:00:04.179 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-18T11:00:04.179 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-18T11:00:04.180 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-18T11:00:04.180 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-18T11:00:04.180 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-18T11:00:04.180 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:18.0.0-6713.g189714d0.el9 ceph 161 k 2023-10-18T11:00:04.180 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 614 k 2023-10-18T11:00:04.181 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:18.0.0-6713.g189714d0.el9 ceph 321 k 2023-10-18T11:00:04.181 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 769 k 2023-10-18T11:00:04.181 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:18.0.0-6713.g189714d0.el9 ceph 298 k 2023-10-18T11:00:04.181 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 1.1 M 2023-10-18T11:00:04.181 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:18.0.0-6713.g189714d0.el9 ceph 99 k 2023-10-18T11:00:04.182 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 337 k 2023-10-18T11:00:04.182 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:18.0.0-6713.g189714d0.el9 ceph 85 k 2023-10-18T11:00:04.182 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 506 k 2023-10-18T11:00:04.182 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:18.0.0-6713.g189714d0.el9 ceph 3.0 M 2023-10-18T11:00:04.183 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 51 M 2023-10-18T11:00:04.183 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:18.0.0-6713.g189714d0.el9 ceph 169 k 2023-10-18T11:00:04.183 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 1.2 M 2023-10-18T11:00:04.183 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-18T11:00:04.183 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2023-10-18T11:00:04.184 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-18T11:00:04.184 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-18T11:00:04.184 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-18T11:00:04.184 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-18T11:00:04.184 INFO:teuthology.orchestra.run.smithi169.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-18T11:00:04.184 INFO:teuthology.orchestra.run.smithi169.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-18T11:00:04.185 INFO:teuthology.orchestra.run.smithi169.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-18T11:00:04.185 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 3.3 M 2023-10-18T11:00:04.185 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 3.0 M 2023-10-18T11:00:04.185 INFO:teuthology.orchestra.run.smithi169.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-18T11:00:04.185 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2023-10-18T11:00:04.186 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-18T11:00:04.186 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-18T11:00:04.186 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:18.0.0-6713.g189714d0.el9 ceph 19 M 2023-10-18T11:00:04.186 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 20 M 2023-10-18T11:00:04.186 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 23 k 2023-10-18T11:00:04.187 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:18.0.0-6713.g189714d0.el9 ceph 2.1 M 2023-10-18T11:00:04.187 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 242 k 2023-10-18T11:00:04.187 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:18.0.0-6713.g189714d0.el9 ceph 4.4 M 2023-10-18T11:00:04.187 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:18.0.0-6713.g189714d0.el9 ceph 18 M 2023-10-18T11:00:04.188 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 15 k 2023-10-18T11:00:04.188 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:18.0.0-6713.g189714d0.el9 ceph 24 k 2023-10-18T11:00:04.188 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-18T11:00:04.188 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-18T11:00:04.188 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-18T11:00:04.189 INFO:teuthology.orchestra.run.smithi169.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-18T11:00:04.189 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-18T11:00:04.189 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-18T11:00:04.189 INFO:teuthology.orchestra.run.smithi169.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-18T11:00:04.189 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-18T11:00:04.190 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-18T11:00:04.190 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:18.0.0-6713.g189714d0.el9 ceph 164 k 2023-10-18T11:00:04.190 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-18T11:00:04.190 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-18T11:00:04.190 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-18T11:00:04.191 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-18T11:00:04.191 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-18T11:00:04.191 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 472 k 2023-10-18T11:00:04.191 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-18T11:00:04.191 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 4.8 M 2023-10-18T11:00:04.192 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-18T11:00:04.192 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-18T11:00:04.193 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-18T11:00:04.193 INFO:teuthology.orchestra.run.smithi169.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-18T11:00:04.193 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-18T11:00:04.193 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-18T11:00:04.194 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-18T11:00:04.194 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-18T11:00:04.194 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-18T11:00:04.194 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-18T11:00:04.194 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-18T11:00:04.195 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-18T11:00:04.195 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:18.0.0-6713.g189714d0.el9 ceph 45 k 2023-10-18T11:00:04.195 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:18.0.0-6713.g189714d0.el9 ceph 127 k 2023-10-18T11:00:04.195 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-18T11:00:04.195 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-18T11:00:04.195 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-18T11:00:04.196 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-18T11:00:04.196 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-18T11:00:04.196 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-18T11:00:04.196 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-18T11:00:04.197 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-18T11:00:04.197 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-18T11:00:04.197 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-18T11:00:04.197 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-18T11:00:04.197 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-18T11:00:04.197 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-18T11:00:04.198 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-18T11:00:04.198 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-18T11:00:04.198 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-18T11:00:04.198 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-18T11:00:04.198 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-18T11:00:04.199 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-18T11:00:04.199 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-18T11:00:04.199 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-18T11:00:04.199 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-18T11:00:04.199 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-18T11:00:04.200 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-18T11:00:04.200 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-18T11:00:04.200 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-18T11:00:04.200 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-18T11:00:04.200 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-18T11:00:04.201 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-18T11:00:04.201 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-18T11:00:04.201 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-18T11:00:04.201 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-18T11:00:04.201 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-18T11:00:04.202 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-18T11:00:04.202 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-18T11:00:04.202 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-18T11:00:04.202 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-18T11:00:04.202 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-18T11:00:04.203 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-18T11:00:04.203 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-18T11:00:04.203 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-18T11:00:04.203 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-18T11:00:04.203 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-18T11:00:04.204 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-18T11:00:04.204 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-18T11:00:04.204 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-18T11:00:04.204 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-18T11:00:04.204 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-18T11:00:04.205 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-18T11:00:04.205 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-18T11:00:04.205 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-18T11:00:04.205 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-18T11:00:04.205 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-18T11:00:04.206 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-18T11:00:04.206 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2023-10-18T11:00:04.206 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-18T11:00:04.206 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:00:04.207 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2023-10-18T11:00:04.207 INFO:teuthology.orchestra.run.smithi169.stdout:==================================================================================================== 2023-10-18T11:00:04.207 INFO:teuthology.orchestra.run.smithi169.stdout:Install 155 Packages 2023-10-18T11:00:04.207 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 10 Packages 2023-10-18T11:00:04.207 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:00:04.208 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 2.1 G 2023-10-18T11:00:04.208 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2023-10-18T11:00:04.808 INFO:teuthology.orchestra.run.smithi169.stdout:(1/165): ceph-18.0.0-6713.g189714d0.el9.x86_64. 38 kB/s | 6.5 kB 00:00 2023-10-18T11:00:05.275 INFO:teuthology.orchestra.run.smithi169.stdout:(2/165): ceph-base-18.0.0-6713.g189714d0.el9.x8 8.1 MB/s | 5.2 MB 00:00 2023-10-18T11:00:05.418 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2023-10-18T11:00:07.862 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-18T11:00:07.864 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-18T11:00:07.903 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-18T11:00:07.904 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-18T11:00:07.905 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-18T11:00:07.906 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-18T11:00:07.908 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-18T11:00:07.911 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-18T11:00:07.912 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-18T11:00:07.989 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-18T11:00:08.038 INFO:teuthology.orchestra.run.smithi151.stdout:==================================================================================================== 2023-10-18T11:00:08.039 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-18T11:00:08.039 INFO:teuthology.orchestra.run.smithi151.stdout:==================================================================================================== 2023-10-18T11:00:08.039 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-18T11:00:08.039 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-18T11:00:08.040 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:18.0.0-6713.g189714d0.el9 ceph 6.5 k 2023-10-18T11:00:08.040 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:18.0.0-6713.g189714d0.el9 ceph 5.2 M 2023-10-18T11:00:08.040 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 74 M 2023-10-18T11:00:08.040 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 410 M 2023-10-18T11:00:08.041 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:18.0.0-6713.g189714d0.el9 ceph 855 k 2023-10-18T11:00:08.041 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 5.8 M 2023-10-18T11:00:08.041 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6713.g189714d0.el9 ceph 141 k 2023-10-18T11:00:08.041 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 1.4 M 2023-10-18T11:00:08.042 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 47 M 2023-10-18T11:00:08.042 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:18.0.0-6713.g189714d0.el9 ceph 1.5 M 2023-10-18T11:00:08.042 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 132 k 2023-10-18T11:00:08.043 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 1.8 M 2023-10-18T11:00:08.043 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 19 M 2023-10-18T11:00:08.043 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 7.4 M 2023-10-18T11:00:08.043 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 47 k 2023-10-18T11:00:08.044 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 112 M 2023-10-18T11:00:08.044 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 315 M 2023-10-18T11:00:08.044 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:18.0.0-6713.g189714d0.el9 ceph 8.6 M 2023-10-18T11:00:08.044 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 174 M 2023-10-18T11:00:08.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:18.0.0-6713.g189714d0.el9 ceph 41 M 2023-10-18T11:00:08.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 625 M 2023-10-18T11:00:08.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 262 k 2023-10-18T11:00:08.045 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 269 k 2023-10-18T11:00:08.046 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:18.0.0-6713.g189714d0.el9 ceph 218 k 2023-10-18T11:00:08.046 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 18 k 2023-10-18T11:00:08.046 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-18T11:00:08.046 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-18T11:00:08.047 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-18T11:00:08.047 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:18.0.0-6713.g189714d0.el9 ceph 31 k 2023-10-18T11:00:08.047 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 715 k 2023-10-18T11:00:08.048 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 5.1 M 2023-10-18T11:00:08.048 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:18.0.0-6713.g189714d0.el9 ceph 126 k 2023-10-18T11:00:08.048 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 108 k 2023-10-18T11:00:08.048 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 45 M 2023-10-18T11:00:08.049 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 51 M 2023-10-18T11:00:08.049 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-18T11:00:08.049 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-18T11:00:08.049 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-18T11:00:08.050 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-18T11:00:08.050 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-18T11:00:08.050 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-18T11:00:08.050 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:18.0.0-6713.g189714d0.el9 ceph 161 k 2023-10-18T11:00:08.050 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 614 k 2023-10-18T11:00:08.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:18.0.0-6713.g189714d0.el9 ceph 321 k 2023-10-18T11:00:08.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 769 k 2023-10-18T11:00:08.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:18.0.0-6713.g189714d0.el9 ceph 298 k 2023-10-18T11:00:08.051 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 1.1 M 2023-10-18T11:00:08.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:18.0.0-6713.g189714d0.el9 ceph 99 k 2023-10-18T11:00:08.052 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 337 k 2023-10-18T11:00:08.052 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:18.0.0-6713.g189714d0.el9 ceph 85 k 2023-10-18T11:00:08.052 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 506 k 2023-10-18T11:00:08.053 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:18.0.0-6713.g189714d0.el9 ceph 3.0 M 2023-10-18T11:00:08.053 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 51 M 2023-10-18T11:00:08.053 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:18.0.0-6713.g189714d0.el9 ceph 169 k 2023-10-18T11:00:08.053 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 1.2 M 2023-10-18T11:00:08.054 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-18T11:00:08.054 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-10-18T11:00:08.054 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-18T11:00:08.055 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-18T11:00:08.055 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-18T11:00:08.055 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-18T11:00:08.055 INFO:teuthology.orchestra.run.smithi151.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-18T11:00:08.056 INFO:teuthology.orchestra.run.smithi151.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-18T11:00:08.056 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-18T11:00:08.056 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 3.3 M 2023-10-18T11:00:08.056 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 3.0 M 2023-10-18T11:00:08.057 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-18T11:00:08.057 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-18T11:00:08.057 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-18T11:00:08.057 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-18T11:00:08.057 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:18.0.0-6713.g189714d0.el9 ceph 19 M 2023-10-18T11:00:08.058 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-debuginfo x86_64 2:18.0.0-6713.g189714d0.el9 ceph 20 M 2023-10-18T11:00:08.058 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 23 k 2023-10-18T11:00:08.059 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:18.0.0-6713.g189714d0.el9 ceph 2.1 M 2023-10-18T11:00:08.059 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 242 k 2023-10-18T11:00:08.059 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:18.0.0-6713.g189714d0.el9 ceph 4.4 M 2023-10-18T11:00:08.059 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:18.0.0-6713.g189714d0.el9 ceph 18 M 2023-10-18T11:00:08.060 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6713.g189714d0.el9 ceph-noarch 15 k 2023-10-18T11:00:08.060 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:18.0.0-6713.g189714d0.el9 ceph 24 k 2023-10-18T11:00:08.060 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-18T11:00:08.060 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-18T11:00:08.060 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-18T11:00:08.061 INFO:teuthology.orchestra.run.smithi151.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-18T11:00:08.061 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-18T11:00:08.061 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-18T11:00:08.061 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-18T11:00:08.061 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-18T11:00:08.062 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-18T11:00:08.062 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:18.0.0-6713.g189714d0.el9 ceph 164 k 2023-10-18T11:00:08.062 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-18T11:00:08.062 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-18T11:00:08.062 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-18T11:00:08.063 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-18T11:00:08.063 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-18T11:00:08.063 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 472 k 2023-10-18T11:00:08.063 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-18T11:00:08.063 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:18.0.0-6713.g189714d0.el9 ceph 4.8 M 2023-10-18T11:00:08.064 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-18T11:00:08.064 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-18T11:00:08.064 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-18T11:00:08.064 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-18T11:00:08.065 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-18T11:00:08.065 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-18T11:00:08.065 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-18T11:00:08.065 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-18T11:00:08.066 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-18T11:00:08.066 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-18T11:00:08.066 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-18T11:00:08.066 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-18T11:00:08.067 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:18.0.0-6713.g189714d0.el9 ceph 45 k 2023-10-18T11:00:08.067 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:18.0.0-6713.g189714d0.el9 ceph 127 k 2023-10-18T11:00:08.067 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-18T11:00:08.067 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-18T11:00:08.067 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-18T11:00:08.068 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-18T11:00:08.068 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-18T11:00:08.068 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-18T11:00:08.068 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-18T11:00:08.068 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-18T11:00:08.069 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-18T11:00:08.069 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-18T11:00:08.069 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-18T11:00:08.069 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-18T11:00:08.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-18T11:00:08.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-18T11:00:08.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-18T11:00:08.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-18T11:00:08.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-18T11:00:08.071 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-18T11:00:08.071 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-18T11:00:08.071 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-18T11:00:08.071 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-18T11:00:08.071 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-18T11:00:08.072 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-18T11:00:08.072 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-18T11:00:08.072 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-18T11:00:08.072 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-18T11:00:08.073 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-18T11:00:08.073 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-18T11:00:08.073 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-18T11:00:08.073 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-18T11:00:08.074 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-18T11:00:08.074 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-18T11:00:08.074 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-18T11:00:08.074 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-18T11:00:08.075 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-18T11:00:08.075 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-18T11:00:08.075 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-18T11:00:08.075 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-18T11:00:08.075 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-18T11:00:08.076 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-18T11:00:08.076 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-18T11:00:08.076 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-18T11:00:08.076 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-18T11:00:08.077 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-18T11:00:08.077 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-18T11:00:08.077 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-18T11:00:08.077 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-18T11:00:08.077 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-18T11:00:08.078 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-18T11:00:08.078 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-18T11:00:08.078 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-18T11:00:08.078 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-18T11:00:08.079 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-18T11:00:08.079 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-18T11:00:08.079 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2023-10-18T11:00:08.079 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-18T11:00:08.080 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:00:08.080 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-18T11:00:08.080 INFO:teuthology.orchestra.run.smithi151.stdout:==================================================================================================== 2023-10-18T11:00:08.080 INFO:teuthology.orchestra.run.smithi151.stdout:Install 155 Packages 2023-10-18T11:00:08.080 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 10 Packages 2023-10-18T11:00:08.081 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:00:08.081 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 2.1 G 2023-10-18T11:00:08.082 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-18T11:00:09.087 INFO:teuthology.orchestra.run.smithi151.stdout:(1/165): ceph-18.0.0-6713.g189714d0.el9.x86_64. 15 kB/s | 6.5 kB 00:00 2023-10-18T11:00:09.806 INFO:teuthology.orchestra.run.smithi151.stdout:(2/165): ceph-base-18.0.0-6713.g189714d0.el9.x8 4.5 MB/s | 5.2 MB 00:01 2023-10-18T11:00:11.633 INFO:teuthology.orchestra.run.smithi169.stdout:(3/165): ceph-base-debuginfo-18.0.0-6713.g18971 11 MB/s | 74 MB 00:06 2023-10-18T11:00:11.825 INFO:teuthology.orchestra.run.smithi169.stdout:(4/165): ceph-common-18.0.0-6713.g189714d0.el9. 2.7 MB/s | 19 MB 00:07 2023-10-18T11:00:12.359 INFO:teuthology.orchestra.run.smithi169.stdout:(5/165): ceph-fuse-18.0.0-6713.g189714d0.el9.x8 1.6 MB/s | 855 kB 00:00 2023-10-18T11:00:14.134 INFO:teuthology.orchestra.run.smithi169.stdout:(6/165): ceph-debuginfo-18.0.0-6713.g189714d0.e 8.1 MB/s | 20 MB 00:02 2023-10-18T11:00:14.250 INFO:teuthology.orchestra.run.smithi169.stdout:(7/165): ceph-immutable-object-cache-18.0.0-671 1.2 MB/s | 141 kB 00:00 2023-10-18T11:00:14.434 INFO:teuthology.orchestra.run.smithi169.stdout:(8/165): ceph-fuse-debuginfo-18.0.0-6713.g18971 2.8 MB/s | 5.8 MB 00:02 2023-10-18T11:00:14.492 INFO:teuthology.orchestra.run.smithi169.stdout:(9/165): ceph-immutable-object-cache-debuginfo- 6.0 MB/s | 1.4 MB 00:00 2023-10-18T11:00:15.243 INFO:teuthology.orchestra.run.smithi169.stdout:(10/165): ceph-mds-18.0.0-6713.g189714d0.el9.x8 2.6 MB/s | 2.1 MB 00:00 2023-10-18T11:00:15.868 INFO:teuthology.orchestra.run.smithi169.stdout:(11/165): ceph-mgr-18.0.0-6713.g189714d0.el9.x8 2.3 MB/s | 1.5 MB 00:00 2023-10-18T11:00:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:(3/165): ceph-common-18.0.0-6713.g189714d0.el9. 1.8 MB/s | 19 MB 00:10 2023-10-18T11:00:20.151 INFO:teuthology.orchestra.run.smithi169.stdout:(12/165): ceph-mds-debuginfo-18.0.0-6713.g18971 8.3 MB/s | 47 MB 00:05 2023-10-18T11:00:20.760 INFO:teuthology.orchestra.run.smithi169.stdout:(13/165): ceph-mon-18.0.0-6713.g189714d0.el9.x8 7.2 MB/s | 4.4 MB 00:00 2023-10-18T11:00:21.280 INFO:teuthology.orchestra.run.smithi151.stdout:(4/165): ceph-base-debuginfo-18.0.0-6713.g18971 5.9 MB/s | 74 MB 00:12 2023-10-18T11:00:21.734 INFO:teuthology.orchestra.run.smithi151.stdout:(5/165): ceph-fuse-18.0.0-6713.g189714d0.el9.x8 1.9 MB/s | 855 kB 00:00 2023-10-18T11:00:22.235 INFO:teuthology.orchestra.run.smithi169.stdout:(14/165): ceph-mgr-debuginfo-18.0.0-6713.g18971 3.0 MB/s | 19 MB 00:06 2023-10-18T11:00:23.239 INFO:teuthology.orchestra.run.smithi151.stdout:(6/165): ceph-fuse-debuginfo-18.0.0-6713.g18971 3.8 MB/s | 5.8 MB 00:01 2023-10-18T11:00:23.356 INFO:teuthology.orchestra.run.smithi151.stdout:(7/165): ceph-immutable-object-cache-18.0.0-671 1.2 MB/s | 141 kB 00:00 2023-10-18T11:00:23.798 INFO:teuthology.orchestra.run.smithi151.stdout:(8/165): ceph-immutable-object-cache-debuginfo- 3.3 MB/s | 1.4 MB 00:00 2023-10-18T11:00:24.515 INFO:teuthology.orchestra.run.smithi151.stdout:(9/165): ceph-mds-18.0.0-6713.g189714d0.el9.x86 2.9 MB/s | 2.1 MB 00:00 2023-10-18T11:00:25.821 INFO:teuthology.orchestra.run.smithi151.stdout:(10/165): ceph-debuginfo-18.0.0-6713.g189714d0. 3.3 MB/s | 20 MB 00:06 2023-10-18T11:00:26.354 INFO:teuthology.orchestra.run.smithi151.stdout:(11/165): ceph-mgr-18.0.0-6713.g189714d0.el9.x8 2.7 MB/s | 1.5 MB 00:00 2023-10-18T11:00:29.318 INFO:teuthology.orchestra.run.smithi169.stdout:(15/165): ceph-osd-18.0.0-6713.g189714d0.el9.x8 2.5 MB/s | 18 MB 00:07 2023-10-18T11:00:30.430 INFO:teuthology.orchestra.run.smithi151.stdout:(12/165): ceph-mgr-debuginfo-18.0.0-6713.g18971 4.7 MB/s | 19 MB 00:04 2023-10-18T11:00:31.072 INFO:teuthology.orchestra.run.smithi151.stdout:(13/165): ceph-mon-18.0.0-6713.g189714d0.el9.x8 6.8 MB/s | 4.4 MB 00:00 2023-10-18T11:00:33.301 INFO:teuthology.orchestra.run.smithi169.stdout:(16/165): ceph-mon-debuginfo-18.0.0-6713.g18971 8.9 MB/s | 112 MB 00:12 2023-10-18T11:00:33.830 INFO:teuthology.orchestra.run.smithi151.stdout:(14/165): ceph-mds-debuginfo-18.0.0-6713.g18971 5.1 MB/s | 47 MB 00:09 2023-10-18T11:00:34.193 INFO:teuthology.orchestra.run.smithi169.stdout:(17/165): ceph-radosgw-18.0.0-6713.g189714d0.el 9.7 MB/s | 8.6 MB 00:00 2023-10-18T11:00:38.738 INFO:teuthology.orchestra.run.smithi151.stdout:(15/165): ceph-osd-18.0.0-6713.g189714d0.el9.x8 3.6 MB/s | 18 MB 00:04 2023-10-18T11:00:51.316 INFO:teuthology.orchestra.run.smithi169.stdout:(18/165): ceph-radosgw-debuginfo-18.0.0-6713.g1 10 MB/s | 174 MB 00:17 2023-10-18T11:00:51.358 INFO:teuthology.orchestra.run.smithi169.stdout:(19/165): ceph-selinux-18.0.0-6713.g189714d0.el 586 kB/s | 24 kB 00:00 2023-10-18T11:00:55.200 INFO:teuthology.orchestra.run.smithi169.stdout:(20/165): ceph-test-18.0.0-6713.g189714d0.el9.x 11 MB/s | 41 MB 00:03 2023-10-18T11:00:58.203 INFO:teuthology.orchestra.run.smithi151.stdout:(16/165): ceph-mon-debuginfo-18.0.0-6713.g18971 4.1 MB/s | 112 MB 00:27 2023-10-18T11:01:00.595 INFO:teuthology.orchestra.run.smithi151.stdout:(17/165): ceph-radosgw-18.0.0-6713.g189714d0.el 3.6 MB/s | 8.6 MB 00:02 2023-10-18T11:01:38.359 INFO:teuthology.orchestra.run.smithi151.stdout:(18/165): ceph-radosgw-debuginfo-18.0.0-6713.g1 4.6 MB/s | 174 MB 00:37 2023-10-18T11:01:38.484 INFO:teuthology.orchestra.run.smithi151.stdout:(19/165): ceph-selinux-18.0.0-6713.g189714d0.el 193 kB/s | 24 kB 00:00 2023-10-18T11:01:54.008 INFO:teuthology.orchestra.run.smithi151.stdout:(20/165): ceph-test-18.0.0-6713.g189714d0.el9.x 2.6 MB/s | 41 MB 00:15 2023-10-18T11:01:55.392 INFO:teuthology.orchestra.run.smithi151.stdout:(21/165): ceph-osd-debuginfo-18.0.0-6713.g18971 4.1 MB/s | 315 MB 01:16 2023-10-18T11:01:55.676 INFO:teuthology.orchestra.run.smithi151.stdout:(22/165): cephfs-mirror-18.0.0-6713.g189714d0.e 773 kB/s | 218 kB 00:00 2023-10-18T11:01:55.784 INFO:teuthology.orchestra.run.smithi151.stdout:(23/165): libcephfs-devel-18.0.0-6713.g189714d0 290 kB/s | 31 kB 00:00 2023-10-18T11:01:56.193 INFO:teuthology.orchestra.run.smithi151.stdout:(24/165): libcephfs2-18.0.0-6713.g189714d0.el9. 1.7 MB/s | 715 kB 00:00 2023-10-18T11:01:57.535 INFO:teuthology.orchestra.run.smithi151.stdout:(25/165): libcephfs2-debuginfo-18.0.0-6713.g189 3.8 MB/s | 5.1 MB 00:01 2023-10-18T11:01:57.715 INFO:teuthology.orchestra.run.smithi151.stdout:(26/165): libcephsqlite-18.0.0-6713.g189714d0.e 914 kB/s | 164 kB 00:00 2023-10-18T11:01:57.844 INFO:teuthology.orchestra.run.smithi151.stdout:(27/165): librados-devel-18.0.0-6713.g189714d0. 995 kB/s | 126 kB 00:00 2023-10-18T11:01:57.978 INFO:teuthology.orchestra.run.smithi151.stdout:(28/165): librados-devel-debuginfo-18.0.0-6713. 819 kB/s | 108 kB 00:00 2023-10-18T11:02:06.041 INFO:teuthology.orchestra.run.smithi169.stdout:(21/165): ceph-test-debuginfo-18.0.0-6713.g1897 8.8 MB/s | 625 MB 01:10 2023-10-18T11:02:06.183 INFO:teuthology.orchestra.run.smithi169.stdout:(22/165): cephfs-mirror-18.0.0-6713.g189714d0.e 1.5 MB/s | 218 kB 00:00 2023-10-18T11:02:06.233 INFO:teuthology.orchestra.run.smithi169.stdout:(23/165): libcephfs-devel-18.0.0-6713.g189714d0 627 kB/s | 31 kB 00:00 2023-10-18T11:02:06.375 INFO:teuthology.orchestra.run.smithi169.stdout:(24/165): libcephfs2-18.0.0-6713.g189714d0.el9. 4.9 MB/s | 715 kB 00:00 2023-10-18T11:02:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:(29/165): ceph-common-debuginfo-18.0.0-6713.g18 3.5 MB/s | 410 MB 01:57 2023-10-18T11:02:07.772 INFO:teuthology.orchestra.run.smithi151.stdout:(30/165): libradosstriper1-18.0.0-6713.g189714d 842 kB/s | 472 kB 00:00 2023-10-18T11:02:08.017 INFO:teuthology.orchestra.run.smithi169.stdout:(25/165): ceph-common-debuginfo-18.0.0-6713.g18 3.3 MB/s | 410 MB 02:02 2023-10-18T11:02:08.109 INFO:teuthology.orchestra.run.smithi169.stdout:(26/165): libcephfs2-debuginfo-18.0.0-6713.g189 3.0 MB/s | 5.1 MB 00:01 2023-10-18T11:02:08.234 INFO:teuthology.orchestra.run.smithi169.stdout:(27/165): libcephsqlite-18.0.0-6713.g189714d0.e 756 kB/s | 164 kB 00:00 2023-10-18T11:02:08.259 INFO:teuthology.orchestra.run.smithi169.stdout:(28/165): librados-devel-18.0.0-6713.g189714d0. 843 kB/s | 126 kB 00:00 2023-10-18T11:02:08.301 INFO:teuthology.orchestra.run.smithi169.stdout:(29/165): librados-devel-debuginfo-18.0.0-6713. 1.6 MB/s | 108 kB 00:00 2023-10-18T11:02:08.410 INFO:teuthology.orchestra.run.smithi169.stdout:(30/165): libradosstriper1-18.0.0-6713.g189714d 4.3 MB/s | 472 kB 00:00 2023-10-18T11:02:11.269 INFO:teuthology.orchestra.run.smithi151.stdout:(31/165): librados2-debuginfo-18.0.0-6713.g1897 3.4 MB/s | 45 MB 00:13 2023-10-18T11:02:12.527 INFO:teuthology.orchestra.run.smithi151.stdout:(32/165): librgw2-18.0.0-6713.g189714d0.el9.x86 3.8 MB/s | 4.8 MB 00:01 2023-10-18T11:02:12.644 INFO:teuthology.orchestra.run.smithi151.stdout:(33/165): python3-ceph-argparse-18.0.0-6713.g18 390 kB/s | 45 kB 00:00 2023-10-18T11:02:12.761 INFO:teuthology.orchestra.run.smithi151.stdout:(34/165): python3-ceph-common-18.0.0-6713.g1897 1.1 MB/s | 127 kB 00:00 2023-10-18T11:02:12.928 INFO:teuthology.orchestra.run.smithi151.stdout:(35/165): python3-cephfs-18.0.0-6713.g189714d0. 974 kB/s | 161 kB 00:00 2023-10-18T11:02:13.196 INFO:teuthology.orchestra.run.smithi151.stdout:(36/165): python3-cephfs-debuginfo-18.0.0-6713. 2.3 MB/s | 614 kB 00:00 2023-10-18T11:02:13.404 INFO:teuthology.orchestra.run.smithi151.stdout:(37/165): python3-rados-18.0.0-6713.g189714d0.e 1.5 MB/s | 321 kB 00:00 2023-10-18T11:02:13.671 INFO:teuthology.orchestra.run.smithi151.stdout:(38/165): python3-rados-debuginfo-18.0.0-6713.g 2.8 MB/s | 769 kB 00:00 2023-10-18T11:02:13.838 INFO:teuthology.orchestra.run.smithi151.stdout:(39/165): python3-rbd-18.0.0-6713.g189714d0.el9 1.8 MB/s | 298 kB 00:00 2023-10-18T11:02:14.264 INFO:teuthology.orchestra.run.smithi151.stdout:(40/165): python3-rbd-debuginfo-18.0.0-6713.g18 2.6 MB/s | 1.1 MB 00:00 2023-10-18T11:02:14.398 INFO:teuthology.orchestra.run.smithi151.stdout:(41/165): python3-rgw-18.0.0-6713.g189714d0.el9 750 kB/s | 99 kB 00:00 2023-10-18T11:02:14.606 INFO:teuthology.orchestra.run.smithi151.stdout:(42/165): python3-rgw-debuginfo-18.0.0-6713.g18 1.6 MB/s | 337 kB 00:00 2023-10-18T11:02:14.707 INFO:teuthology.orchestra.run.smithi151.stdout:(43/165): rbd-fuse-18.0.0-6713.g189714d0.el9.x8 857 kB/s | 85 kB 00:00 2023-10-18T11:02:14.907 INFO:teuthology.orchestra.run.smithi151.stdout:(44/165): rbd-fuse-debuginfo-18.0.0-6713.g18971 2.5 MB/s | 506 kB 00:00 2023-10-18T11:02:15.899 INFO:teuthology.orchestra.run.smithi151.stdout:(45/165): rbd-mirror-18.0.0-6713.g189714d0.el9. 3.0 MB/s | 3.0 MB 00:00 2023-10-18T11:02:17.917 INFO:teuthology.orchestra.run.smithi169.stdout:(31/165): librados2-debuginfo-18.0.0-6713.g1897 4.7 MB/s | 45 MB 00:09 2023-10-18T11:02:19.567 INFO:teuthology.orchestra.run.smithi169.stdout:(32/165): librbd1-debuginfo-18.0.0-6713.g189714 4.5 MB/s | 51 MB 00:11 2023-10-18T11:02:19.634 INFO:teuthology.orchestra.run.smithi169.stdout:(33/165): librgw2-18.0.0-6713.g189714d0.el9.x86 2.8 MB/s | 4.8 MB 00:01 2023-10-18T11:02:19.659 INFO:teuthology.orchestra.run.smithi169.stdout:(34/165): python3-ceph-argparse-18.0.0-6713.g18 493 kB/s | 45 kB 00:00 2023-10-18T11:02:19.718 INFO:teuthology.orchestra.run.smithi169.stdout:(35/165): python3-ceph-common-18.0.0-6713.g1897 1.5 MB/s | 127 kB 00:00 2023-10-18T11:02:19.810 INFO:teuthology.orchestra.run.smithi169.stdout:(36/165): python3-cephfs-18.0.0-6713.g189714d0. 1.0 MB/s | 161 kB 00:00 2023-10-18T11:02:19.960 INFO:teuthology.orchestra.run.smithi169.stdout:(37/165): python3-cephfs-debuginfo-18.0.0-6713. 2.5 MB/s | 614 kB 00:00 2023-10-18T11:02:19.985 INFO:teuthology.orchestra.run.smithi169.stdout:(38/165): python3-rados-18.0.0-6713.g189714d0.e 1.8 MB/s | 321 kB 00:00 2023-10-18T11:02:20.169 INFO:teuthology.orchestra.run.smithi169.stdout:(39/165): python3-rbd-18.0.0-6713.g189714d0.el9 1.6 MB/s | 298 kB 00:00 2023-10-18T11:02:20.202 INFO:teuthology.orchestra.run.smithi169.stdout:(40/165): python3-rados-debuginfo-18.0.0-6713.g 3.1 MB/s | 769 kB 00:00 2023-10-18T11:02:20.294 INFO:teuthology.orchestra.run.smithi169.stdout:(41/165): python3-rgw-18.0.0-6713.g189714d0.el9 1.1 MB/s | 99 kB 00:00 2023-10-18T11:02:20.461 INFO:teuthology.orchestra.run.smithi169.stdout:(42/165): python3-rgw-debuginfo-18.0.0-6713.g18 2.0 MB/s | 337 kB 00:00 2023-10-18T11:02:20.495 INFO:teuthology.orchestra.run.smithi169.stdout:(43/165): python3-rbd-debuginfo-18.0.0-6713.g18 3.4 MB/s | 1.1 MB 00:00 2023-10-18T11:02:20.545 INFO:teuthology.orchestra.run.smithi169.stdout:(44/165): rbd-fuse-18.0.0-6713.g189714d0.el9.x8 1.0 MB/s | 85 kB 00:00 2023-10-18T11:02:20.663 INFO:teuthology.orchestra.run.smithi169.stdout:(45/165): rbd-fuse-debuginfo-18.0.0-6713.g18971 3.0 MB/s | 506 kB 00:00 2023-10-18T11:02:21.330 INFO:teuthology.orchestra.run.smithi169.stdout:(46/165): rbd-mirror-18.0.0-6713.g189714d0.el9. 3.9 MB/s | 3.0 MB 00:00 2023-10-18T11:02:21.455 INFO:teuthology.orchestra.run.smithi169.stdout:(47/165): rbd-nbd-18.0.0-6713.g189714d0.el9.x86 1.3 MB/s | 169 kB 00:00 2023-10-18T11:02:21.813 INFO:teuthology.orchestra.run.smithi169.stdout:(48/165): rbd-nbd-debuginfo-18.0.0-6713.g189714 3.4 MB/s | 1.2 MB 00:00 2023-10-18T11:02:21.922 INFO:teuthology.orchestra.run.smithi169.stdout:(49/165): ceph-grafana-dashboards-18.0.0-6713.g 214 kB/s | 23 kB 00:00 2023-10-18T11:02:22.130 INFO:teuthology.orchestra.run.smithi169.stdout:(50/165): ceph-mgr-cephadm-18.0.0-6713.g189714d 636 kB/s | 132 kB 00:00 2023-10-18T11:02:22.497 INFO:teuthology.orchestra.run.smithi169.stdout:(51/165): ceph-mgr-dashboard-18.0.0-6713.g18971 4.8 MB/s | 1.8 MB 00:00 2023-10-18T11:02:22.690 INFO:teuthology.orchestra.run.smithi151.stdout:(46/165): librbd1-debuginfo-18.0.0-6713.g189714 3.4 MB/s | 51 MB 00:14 2023-10-18T11:02:22.832 INFO:teuthology.orchestra.run.smithi151.stdout:(47/165): rbd-nbd-18.0.0-6713.g189714d0.el9.x86 1.2 MB/s | 169 kB 00:00 2023-10-18T11:02:23.266 INFO:teuthology.orchestra.run.smithi151.stdout:(48/165): rbd-nbd-debuginfo-18.0.0-6713.g189714 2.8 MB/s | 1.2 MB 00:00 2023-10-18T11:02:23.397 INFO:teuthology.orchestra.run.smithi151.stdout:(49/165): ceph-grafana-dashboards-18.0.0-6713.g 179 kB/s | 23 kB 00:00 2023-10-18T11:02:23.508 INFO:teuthology.orchestra.run.smithi151.stdout:(50/165): ceph-mgr-cephadm-18.0.0-6713.g189714d 1.2 MB/s | 132 kB 00:00 2023-10-18T11:02:24.117 INFO:teuthology.orchestra.run.smithi151.stdout:(51/165): ceph-mgr-dashboard-18.0.0-6713.g18971 2.9 MB/s | 1.8 MB 00:00 2023-10-18T11:02:24.264 INFO:teuthology.orchestra.run.smithi169.stdout:(52/165): ceph-mgr-diskprediction-local-18.0.0- 4.2 MB/s | 7.4 MB 00:01 2023-10-18T11:02:24.381 INFO:teuthology.orchestra.run.smithi169.stdout:(53/165): ceph-mgr-modules-core-18.0.0-6713.g18 2.0 MB/s | 242 kB 00:00 2023-10-18T11:02:24.481 INFO:teuthology.orchestra.run.smithi169.stdout:(54/165): ceph-mgr-rook-18.0.0-6713.g189714d0.e 475 kB/s | 47 kB 00:00 2023-10-18T11:02:24.581 INFO:teuthology.orchestra.run.smithi169.stdout:(55/165): ceph-prometheus-alerts-18.0.0-6713.g1 151 kB/s | 15 kB 00:00 2023-10-18T11:02:24.690 INFO:teuthology.orchestra.run.smithi169.stdout:(56/165): ceph-volume-18.0.0-6713.g189714d0.el9 2.4 MB/s | 262 kB 00:00 2023-10-18T11:02:24.815 INFO:teuthology.orchestra.run.smithi169.stdout:(57/165): cephadm-18.0.0-6713.g189714d0.el9.noa 2.1 MB/s | 269 kB 00:00 2023-10-18T11:02:24.916 INFO:teuthology.orchestra.run.smithi169.stdout:(58/165): cephfs-top-18.0.0-6713.g189714d0.el9. 182 kB/s | 18 kB 00:00 2023-10-18T11:02:25.049 INFO:teuthology.orchestra.run.smithi169.stdout:(59/165): bison-3.7.4-5.el9.x86_64.rpm 6.8 MB/s | 920 kB 00:00 2023-10-18T11:02:25.083 INFO:teuthology.orchestra.run.smithi169.stdout:(60/165): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-10-18T11:02:25.125 INFO:teuthology.orchestra.run.smithi169.stdout:(61/165): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-10-18T11:02:25.150 INFO:teuthology.orchestra.run.smithi169.stdout:(62/165): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2023-10-18T11:02:25.242 INFO:teuthology.orchestra.run.smithi169.stdout:(63/165): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-10-18T11:02:25.267 INFO:teuthology.orchestra.run.smithi169.stdout:(64/165): flexiblas-openblas-openmp-3.0.4-8.el9 687 kB/s | 17 kB 00:00 2023-10-18T11:02:25.292 INFO:teuthology.orchestra.run.smithi169.stdout:(65/165): libaio-devel-0.3.111-13.el9.x86_64.rp 405 kB/s | 10 kB 00:00 2023-10-18T11:02:25.326 INFO:teuthology.orchestra.run.smithi169.stdout:(66/165): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.6 MB/s | 159 kB 00:00 2023-10-18T11:02:25.368 INFO:teuthology.orchestra.run.smithi169.stdout:(67/165): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 661 kB 00:00 2023-10-18T11:02:25.410 INFO:teuthology.orchestra.run.smithi169.stdout:(68/165): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2023-10-18T11:02:25.435 INFO:teuthology.orchestra.run.smithi169.stdout:(69/165): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 46 kB 00:00 2023-10-18T11:02:25.486 INFO:teuthology.orchestra.run.smithi169.stdout:(70/165): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-10-18T11:02:25.519 INFO:teuthology.orchestra.run.smithi169.stdout:(71/165): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2023-10-18T11:02:25.544 INFO:teuthology.orchestra.run.smithi169.stdout:(72/165): openblas-0.3.21-2.el9.x86_64.rpm 1.3 MB/s | 34 kB 00:00 2023-10-18T11:02:25.695 INFO:teuthology.orchestra.run.smithi169.stdout:(73/165): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2023-10-18T11:02:25.754 INFO:teuthology.orchestra.run.smithi169.stdout:(74/165): postgresql-13.11-1.el9.x86_64.rpm 26 MB/s | 1.5 MB 00:00 2023-10-18T11:02:25.796 INFO:teuthology.orchestra.run.smithi169.stdout:(75/165): postgresql-contrib-13.11-1.el9.x86_64 19 MB/s | 811 kB 00:00 2023-10-18T11:02:25.829 INFO:teuthology.orchestra.run.smithi169.stdout:(76/165): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2023-10-18T11:02:25.963 INFO:teuthology.orchestra.run.smithi169.stdout:(77/165): postgresql-server-13.11-1.el9.x86_64. 43 MB/s | 5.7 MB 00:00 2023-10-18T11:02:25.993 INFO:teuthology.orchestra.run.smithi151.stdout:(52/165): ceph-mgr-diskprediction-local-18.0.0- 3.9 MB/s | 7.4 MB 00:01 2023-10-18T11:02:26.101 INFO:teuthology.orchestra.run.smithi151.stdout:(53/165): ceph-mgr-modules-core-18.0.0-6713.g18 2.2 MB/s | 242 kB 00:00 2023-10-18T11:02:26.105 INFO:teuthology.orchestra.run.smithi169.stdout:(78/165): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2023-10-18T11:02:26.139 INFO:teuthology.orchestra.run.smithi169.stdout:(79/165): python3-devel-3.9.17-2.el9.x86_64.rpm 6.0 MB/s | 205 kB 00:00 2023-10-18T11:02:26.172 INFO:teuthology.orchestra.run.smithi169.stdout:(80/165): python3-jinja2-2.11.3-4.el9.noarch.rp 6.7 MB/s | 228 kB 00:00 2023-10-18T11:02:26.206 INFO:teuthology.orchestra.run.smithi169.stdout:(81/165): python3-jsonpatch-1.21-16.el9.noarch. 734 kB/s | 24 kB 00:00 2023-10-18T11:02:26.220 INFO:teuthology.orchestra.run.smithi151.stdout:(54/165): ceph-mgr-rook-18.0.0-6713.g189714d0.e 404 kB/s | 47 kB 00:00 2023-10-18T11:02:26.248 INFO:teuthology.orchestra.run.smithi169.stdout:(82/165): python3-jsonpointer-2.0-4.el9.noarch. 435 kB/s | 18 kB 00:00 2023-10-18T11:02:26.282 INFO:teuthology.orchestra.run.smithi169.stdout:(83/165): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-10-18T11:02:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:(55/165): ceph-prometheus-alerts-18.0.0-6713.g1 187 kB/s | 15 kB 00:00 2023-10-18T11:02:26.315 INFO:teuthology.orchestra.run.smithi169.stdout:(84/165): python3-markupsafe-1.1.1-12.el9.x86_6 953 kB/s | 32 kB 00:00 2023-10-18T11:02:26.394 INFO:teuthology.orchestra.run.smithi151.stdout:(56/165): ceph-volume-18.0.0-6713.g189714d0.el9 2.8 MB/s | 262 kB 00:00 2023-10-18T11:02:26.440 INFO:teuthology.orchestra.run.smithi169.stdout:(85/165): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2023-10-18T11:02:26.474 INFO:teuthology.orchestra.run.smithi169.stdout:(86/165): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.4 MB/s | 217 kB 00:00 2023-10-18T11:02:26.477 INFO:teuthology.orchestra.run.smithi151.stdout:(57/165): cephadm-18.0.0-6713.g189714d0.el9.noa 3.2 MB/s | 269 kB 00:00 2023-10-18T11:02:26.507 INFO:teuthology.orchestra.run.smithi169.stdout:(87/165): python3-oauthlib-3.1.1-5.el9.noarch.r 5.1 MB/s | 174 kB 00:00 2023-10-18T11:02:26.541 INFO:teuthology.orchestra.run.smithi169.stdout:(88/165): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-10-18T11:02:26.569 INFO:teuthology.orchestra.run.smithi151.stdout:(58/165): cephfs-top-18.0.0-6713.g189714d0.el9. 201 kB/s | 18 kB 00:00 2023-10-18T11:02:26.575 INFO:teuthology.orchestra.run.smithi169.stdout:(89/165): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2023-10-18T11:02:26.608 INFO:teuthology.orchestra.run.smithi169.stdout:(90/165): python3-pyasn1-modules-0.4.8-6.el9.no 6.2 MB/s | 211 kB 00:00 2023-10-18T11:02:26.642 INFO:teuthology.orchestra.run.smithi169.stdout:(91/165): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 43 kB 00:00 2023-10-18T11:02:26.920 INFO:teuthology.orchestra.run.smithi151.stdout:(59/165): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 920 kB 00:00 2023-10-18T11:02:26.970 INFO:teuthology.orchestra.run.smithi151.stdout:(60/165): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2023-10-18T11:02:26.984 INFO:teuthology.orchestra.run.smithi169.stdout:(92/165): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2023-10-18T11:02:27.017 INFO:teuthology.orchestra.run.smithi169.stdout:(93/165): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-10-18T11:02:27.038 INFO:teuthology.orchestra.run.smithi151.stdout:(61/165): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 307 kB 00:00 2023-10-18T11:02:27.068 INFO:teuthology.orchestra.run.smithi169.stdout:(94/165): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2023-10-18T11:02:27.080 INFO:teuthology.orchestra.run.smithi151.stdout:(62/165): flexiblas-3.0.4-8.el9.x86_64.rpm 777 kB/s | 32 kB 00:00 2023-10-18T11:02:27.101 INFO:teuthology.orchestra.run.smithi169.stdout:(95/165): uuid-1.6.2-55.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2023-10-18T11:02:27.135 INFO:teuthology.orchestra.run.smithi169.stdout:(96/165): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-10-18T11:02:27.169 INFO:teuthology.orchestra.run.smithi169.stdout:(97/165): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2023-10-18T11:02:27.188 INFO:teuthology.orchestra.run.smithi151.stdout:(63/165): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-10-18T11:02:27.219 INFO:teuthology.orchestra.run.smithi169.stdout:(98/165): libgfortran-11.4.1-2.3.el9.x86_64.rpm 16 MB/s | 803 kB 00:00 2023-10-18T11:02:27.230 INFO:teuthology.orchestra.run.smithi151.stdout:(64/165): flexiblas-openblas-openmp-3.0.4-8.el9 420 kB/s | 17 kB 00:00 2023-10-18T11:02:27.269 INFO:teuthology.orchestra.run.smithi169.stdout:(99/165): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2023-10-18T11:02:27.328 INFO:teuthology.orchestra.run.smithi169.stdout:(100/165): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2023-10-18T11:02:27.348 INFO:teuthology.orchestra.run.smithi151.stdout:(65/165): libaio-devel-0.3.111-13.el9.x86_64.rp 87 kB/s | 10 kB 00:00 2023-10-18T11:02:27.395 INFO:teuthology.orchestra.run.smithi169.stdout:(101/165): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2023-10-18T11:02:27.429 INFO:teuthology.orchestra.run.smithi169.stdout:(102/165): python3-pycparser-2.20-6.el9.noarch. 3.6 MB/s | 124 kB 00:00 2023-10-18T11:02:27.454 INFO:teuthology.orchestra.run.smithi169.stdout:(103/165): python3-requests-2.25.1-7.el9.noarch 4.4 MB/s | 113 kB 00:00 2023-10-18T11:02:27.496 INFO:teuthology.orchestra.run.smithi169.stdout:(104/165): python3-urllib3-1.26.5-3.el9.noarch. 4.4 MB/s | 188 kB 00:00 2023-10-18T11:02:27.905 INFO:teuthology.orchestra.run.smithi169.stdout:(105/165): python3-cryptography-36.0.1-4.el9.x8 3.0 MB/s | 1.2 MB 00:00 2023-10-18T11:02:28.230 INFO:teuthology.orchestra.run.smithi169.stdout:(106/165): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2023-10-18T11:02:28.280 INFO:teuthology.orchestra.run.smithi169.stdout:(107/165): elfutils-libelf-devel-0.189-3.el9.x8 447 kB/s | 22 kB 00:00 2023-10-18T11:02:28.281 INFO:teuthology.orchestra.run.smithi151.stdout:(66/165): libpmemobj-1.12.1-1.el9.x86_64.rpm 171 kB/s | 159 kB 00:00 2023-10-18T11:02:28.339 INFO:teuthology.orchestra.run.smithi169.stdout:(108/165): jq-1.6-15.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-10-18T11:02:28.389 INFO:teuthology.orchestra.run.smithi169.stdout:(109/165): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2023-10-18T11:02:28.439 INFO:teuthology.orchestra.run.smithi169.stdout:(110/165): libuuid-devel-2.37.4-15.el9.x86_64.r 511 kB/s | 26 kB 00:00 2023-10-18T11:02:28.815 INFO:teuthology.orchestra.run.smithi169.stdout:(111/165): openssl-devel-3.0.7-24.el9.x86_64.rp 11 MB/s | 4.1 MB 00:00 2023-10-18T11:02:28.865 INFO:teuthology.orchestra.run.smithi169.stdout:(112/165): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2023-10-18T11:02:28.924 INFO:teuthology.orchestra.run.smithi169.stdout:(113/165): xfsprogs-devel-5.19.0-4.el9.x86_64.r 1.4 MB/s | 86 kB 00:00 2023-10-18T11:02:28.990 INFO:teuthology.orchestra.run.smithi151.stdout:(67/165): librdkafka-1.6.1-102.el9.x86_64.rpm 935 kB/s | 661 kB 00:00 2023-10-18T11:02:29.116 INFO:teuthology.orchestra.run.smithi151.stdout:(68/165): libtool-2.4.6-45.el9.x86_64.rpm 4.6 MB/s | 578 kB 00:00 2023-10-18T11:02:29.157 INFO:teuthology.orchestra.run.smithi151.stdout:(69/165): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2023-10-18T11:02:29.208 INFO:teuthology.orchestra.run.smithi151.stdout:(70/165): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2023-10-18T11:02:29.250 INFO:teuthology.orchestra.run.smithi151.stdout:(71/165): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2023-10-18T11:02:29.284 INFO:teuthology.orchestra.run.smithi151.stdout:(72/165): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-10-18T11:02:29.426 INFO:teuthology.orchestra.run.smithi151.stdout:(73/165): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2023-10-18T11:02:29.518 INFO:teuthology.orchestra.run.smithi151.stdout:(74/165): postgresql-13.11-1.el9.x86_64.rpm 17 MB/s | 1.5 MB 00:00 2023-10-18T11:02:29.577 INFO:teuthology.orchestra.run.smithi151.stdout:(75/165): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2023-10-18T11:02:29.619 INFO:teuthology.orchestra.run.smithi151.stdout:(76/165): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2023-10-18T11:02:29.786 INFO:teuthology.orchestra.run.smithi151.stdout:(77/165): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2023-10-18T11:02:30.312 INFO:teuthology.orchestra.run.smithi151.stdout:(78/165): rbd-mirror-debuginfo-18.0.0-6713.g189 3.5 MB/s | 51 MB 00:14 2023-10-18T11:02:30.399 INFO:teuthology.orchestra.run.smithi169.stdout:(114/165): ceph-osd-debuginfo-18.0.0-6713.g1897 2.6 MB/s | 315 MB 02:01 2023-10-18T11:02:30.424 INFO:teuthology.orchestra.run.smithi169.stdout:(115/165): zlib-devel-1.2.11-40.el9.x86_64.rpm 30 kB/s | 45 kB 00:01 2023-10-18T11:02:30.462 INFO:teuthology.orchestra.run.smithi151.stdout:(79/165): python3-babel-2.9.1-2.el9.noarch.rpm 8.6 MB/s | 5.8 MB 00:00 2023-10-18T11:02:30.487 INFO:teuthology.orchestra.run.smithi151.stdout:(80/165): python3-devel-3.9.17-2.el9.x86_64.rpm 1.3 MB/s | 205 kB 00:00 2023-10-18T11:02:30.529 INFO:teuthology.orchestra.run.smithi151.stdout:(81/165): python3-jinja2-2.11.3-4.el9.noarch.rp 5.5 MB/s | 228 kB 00:00 2023-10-18T11:02:30.554 INFO:teuthology.orchestra.run.smithi151.stdout:(82/165): python3-jsonpatch-1.21-16.el9.noarch. 373 kB/s | 24 kB 00:00 2023-10-18T11:02:30.596 INFO:teuthology.orchestra.run.smithi151.stdout:(83/165): python3-jsonpointer-2.0-4.el9.noarch. 445 kB/s | 18 kB 00:00 2023-10-18T11:02:30.622 INFO:teuthology.orchestra.run.smithi151.stdout:(84/165): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-10-18T11:02:30.705 INFO:teuthology.orchestra.run.smithi151.stdout:(85/165): python3-markupsafe-1.1.1-12.el9.x86_6 384 kB/s | 32 kB 00:00 2023-10-18T11:02:30.823 INFO:teuthology.orchestra.run.smithi151.stdout:(86/165): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-10-18T11:02:30.856 INFO:teuthology.orchestra.run.smithi151.stdout:(87/165): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-10-18T11:02:30.874 INFO:teuthology.orchestra.run.smithi169.stdout:(116/165): rbd-mirror-debuginfo-18.0.0-6713.g18 5.0 MB/s | 51 MB 00:10 2023-10-18T11:02:30.898 INFO:teuthology.orchestra.run.smithi151.stdout:(88/165): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2023-10-18T11:02:30.923 INFO:teuthology.orchestra.run.smithi151.stdout:(89/165): python3-prettytable-0.7.2-27.el9.noar 627 kB/s | 41 kB 00:00 2023-10-18T11:02:30.949 INFO:teuthology.orchestra.run.smithi151.stdout:(90/165): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-10-18T11:02:30.982 INFO:teuthology.orchestra.run.smithi151.stdout:(91/165): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2023-10-18T11:02:31.008 INFO:teuthology.orchestra.run.smithi151.stdout:(92/165): python3-requests-oauthlib-1.3.0-12.el 766 kB/s | 43 kB 00:00 2023-10-18T11:02:31.191 INFO:teuthology.orchestra.run.smithi169.stdout:(117/165): fmt-8.1.1-5.el9.x86_64.rpm 140 kB/s | 111 kB 00:00 2023-10-18T11:02:31.308 INFO:teuthology.orchestra.run.smithi169.stdout:(118/165): libarrow-doc-9.0.0-9.el9.noarch.rpm 209 kB/s | 24 kB 00:00 2023-10-18T11:02:31.333 INFO:teuthology.orchestra.run.smithi151.stdout:(93/165): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2023-10-18T11:02:31.334 INFO:teuthology.orchestra.run.smithi169.stdout:(119/165): gperftools-libs-2.9.1-2.el9.x86_64.r 340 kB/s | 309 kB 00:00 2023-10-18T11:02:31.359 INFO:teuthology.orchestra.run.smithi151.stdout:(94/165): python3-toml-0.10.2-6.el9.noarch.rpm 116 kB/s | 39 kB 00:00 2023-10-18T11:02:31.392 INFO:teuthology.orchestra.run.smithi151.stdout:(95/165): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2023-10-18T11:02:31.418 INFO:teuthology.orchestra.run.smithi151.stdout:(96/165): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-10-18T11:02:31.443 INFO:teuthology.orchestra.run.smithi151.stdout:(97/165): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-10-18T11:02:31.450 INFO:teuthology.orchestra.run.smithi169.stdout:(120/165): libunwind-1.6.2-1.el9.x86_64.rpm 578 kB/s | 67 kB 00:00 2023-10-18T11:02:31.476 INFO:teuthology.orchestra.run.smithi169.stdout:(121/165): liboath-2.6.7-2.el9.x86_64.rpm 290 kB/s | 49 kB 00:00 2023-10-18T11:02:31.494 INFO:teuthology.orchestra.run.smithi151.stdout:(98/165): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-10-18T11:02:31.544 INFO:teuthology.orchestra.run.smithi151.stdout:(99/165): libgfortran-11.4.1-2.3.el9.x86_64.rpm 7.9 MB/s | 803 kB 00:00 2023-10-18T11:02:31.578 INFO:teuthology.orchestra.run.smithi151.stdout:(100/165): libquadmath-11.4.1-2.3.el9.x86_64.rp 2.5 MB/s | 195 kB 00:00 2023-10-18T11:02:31.612 INFO:teuthology.orchestra.run.smithi151.stdout:(101/165): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2023-10-18T11:02:31.637 INFO:teuthology.orchestra.run.smithi151.stdout:(102/165): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-10-18T11:02:31.671 INFO:teuthology.orchestra.run.smithi151.stdout:(103/165): python3-pycparser-2.20-6.el9.noarch. 2.1 MB/s | 124 kB 00:00 2023-10-18T11:02:31.693 INFO:teuthology.orchestra.run.smithi169.stdout:(122/165): libarrow-9.0.0-9.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2023-10-18T11:02:31.696 INFO:teuthology.orchestra.run.smithi151.stdout:(104/165): python3-requests-2.25.1-7.el9.noarch 1.9 MB/s | 113 kB 00:00 2023-10-18T11:02:31.718 INFO:teuthology.orchestra.run.smithi169.stdout:(123/165): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.1 MB/s | 837 kB 00:00 2023-10-18T11:02:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:(105/165): python3-urllib3-1.26.5-3.el9.noarch. 2.8 MB/s | 188 kB 00:00 2023-10-18T11:02:31.785 INFO:teuthology.orchestra.run.smithi169.stdout:(124/165): python3-asyncssh-2.13.2-3.el9.noarch 1.7 MB/s | 548 kB 00:00 2023-10-18T11:02:31.810 INFO:teuthology.orchestra.run.smithi169.stdout:(125/165): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2023-10-18T11:02:31.835 INFO:teuthology.orchestra.run.smithi169.stdout:(126/165): python3-cachetools-4.2.4-1.el9.noarc 275 kB/s | 32 kB 00:00 2023-10-18T11:02:31.860 INFO:teuthology.orchestra.run.smithi169.stdout:(127/165): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2023-10-18T11:02:31.936 INFO:teuthology.orchestra.run.smithi169.stdout:(128/165): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2023-10-18T11:02:31.961 INFO:teuthology.orchestra.run.smithi169.stdout:(129/165): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-10-18T11:02:31.986 INFO:teuthology.orchestra.run.smithi169.stdout:(130/165): python3-google-auth-2.23.2-1.el9.noa 1.5 MB/s | 196 kB 00:00 2023-10-18T11:02:32.012 INFO:teuthology.orchestra.run.smithi169.stdout:(131/165): python3-jaraco-8.2.1-3.el9.noarch.rp 141 kB/s | 11 kB 00:00 2023-10-18T11:02:32.028 INFO:teuthology.orchestra.run.smithi169.stdout:(132/165): python3-jaraco-classes-3.2.1-5.el9.n 263 kB/s | 18 kB 00:00 2023-10-18T11:02:32.054 INFO:teuthology.orchestra.run.smithi169.stdout:(133/165): python3-jaraco-collections-3.0.0-8.e 344 kB/s | 23 kB 00:00 2023-10-18T11:02:32.063 INFO:teuthology.orchestra.run.smithi151.stdout:(106/165): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2023-10-18T11:02:32.096 INFO:teuthology.orchestra.run.smithi169.stdout:(134/165): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2023-10-18T11:02:32.113 INFO:teuthology.orchestra.run.smithi169.stdout:(135/165): python3-jaraco-text-3.2.0-6.el9.noar 234 kB/s | 20 kB 00:00 2023-10-18T11:02:32.122 INFO:teuthology.orchestra.run.smithi151.stdout:(107/165): elfutils-libelf-devel-0.189-3.el9.x8 385 kB/s | 22 kB 00:00 2023-10-18T11:02:32.155 INFO:teuthology.orchestra.run.smithi169.stdout:(136/165): python3-jwt+crypto-2.4.0-1.el9.noarc 90 kB/s | 9.0 kB 00:00 2023-10-18T11:02:32.172 INFO:teuthology.orchestra.run.smithi169.stdout:(137/165): python3-jwt-2.4.0-1.el9.noarch.rpm 542 kB/s | 41 kB 00:00 2023-10-18T11:02:32.198 INFO:teuthology.orchestra.run.smithi151.stdout:(108/165): jq-1.6-15.el9.x86_64.rpm 2.5 MB/s | 187 kB 00:00 2023-10-18T11:02:32.239 INFO:teuthology.orchestra.run.smithi169.stdout:(138/165): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2023-10-18T11:02:32.289 INFO:teuthology.orchestra.run.smithi169.stdout:(139/165): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2023-10-18T11:02:32.290 INFO:teuthology.orchestra.run.smithi151.stdout:(109/165): librabbitmq-0.11.0-7.el9.x86_64.rpm 497 kB/s | 45 kB 00:00 2023-10-18T11:02:32.314 INFO:teuthology.orchestra.run.smithi169.stdout:(140/165): python3-more-itertools-8.12.0-2.el9. 555 kB/s | 79 kB 00:00 2023-10-18T11:02:32.331 INFO:teuthology.orchestra.run.smithi169.stdout:(141/165): python3-natsort-7.1.1-5.el9.noarch.r 627 kB/s | 58 kB 00:00 2023-10-18T11:02:32.348 INFO:teuthology.orchestra.run.smithi151.stdout:(110/165): libuuid-devel-2.37.4-15.el9.x86_64.r 444 kB/s | 26 kB 00:00 2023-10-18T11:02:32.398 INFO:teuthology.orchestra.run.smithi169.stdout:(142/165): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2023-10-18T11:02:32.423 INFO:teuthology.orchestra.run.smithi169.stdout:(143/165): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2023-10-18T11:02:32.448 INFO:teuthology.orchestra.run.smithi169.stdout:(144/165): python3-pyOpenSSL-21.0.0-1.el9.noarc 767 kB/s | 90 kB 00:00 2023-10-18T11:02:32.474 INFO:teuthology.orchestra.run.smithi169.stdout:(145/165): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2023-10-18T11:02:32.507 INFO:teuthology.orchestra.run.smithi169.stdout:(146/165): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-10-18T11:02:32.533 INFO:teuthology.orchestra.run.smithi169.stdout:(147/165): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2023-10-18T11:02:32.574 INFO:teuthology.orchestra.run.smithi169.stdout:(148/165): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2023-10-18T11:02:32.600 INFO:teuthology.orchestra.run.smithi169.stdout:(149/165): python3-typing-extensions-4.4.0-2.el 555 kB/s | 51 kB 00:00 2023-10-18T11:02:32.625 INFO:teuthology.orchestra.run.smithi169.stdout:(150/165): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2023-10-18T11:02:32.659 INFO:teuthology.orchestra.run.smithi169.stdout:(151/165): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2023-10-18T11:02:32.692 INFO:teuthology.orchestra.run.smithi169.stdout:(152/165): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2023-10-18T11:02:32.717 INFO:teuthology.orchestra.run.smithi169.stdout:(153/165): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2023-10-18T11:02:32.743 INFO:teuthology.orchestra.run.smithi169.stdout:(154/165): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2023-10-18T11:02:32.860 INFO:teuthology.orchestra.run.smithi169.stdout:(155/165): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2023-10-18T11:02:32.893 INFO:teuthology.orchestra.run.smithi169.stdout:(156/165): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-10-18T11:02:32.907 INFO:teuthology.orchestra.run.smithi151.stdout:(111/165): python3-cryptography-36.0.1-4.el9.x8 1.0 MB/s | 1.2 MB 00:01 2023-10-18T11:02:32.977 INFO:teuthology.orchestra.run.smithi169.stdout:(157/165): NetworkManager-1.45.4-1.el9.x86_64.r 27 MB/s | 2.2 MB 00:00 2023-10-18T11:02:33.044 INFO:teuthology.orchestra.run.smithi169.stdout:(158/165): NetworkManager-libnm-1.45.4-1.el9.x8 27 MB/s | 1.8 MB 00:00 2023-10-18T11:02:33.077 INFO:teuthology.orchestra.run.smithi169.stdout:(159/165): NetworkManager-team-1.45.4-1.el9.x86 1.2 MB/s | 41 kB 00:00 2023-10-18T11:02:33.103 INFO:teuthology.orchestra.run.smithi151.stdout:(112/165): python3-pytz-2021.1-5.el9.noarch.rpm 261 kB/s | 51 kB 00:00 2023-10-18T11:02:33.128 INFO:teuthology.orchestra.run.smithi169.stdout:(160/165): NetworkManager-tui-1.45.4-1.el9.x86_ 4.8 MB/s | 244 kB 00:00 2023-10-18T11:02:33.162 INFO:teuthology.orchestra.run.smithi169.stdout:(161/165): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-10-18T11:02:33.195 INFO:teuthology.orchestra.run.smithi169.stdout:(162/165): libacl-2.3.1-4.el9.x86_64.rpm 660 kB/s | 22 kB 00:00 2023-10-18T11:02:33.199 INFO:teuthology.orchestra.run.smithi151.stdout:(113/165): openssl-devel-3.0.7-24.el9.x86_64.rp 4.9 MB/s | 4.1 MB 00:00 2023-10-18T11:02:33.225 INFO:teuthology.orchestra.run.smithi151.stdout:(114/165): xfsprogs-devel-5.19.0-4.el9.x86_64.r 716 kB/s | 86 kB 00:00 2023-10-18T11:02:33.237 INFO:teuthology.orchestra.run.smithi169.stdout:(163/165): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2023-10-18T11:02:33.258 INFO:teuthology.orchestra.run.smithi151.stdout:(115/165): zlib-devel-1.2.11-40.el9.x86_64.rpm 782 kB/s | 45 kB 00:00 2023-10-18T11:02:33.296 INFO:teuthology.orchestra.run.smithi169.stdout:(164/165): librbd1-18.0.0-6713.g189714d0.el9.x8 5.5 MB/s | 3.0 MB 00:00 2023-10-18T11:02:33.346 INFO:teuthology.orchestra.run.smithi169.stdout:(165/165): librados2-18.0.0-6713.g189714d0.el9. 5.3 MB/s | 3.3 MB 00:00 2023-10-18T11:02:33.352 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2023-10-18T11:02:33.353 INFO:teuthology.orchestra.run.smithi169.stdout:Total 14 MB/s | 2.1 GB 02:29 2023-10-18T11:02:33.376 INFO:teuthology.orchestra.run.smithi151.stdout:(116/165): fmt-8.1.1-5.el9.x86_64.rpm 740 kB/s | 111 kB 00:00 2023-10-18T11:02:33.434 INFO:teuthology.orchestra.run.smithi151.stdout:(117/165): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2023-10-18T11:02:33.486 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2023-10-18T11:02:33.526 INFO:teuthology.orchestra.run.smithi151.stdout:(118/165): libarrow-doc-9.0.0-9.el9.noarch.rpm 268 kB/s | 24 kB 00:00 2023-10-18T11:02:33.593 INFO:teuthology.orchestra.run.smithi151.stdout:(119/165): liboath-2.6.7-2.el9.x86_64.rpm 739 kB/s | 49 kB 00:00 2023-10-18T11:02:33.620 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2023-10-18T11:02:33.620 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2023-10-18T11:02:33.644 INFO:teuthology.orchestra.run.smithi151.stdout:(120/165): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-10-18T11:02:33.736 INFO:teuthology.orchestra.run.smithi151.stdout:(121/165): libarrow-9.0.0-9.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2023-10-18T11:02:33.803 INFO:teuthology.orchestra.run.smithi151.stdout:(122/165): parquet-libs-9.0.0-9.el9.x86_64.rpm 5.2 MB/s | 837 kB 00:00 2023-10-18T11:02:33.854 INFO:teuthology.orchestra.run.smithi151.stdout:(123/165): python3-asyncssh-2.13.2-3.el9.noarch 4.6 MB/s | 548 kB 00:00 2023-10-18T11:02:33.907 INFO:teuthology.orchestra.run.smithi151.stdout:(124/165): python3-bcrypt-3.2.2-1.el9.x86_64.rp 425 kB/s | 43 kB 00:00 2023-10-18T11:02:33.938 INFO:teuthology.orchestra.run.smithi151.stdout:(125/165): python3-cachetools-4.2.4-1.el9.noarc 389 kB/s | 32 kB 00:00 2023-10-18T11:02:33.963 INFO:teuthology.orchestra.run.smithi151.stdout:(126/165): python3-certifi-2021.10.8-2.el9.noar 271 kB/s | 15 kB 00:00 2023-10-18T11:02:33.997 INFO:teuthology.orchestra.run.smithi151.stdout:(127/165): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2023-10-18T11:02:34.039 INFO:teuthology.orchestra.run.smithi151.stdout:(128/165): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2023-10-18T11:02:34.081 INFO:teuthology.orchestra.run.smithi151.stdout:(129/165): python3-google-auth-2.23.2-1.el9.noa 2.3 MB/s | 196 kB 00:00 2023-10-18T11:02:34.106 INFO:teuthology.orchestra.run.smithi151.stdout:(130/165): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2023-10-18T11:02:34.148 INFO:teuthology.orchestra.run.smithi151.stdout:(131/165): python3-jaraco-classes-3.2.1-5.el9.n 267 kB/s | 18 kB 00:00 2023-10-18T11:02:34.173 INFO:teuthology.orchestra.run.smithi151.stdout:(132/165): python3-jaraco-collections-3.0.0-8.e 349 kB/s | 23 kB 00:00 2023-10-18T11:02:34.215 INFO:teuthology.orchestra.run.smithi151.stdout:(133/165): python3-jaraco-functools-3.5.0-2.el9 479 kB/s | 19 kB 00:00 2023-10-18T11:02:34.257 INFO:teuthology.orchestra.run.smithi151.stdout:(134/165): python3-jwt+crypto-2.4.0-1.el9.noarc 221 kB/s | 9.0 kB 00:00 2023-10-18T11:02:34.333 INFO:teuthology.orchestra.run.smithi151.stdout:(135/165): python3-jaraco-text-3.2.0-6.el9.noar 124 kB/s | 20 kB 00:00 2023-10-18T11:02:34.358 INFO:teuthology.orchestra.run.smithi151.stdout:(136/165): python3-jwt-2.4.0-1.el9.noarch.rpm 411 kB/s | 41 kB 00:00 2023-10-18T11:02:34.426 INFO:teuthology.orchestra.run.smithi151.stdout:(137/165): python3-logutils-0.3.5-21.el9.noarch 701 kB/s | 46 kB 00:00 2023-10-18T11:02:34.484 INFO:teuthology.orchestra.run.smithi151.stdout:(138/165): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2023-10-18T11:02:34.510 INFO:teuthology.orchestra.run.smithi151.stdout:(139/165): python3-more-itertools-8.12.0-2.el9. 951 kB/s | 79 kB 00:00 2023-10-18T11:02:34.551 INFO:teuthology.orchestra.run.smithi151.stdout:(140/165): python3-natsort-7.1.1-5.el9.noarch.r 870 kB/s | 58 kB 00:00 2023-10-18T11:02:34.585 INFO:teuthology.orchestra.run.smithi151.stdout:(141/165): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2023-10-18T11:02:34.619 INFO:teuthology.orchestra.run.smithi151.stdout:(142/165): python3-portend-3.1.0-2.el9.noarch.r 248 kB/s | 16 kB 00:00 2023-10-18T11:02:34.694 INFO:teuthology.orchestra.run.smithi151.stdout:(143/165): python3-pyOpenSSL-21.0.0-1.el9.noarc 832 kB/s | 90 kB 00:00 2023-10-18T11:02:34.720 INFO:teuthology.orchestra.run.smithi151.stdout:(144/165): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2023-10-18T11:02:34.762 INFO:teuthology.orchestra.run.smithi151.stdout:(145/165): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2023-10-18T11:02:34.854 INFO:teuthology.orchestra.run.smithi151.stdout:(146/165): python3-tempora-5.0.0-2.el9.noarch.r 393 kB/s | 36 kB 00:00 2023-10-18T11:02:34.879 INFO:teuthology.orchestra.run.smithi151.stdout:(147/165): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2023-10-18T11:02:34.905 INFO:teuthology.orchestra.run.smithi151.stdout:(148/165): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-10-18T11:02:34.963 INFO:teuthology.orchestra.run.smithi151.stdout:(149/165): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-10-18T11:02:35.087 INFO:teuthology.orchestra.run.smithi151.stdout:(150/165): python3-werkzeug-2.0.3-3.el9.1.noarc 3.4 MB/s | 427 kB 00:00 2023-10-18T11:02:35.231 INFO:teuthology.orchestra.run.smithi151.stdout:(151/165): python3-zc-lockfile-2.0-10.el9.noarc 139 kB/s | 20 kB 00:00 2023-10-18T11:02:35.290 INFO:teuthology.orchestra.run.smithi151.stdout:(152/165): re2-20211101-3.el9.x86_64.rpm 3.3 MB/s | 192 kB 00:00 2023-10-18T11:02:35.415 INFO:teuthology.orchestra.run.smithi151.stdout:(153/165): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2023-10-18T11:02:35.449 INFO:teuthology.orchestra.run.smithi151.stdout:(154/165): python3-webob-1.8.7-6.el9.noarch.rpm 404 kB/s | 230 kB 00:00 2023-10-18T11:02:36.066 INFO:teuthology.orchestra.run.smithi151.stdout:(155/165): librbd1-18.0.0-6713.g189714d0.el9.x8 4.9 MB/s | 3.0 MB 00:00 2023-10-18T11:02:36.108 INFO:teuthology.orchestra.run.smithi151.stdout:(156/165): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-10-18T11:02:36.225 INFO:teuthology.orchestra.run.smithi151.stdout:(157/165): NetworkManager-1.45.4-1.el9.x86_64.r 19 MB/s | 2.2 MB 00:00 2023-10-18T11:02:36.325 INFO:teuthology.orchestra.run.smithi151.stdout:(158/165): librados2-18.0.0-6713.g189714d0.el9. 3.6 MB/s | 3.3 MB 00:00 2023-10-18T11:02:36.401 INFO:teuthology.orchestra.run.smithi151.stdout:(159/165): NetworkManager-libnm-1.45.4-1.el9.x8 10 MB/s | 1.8 MB 00:00 2023-10-18T11:02:36.426 INFO:teuthology.orchestra.run.smithi151.stdout:(160/165): NetworkManager-team-1.45.4-1.el9.x86 479 kB/s | 41 kB 00:00 2023-10-18T11:02:36.460 INFO:teuthology.orchestra.run.smithi151.stdout:(161/165): NetworkManager-tui-1.45.4-1.el9.x86_ 4.2 MB/s | 244 kB 00:00 2023-10-18T11:02:36.493 INFO:teuthology.orchestra.run.smithi151.stdout:(162/165): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2023-10-18T11:02:36.519 INFO:teuthology.orchestra.run.smithi151.stdout:(163/165): libacl-2.3.1-4.el9.x86_64.rpm 379 kB/s | 22 kB 00:00 2023-10-18T11:02:36.552 INFO:teuthology.orchestra.run.smithi151.stdout:(164/165): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-10-18T11:02:46.604 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2023-10-18T11:02:46.605 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2023-10-18T11:02:48.977 INFO:teuthology.orchestra.run.smithi151.stdout:(165/165): ceph-test-debuginfo-18.0.0-6713.g189 11 MB/s | 625 MB 00:54 2023-10-18T11:02:48.987 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-18T11:02:48.987 INFO:teuthology.orchestra.run.smithi151.stdout:Total 13 MB/s | 2.1 GB 02:40 2023-10-18T11:02:49.428 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-18T11:02:49.639 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-18T11:02:49.640 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-18T11:03:03.623 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-18T11:03:03.624 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-18T11:03:06.482 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2023-10-18T11:03:06.569 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_6 1/175 2023-10-18T11:03:06.603 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/175 2023-10-18T11:03:06.637 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/175 2023-10-18T11:03:06.663 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 4/175 2023-10-18T11:03:06.712 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/175 2023-10-18T11:03:07.127 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/175 2023-10-18T11:03:07.188 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:18.0.0-6713.g189714d0.el9.x86_64 7/175 2023-10-18T11:03:07.307 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:18.0.0-6713.g189714d0.el9.x86_64 7/175 2023-10-18T11:03:07.339 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:18.0.0-6713.g189714d0.el9.x86_64 8/175 2023-10-18T11:03:07.431 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:18.0.0-6713.g189714d0.el9.x86_64 8/175 2023-10-18T11:03:07.473 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:18.0.0-6713.g189714d0.el9.x86_64 9/175 2023-10-18T11:03:07.502 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 10/175 2023-10-18T11:03:07.654 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/175 2023-10-18T11:03:07.709 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/175 2023-10-18T11:03:07.737 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:18.0.0-6713.g189714d0.el9.x86_64 13/175 2023-10-18T11:03:07.829 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6713.g189714d0.el9.x86_64 13/175 2023-10-18T11:03:07.855 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:18.0.0-6713.g189714d0.el9.x86 14/175 2023-10-18T11:03:07.899 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6713.g189714d0.el9.x86 14/175 2023-10-18T11:03:08.029 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/175 2023-10-18T11:03:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 16/175 2023-10-18T11:03:08.185 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 16/175 2023-10-18T11:03:08.245 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-18T11:03:08.304 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-18T11:03:08.580 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-18T11:03:08.616 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/175 2023-10-18T11:03:08.651 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/175 2023-10-18T11:03:08.727 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/175 2023-10-18T11:03:08.789 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 21/175 2023-10-18T11:03:08.819 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/175 2023-10-18T11:03:08.855 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/175 2023-10-18T11:03:08.926 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/175 2023-10-18T11:03:08.960 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/175 2023-10-18T11:03:08.988 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/175 2023-10-18T11:03:09.058 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/175 2023-10-18T11:03:09.093 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:18.0.0-6713.g189714d0.el9. 28/175 2023-10-18T11:03:09.136 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:18.0.0-6713.g189714d0.el 29/175 2023-10-18T11:03:09.211 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:18.0.0-6713.g189714d0.el9.x86_6 30/175 2023-10-18T11:03:09.347 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/175 2023-10-18T11:03:09.397 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/175 2023-10-18T11:03:09.945 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/175 2023-10-18T11:03:10.028 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/175 2023-10-18T11:03:10.073 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/175 2023-10-18T11:03:10.121 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:18.0.0-6713.g189714d0.el9.x86_6 36/175 2023-10-18T11:03:10.149 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 37/175 2023-10-18T11:03:10.252 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-3.el9.x86_64 38/175 2023-10-18T11:03:10.287 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 39/175 2023-10-18T11:03:10.342 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 40/175 2023-10-18T11:03:10.416 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 41/175 2023-10-18T11:03:10.453 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 42/175 2023-10-18T11:03:10.490 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 43/175 2023-10-18T11:03:10.537 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 44/175 2023-10-18T11:03:10.582 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 45/175 2023-10-18T11:03:10.616 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 46/175 2023-10-18T11:03:10.755 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 47/175 2023-10-18T11:03:10.793 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 48/175 2023-10-18T11:03:10.835 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 49/175 2023-10-18T11:03:10.930 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 50/175 2023-10-18T11:03:10.967 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 51/175 2023-10-18T11:03:11.007 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 52/175 2023-10-18T11:03:11.032 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 53/175 2023-10-18T11:03:11.051 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 54/175 2023-10-18T11:03:11.076 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fmt-8.1.1-5.el9.x86_64 55/175 2023-10-18T11:03:11.104 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 56/175 2023-10-18T11:03:11.194 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 57/175 2023-10-18T11:03:11.237 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 58/175 2023-10-18T11:03:11.286 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 59/175 2023-10-18T11:03:11.341 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 60/175 2023-10-18T11:03:11.530 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 61/175 2023-10-18T11:03:11.583 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 62/175 2023-10-18T11:03:11.724 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 63/175 2023-10-18T11:03:11.769 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 64/175 2023-10-18T11:03:11.798 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 65/175 2023-10-18T11:03:11.823 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 66/175 2023-10-18T11:03:11.855 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 67/175 2023-10-18T11:03:11.889 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-15.el9.x86_64 68/175 2023-10-18T11:03:11.923 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/175 2023-10-18T11:03:11.968 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/175 2023-10-18T11:03:12.002 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 71/175 2023-10-18T11:03:12.032 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/175 2023-10-18T11:03:12.111 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/175 2023-10-18T11:03:12.143 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 74/175 2023-10-18T11:03:12.168 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/175 2023-10-18T11:03:12.209 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/175 2023-10-18T11:03:12.244 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/175 2023-10-18T11:03:12.335 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/175 2023-10-18T11:03:12.371 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 79/175 2023-10-18T11:03:12.475 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/175 2023-10-18T11:03:12.530 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/175 2023-10-18T11:03:13.268 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/175 2023-10-18T11:03:13.507 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/175 2023-10-18T11:03:13.662 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-18T11:03:13.763 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/175 2023-10-18T11:03:13.795 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 86/175 2023-10-18T11:03:13.972 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/175 2023-10-18T11:03:14.001 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/175 2023-10-18T11:03:14.079 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/175 2023-10-18T11:03:14.722 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/175 2023-10-18T11:03:14.842 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/175 2023-10-18T11:03:16.083 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/175 2023-10-18T11:03:16.160 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/175 2023-10-18T11:03:16.191 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/175 2023-10-18T11:03:16.222 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : jq-1.6-15.el9.x86_64 95/175 2023-10-18T11:03:16.249 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/175 2023-10-18T11:03:16.550 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 97/175 2023-10-18T11:03:16.571 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:18.0.0-6713.g189714d0.el9.x86_64 98/175 2023-10-18T11:03:16.662 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:18.0.0-6713.g189714d0.el9.x86_64 98/175 2023-10-18T11:03:16.692 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:18.0.0-6713.g189714d0.el9.x86_64 99/175 2023-10-18T11:03:16.728 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 100/175 2023-10-18T11:03:17.152 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 101/175 2023-10-18T11:03:17.182 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:18.0.0-6713.g189714d0.el9.x86_64 102/175 2023-10-18T11:03:17.253 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:18.0.0-6713.g189714d0.el9.x86_64 102/175 2023-10-18T11:03:17.283 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:18.0.0-6713.g189714d0.el9.x86_64 103/175 2023-10-18T11:03:19.389 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 104/175 2023-10-18T11:03:19.421 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 104/175 2023-10-18T11:03:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 104/175 2023-10-18T11:03:19.991 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:18.0.0-6713.g189714d0.el9.x86_64 105/175 2023-10-18T11:03:20.073 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:18.0.0-6713.g189714d0.el9.x86_64 105/175 2023-10-18T11:03:20.073 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-18T11:03:20.074 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-18T11:03:20.074 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:20.101 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:18.0.0-6713.g189714d0.el9.x86_64 106/175 2023-10-18T11:03:24.279 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-18T11:03:24.378 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_6 1/175 2023-10-18T11:03:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/175 2023-10-18T11:03:24.453 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/175 2023-10-18T11:03:24.508 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 4/175 2023-10-18T11:03:24.614 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/175 2023-10-18T11:03:25.004 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/175 2023-10-18T11:03:25.080 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:18.0.0-6713.g189714d0.el9.x86_64 7/175 2023-10-18T11:03:25.245 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:18.0.0-6713.g189714d0.el9.x86_64 7/175 2023-10-18T11:03:25.295 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:18.0.0-6713.g189714d0.el9.x86_64 8/175 2023-10-18T11:03:25.416 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:18.0.0-6713.g189714d0.el9.x86_64 8/175 2023-10-18T11:03:25.497 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:18.0.0-6713.g189714d0.el9.x86_64 9/175 2023-10-18T11:03:25.539 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 10/175 2023-10-18T11:03:25.793 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/175 2023-10-18T11:03:25.854 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.11-1.el9.x86_64 12/175 2023-10-18T11:03:25.887 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:18.0.0-6713.g189714d0.el9.x86_64 13/175 2023-10-18T11:03:26.043 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6713.g189714d0.el9.x86_64 13/175 2023-10-18T11:03:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:18.0.0-6713.g189714d0.el9.x86 14/175 2023-10-18T11:03:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6713.g189714d0.el9.x86 14/175 2023-10-18T11:03:26.520 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 15/175 2023-10-18T11:03:26.703 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 16/175 2023-10-18T11:03:26.783 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 16/175 2023-10-18T11:03:27.062 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-18T11:03:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-18T11:03:27.555 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 17/175 2023-10-18T11:03:27.605 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/175 2023-10-18T11:03:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/175 2023-10-18T11:03:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/175 2023-10-18T11:03:27.853 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 21/175 2023-10-18T11:03:27.885 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/175 2023-10-18T11:03:27.939 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/175 2023-10-18T11:03:28.053 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/175 2023-10-18T11:03:28.146 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/175 2023-10-18T11:03:28.197 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/175 2023-10-18T11:03:28.314 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/175 2023-10-18T11:03:28.360 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:18.0.0-6713.g189714d0.el9. 28/175 2023-10-18T11:03:28.412 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:18.0.0-6713.g189714d0.el 29/175 2023-10-18T11:03:28.526 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:18.0.0-6713.g189714d0.el9.x86_6 30/175 2023-10-18T11:03:28.711 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/175 2023-10-18T11:03:28.781 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/175 2023-10-18T11:03:29.486 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/175 2023-10-18T11:03:29.587 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/175 2023-10-18T11:03:29.641 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 35/175 2023-10-18T11:03:29.679 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:18.0.0-6713.g189714d0.el9.x86_6 36/175 2023-10-18T11:03:29.753 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 37/175 2023-10-18T11:03:29.920 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 38/175 2023-10-18T11:03:29.973 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 39/175 2023-10-18T11:03:30.046 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 40/175 2023-10-18T11:03:30.147 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 41/175 2023-10-18T11:03:30.191 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 42/175 2023-10-18T11:03:30.231 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 43/175 2023-10-18T11:03:30.355 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 44/175 2023-10-18T11:03:30.748 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 45/175 2023-10-18T11:03:30.824 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 46/175 2023-10-18T11:03:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 47/175 2023-10-18T11:03:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 48/175 2023-10-18T11:03:31.191 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 49/175 2023-10-18T11:03:31.334 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 50/175 2023-10-18T11:03:31.381 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 51/175 2023-10-18T11:03:31.439 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 52/175 2023-10-18T11:03:31.474 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 53/175 2023-10-18T11:03:31.539 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 54/175 2023-10-18T11:03:31.544 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6713.g189714d0.el9.x86_64 106/175 2023-10-18T11:03:31.545 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2023-10-18T11:03:31.545 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2023-10-18T11:03:31.545 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2023-10-18T11:03:31.545 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2023-10-18T11:03:31.546 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2023-10-18T11:03:31.546 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2023-10-18T11:03:31.546 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2023-10-18T11:03:31.546 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:31.582 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fmt-8.1.1-5.el9.x86_64 55/175 2023-10-18T11:03:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 56/175 2023-10-18T11:03:31.706 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:18.0.0-6713.g189714d0.el9.noarch 107/175 2023-10-18T11:03:31.723 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:18.0.0-6713.g189714d0.el9.noarch 107/175 2023-10-18T11:03:31.723 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:31.723 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-18T11:03:31.724 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:31.789 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 57/175 2023-10-18T11:03:31.849 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 58/175 2023-10-18T11:03:31.954 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 59/175 2023-10-18T11:03:32.063 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 60/175 2023-10-18T11:03:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 61/175 2023-10-18T11:03:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 62/175 2023-10-18T11:03:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 63/175 2023-10-18T11:03:32.638 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 64/175 2023-10-18T11:03:32.672 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 65/175 2023-10-18T11:03:32.737 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 66/175 2023-10-18T11:03:32.783 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 67/175 2023-10-18T11:03:32.851 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 68/175 2023-10-18T11:03:32.914 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/175 2023-10-18T11:03:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/175 2023-10-18T11:03:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 71/175 2023-10-18T11:03:33.126 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/175 2023-10-18T11:03:33.272 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/175 2023-10-18T11:03:33.275 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:18.0.0-6713.g189714d0.el9.x86_64 108/175 2023-10-18T11:03:33.300 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:18.0.0-6713.g189714d0.el9.x86_64 108/175 2023-10-18T11:03:33.301 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:33.301 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-18T11:03:33.301 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-18T11:03:33.301 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-18T11:03:33.301 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:33.323 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 74/175 2023-10-18T11:03:33.358 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/175 2023-10-18T11:03:33.420 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/175 2023-10-18T11:03:33.462 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/175 2023-10-18T11:03:33.501 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:18.0.0-6713.g189714d0.el9.x86_64 109/175 2023-10-18T11:03:33.523 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:18.0.0-6713.g189714d0.el9.x86_64 109/175 2023-10-18T11:03:33.523 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:33.523 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-18T11:03:33.524 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-18T11:03:33.524 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-18T11:03:33.524 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:33.645 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/175 2023-10-18T11:03:33.693 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 79/175 2023-10-18T11:03:33.833 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/175 2023-10-18T11:03:33.901 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/175 2023-10-18T11:03:33.960 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:18.0.0-6713.g189714d0.el9.x86_64 110/175 2023-10-18T11:03:33.982 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:18.0.0-6713.g189714d0.el9.x86_64 110/175 2023-10-18T11:03:33.983 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:33.983 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-18T11:03:33.983 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-18T11:03:33.983 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-18T11:03:33.984 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:34.318 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:18.0.0-6713.g189714d0.el9.noarch 111/175 2023-10-18T11:03:34.342 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:18.0.0-6713.g189714d0.el9.noarch 111/175 2023-10-18T11:03:34.371 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6713.g189714d0.e 112/175 2023-10-18T11:03:34.433 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6713.g189714d0. 113/175 2023-10-18T11:03:34.457 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6713.g189714d0.el9.noa 114/175 2023-10-18T11:03:34.676 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6713.g189714d0.el9.noa 114/175 2023-10-18T11:03:34.716 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6713.g189714d0.el9.n 115/175 2023-10-18T11:03:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/175 2023-10-18T11:03:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/175 2023-10-18T11:03:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-18T11:03:35.109 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/175 2023-10-18T11:03:35.152 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 86/175 2023-10-18T11:03:35.391 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/175 2023-10-18T11:03:35.424 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/175 2023-10-18T11:03:35.517 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/175 2023-10-18T11:03:35.670 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6713.g189714d0.el9.n 115/175 2023-10-18T11:03:35.700 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6713.g189 116/175 2023-10-18T11:03:35.800 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6713.g189 116/175 2023-10-18T11:03:35.965 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6713.g189714d0.el 117/175 2023-10-18T11:03:35.994 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:18.0.0-6713.g189714d0.el9.x86_64 118/175 2023-10-18T11:03:36.017 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6713.g189714d0.el9.x86_64 118/175 2023-10-18T11:03:36.017 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:36.017 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-18T11:03:36.017 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-18T11:03:36.018 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-18T11:03:36.018 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:36.061 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:18.0.0-6713.g189714d0.el9.noarch 119/175 2023-10-18T11:03:36.071 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6713.g189714d0.el9.noarch 119/175 2023-10-18T11:03:36.356 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/175 2023-10-18T11:03:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/175 2023-10-18T11:03:36.835 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:18.0.0-6713.g189714d0.el9.x86_64 120/175 2023-10-18T11:03:36.862 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:18.0.0-6713.g189714d0.el9.x86_64 121/175 2023-10-18T11:03:36.884 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6713.g189714d0.el9.x86_64 121/175 2023-10-18T11:03:36.885 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:36.885 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-18T11:03:36.885 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-18T11:03:36.885 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-18T11:03:36.886 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:36.921 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6713.g18971 122/175 2023-10-18T11:03:36.943 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6713.g18971 122/175 2023-10-18T11:03:36.943 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:36.943 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-18T11:03:36.943 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:37.005 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 123/175 2023-10-18T11:03:37.027 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 123/175 2023-10-18T11:03:37.027 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:37.028 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-18T11:03:37.028 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-18T11:03:37.028 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-18T11:03:37.028 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:37.323 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 124/175 2023-10-18T11:03:37.344 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 124/175 2023-10-18T11:03:37.345 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:37.345 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-18T11:03:37.345 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-18T11:03:37.345 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-18T11:03:37.345 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:03:38.088 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/175 2023-10-18T11:03:38.177 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/175 2023-10-18T11:03:38.215 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/175 2023-10-18T11:03:38.247 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-15.el9.x86_64 95/175 2023-10-18T11:03:38.286 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/175 2023-10-18T11:03:38.688 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 97/175 2023-10-18T11:03:38.743 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:18.0.0-6713.g189714d0.el9.x86_64 98/175 2023-10-18T11:03:38.861 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:18.0.0-6713.g189714d0.el9.x86_64 98/175 2023-10-18T11:03:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:18.0.0-6713.g189714d0.el9.x86_64 99/175 2023-10-18T11:03:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 100/175 2023-10-18T11:03:39.453 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 101/175 2023-10-18T11:03:39.513 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:18.0.0-6713.g189714d0.el9.x86_64 102/175 2023-10-18T11:03:39.598 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:18.0.0-6713.g189714d0.el9.x86_64 102/175 2023-10-18T11:03:39.632 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:18.0.0-6713.g189714d0.el9.x86_64 103/175 2023-10-18T11:03:41.084 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:18.0.0-6713.g189714d0.el9.x86_64 125/175 2023-10-18T11:03:41.125 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 126/175 2023-10-18T11:03:41.156 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:18.0.0-6713.g189714d0.el9.x86_64 127/175 2023-10-18T11:03:41.326 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 128/175 2023-10-18T11:03:41.436 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 129/175 2023-10-18T11:03:41.495 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 130/175 2023-10-18T11:03:41.539 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/175 2023-10-18T11:03:41.581 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 132/175 2023-10-18T11:03:41.603 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:18.0.0-6713.g189714d0.el9.x86_ 133/175 2023-10-18T11:03:41.632 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 134/175 2023-10-18T11:03:41.696 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 135/175 2023-10-18T11:03:41.729 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 136/175 2023-10-18T11:03:41.764 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 137/175 2023-10-18T11:03:42.101 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 104/175 2023-10-18T11:03:42.139 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 104/175 2023-10-18T11:03:42.373 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-18T11:03:42.413 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-18T11:03:42.432 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-18T11:03:42.761 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 104/175 2023-10-18T11:03:42.810 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:18.0.0-6713.g189714d0.el9.x86_64 105/175 2023-10-18T11:03:42.981 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:18.0.0-6713.g189714d0.el9.x86_64 105/175 2023-10-18T11:03:43.003 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-18T11:03:43.003 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-18T11:03:43.004 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:03:43.020 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:18.0.0-6713.g189714d0.el9.x86_64 106/175 2023-10-18T11:03:50.016 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:18.0.0-6713.g189714d0.el9.noarch 139/175 2023-10-18T11:03:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6713.g189714d0.el9.x86_64 106/175 2023-10-18T11:03:56.708 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-10-18T11:03:56.708 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-10-18T11:03:56.708 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-10-18T11:03:56.708 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-10-18T11:03:56.709 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-10-18T11:03:56.709 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2023-10-18T11:03:56.709 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-10-18T11:03:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:03:56.927 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:18.0.0-6713.g189714d0.el9.noarch 107/175 2023-10-18T11:03:56.970 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:18.0.0-6713.g189714d0.el9.noarch 107/175 2023-10-18T11:03:56.970 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:56.970 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-18T11:03:56.970 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:03:58.656 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:18.0.0-6713.g189714d0.el9.x86_64 108/175 2023-10-18T11:03:58.743 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:18.0.0-6713.g189714d0.el9.x86_64 108/175 2023-10-18T11:03:58.744 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:58.744 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-18T11:03:58.744 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-18T11:03:58.744 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-18T11:03:58.745 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:03:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:18.0.0-6713.g189714d0.el9.x86_64 109/175 2023-10-18T11:03:59.075 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:18.0.0-6713.g189714d0.el9.x86_64 109/175 2023-10-18T11:03:59.076 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:59.076 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-18T11:03:59.076 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-18T11:03:59.076 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-18T11:03:59.077 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:03:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:18.0.0-6713.g189714d0.el9.x86_64 110/175 2023-10-18T11:03:59.642 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:18.0.0-6713.g189714d0.el9.x86_64 110/175 2023-10-18T11:03:59.643 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:03:59.643 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-18T11:03:59.643 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-18T11:03:59.643 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-18T11:03:59.643 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:04:00.368 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.0.0-6713.g189714d0.el9.noarch 111/175 2023-10-18T11:04:00.403 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:18.0.0-6713.g189714d0.el9.noarch 111/175 2023-10-18T11:04:00.451 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6713.g189714d0.e 112/175 2023-10-18T11:04:00.564 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6713.g189714d0. 113/175 2023-10-18T11:04:00.632 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6713.g189714d0.el9.noa 114/175 2023-10-18T11:04:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6713.g189714d0.el9.noa 114/175 2023-10-18T11:04:01.039 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6713.g189714d0.el9.n 115/175 2023-10-18T11:04:02.187 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6713.g189714d0.el9.n 115/175 2023-10-18T11:04:02.238 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6713.g189 116/175 2023-10-18T11:04:02.385 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6713.g189 116/175 2023-10-18T11:04:02.575 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6713.g189714d0.el 117/175 2023-10-18T11:04:02.602 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:18.0.0-6713.g189714d0.el9.x86_64 118/175 2023-10-18T11:04:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6713.g189714d0.el9.x86_64 118/175 2023-10-18T11:04:02.678 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:04:02.678 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-18T11:04:02.678 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-18T11:04:02.678 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-18T11:04:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:04:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:18.0.0-6713.g189714d0.el9.noarch 119/175 2023-10-18T11:04:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6713.g189714d0.el9.noarch 119/175 2023-10-18T11:04:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:18.0.0-6713.g189714d0.el9.x86_64 120/175 2023-10-18T11:04:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:18.0.0-6713.g189714d0.el9.x86_64 121/175 2023-10-18T11:04:03.730 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6713.g189714d0.el9.x86_64 121/175 2023-10-18T11:04:03.730 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:04:03.731 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-18T11:04:03.731 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-18T11:04:03.731 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-18T11:04:03.731 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:04:03.788 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6713.g18971 122/175 2023-10-18T11:04:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6713.g18971 122/175 2023-10-18T11:04:03.862 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:04:03.863 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-18T11:04:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:04:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 123/175 2023-10-18T11:04:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 123/175 2023-10-18T11:04:04.038 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:04:04.038 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-18T11:04:04.038 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-18T11:04:04.038 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-18T11:04:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:04:04.373 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 124/175 2023-10-18T11:04:04.446 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 124/175 2023-10-18T11:04:04.447 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-18T11:04:04.447 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-18T11:04:04.447 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-18T11:04:04.448 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-18T11:04:04.448 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:04:08.580 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:18.0.0-6713.g189714d0.el9.x86_64 125/175 2023-10-18T11:04:08.663 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 126/175 2023-10-18T11:04:08.704 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:18.0.0-6713.g189714d0.el9.x86_64 127/175 2023-10-18T11:04:09.015 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 128/175 2023-10-18T11:04:09.153 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 129/175 2023-10-18T11:04:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 130/175 2023-10-18T11:04:09.275 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/175 2023-10-18T11:04:09.312 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 132/175 2023-10-18T11:04:09.350 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:18.0.0-6713.g189714d0.el9.x86_ 133/175 2023-10-18T11:04:09.388 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 134/175 2023-10-18T11:04:09.532 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 135/175 2023-10-18T11:04:09.605 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 136/175 2023-10-18T11:04:09.656 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 137/175 2023-10-18T11:04:10.548 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-18T11:04:10.597 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-18T11:04:10.654 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 138/175 2023-10-18T11:04:18.933 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:18.0.0-6713.g189714d0.el9.noarch 139/175 2023-10-18T11:04:28.648 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6713.g189714d0.el9. 140/175 2023-10-18T11:04:29.331 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6713.g189714d0.el 141/175 2023-10-18T11:04:29.676 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9. 142/175 2023-10-18T11:04:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 143/175 2023-10-18T11:04:36.255 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6713.g189714d0.el9.x 144/175 2023-10-18T11:04:47.412 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6713.g189714d0.el9.x 145/175 2023-10-18T11:05:01.426 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6713.g189714d0.el9. 140/175 2023-10-18T11:05:02.085 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6713.g189714d0.el 141/175 2023-10-18T11:05:02.297 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9. 142/175 2023-10-18T11:05:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 143/175 2023-10-18T11:05:10.701 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6713.g189714d0.el9.x 144/175 2023-10-18T11:05:17.622 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6713.g189714d0.el9.x 146/175 2023-10-18T11:05:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6713.g189714d0.el9.x 145/175 2023-10-18T11:05:34.233 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6713.g189714d0.el9.x 147/175 2023-10-18T11:05:55.741 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6713.g189714d0.el9.x 146/175 2023-10-18T11:06:13.822 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6713.g189714d0.el9.x 147/175 2023-10-18T11:06:36.032 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6713.g189714d0.e 148/175 2023-10-18T11:06:36.579 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6713.g189714d0.el9. 149/175 2023-10-18T11:06:36.621 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6713.g189714d0.el9 150/175 2023-10-18T11:06:41.377 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6713.g189714d0 151/175 2023-10-18T11:06:46.856 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados2-debuginfo-2:18.0.0-6713.g189714d0.el9. 152/175 2023-10-18T11:06:47.202 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librbd1-debuginfo-2:18.0.0-6713.g189714d0.el9.x8 153/175 2023-10-18T11:06:47.525 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6713.g189714d0 154/175 2023-10-18T11:06:47.911 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6713.g189714d0. 155/175 2023-10-18T11:06:48.202 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6713.g189714d0.el 156/175 2023-10-18T11:06:48.415 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6713.g189714d0.el 157/175 2023-10-18T11:06:53.812 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9.x 158/175 2023-10-18T11:06:54.203 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6713.g189714d0.el9 159/175 2023-10-18T11:06:55.174 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6713.g189714d0.el9.x8 160/175 2023-10-18T11:06:56.306 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/175 2023-10-18T11:06:56.385 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 162/175 2023-10-18T11:06:56.425 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 163/175 2023-10-18T11:06:56.504 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/175 2023-10-18T11:06:56.555 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/175 2023-10-18T11:06:56.581 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 166/175 2023-10-18T11:06:56.581 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-18T11:06:56.648 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-18T11:06:56.673 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 168/175 2023-10-18T11:06:56.701 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 169/175 2023-10-18T11:06:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 170/175 2023-10-18T11:06:56.729 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-18T11:06:56.730 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-18T11:06:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-18T11:06:56.910 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-18T11:06:56.993 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-18T11:06:57.018 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-18T11:06:57.018 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-18T11:06:57.102 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-18T11:06:57.165 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-18T11:07:06.208 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-18T11:07:06.209 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:18.0.0-6713.g189714d0.el9.x86_64 1/175 2023-10-18T11:07:06.209 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:18.0.0-6713.g189714d0.el9.x86_64 2/175 2023-10-18T11:07:06.210 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6713.g189714d0.el9. 3/175 2023-10-18T11:07:06.210 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 4/175 2023-10-18T11:07:06.210 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6713.g189714d0.el 5/175 2023-10-18T11:07:06.210 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_6 6/175 2023-10-18T11:07:06.210 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 7/175 2023-10-18T11:07:06.210 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9. 8/175 2023-10-18T11:07:06.211 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6713.g18971 9/175 2023-10-18T11:07:06.211 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 10/175 2023-10-18T11:07:06.211 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:18.0.0-6713.g189714d0.el9.x86_64 11/175 2023-10-18T11:07:06.211 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6713.g189714d0.el9.x 12/175 2023-10-18T11:07:06.211 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:18.0.0-6713.g189714d0.el9.x86_64 13/175 2023-10-18T11:07:06.212 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6713.g189714d0.el9.x 14/175 2023-10-18T11:07:06.212 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:18.0.0-6713.g189714d0.el9.x86_64 15/175 2023-10-18T11:07:06.212 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6713.g189714d0.el9.x 16/175 2023-10-18T11:07:06.212 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:18.0.0-6713.g189714d0.el9.x86_64 17/175 2023-10-18T11:07:06.212 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6713.g189714d0.el9.x 18/175 2023-10-18T11:07:06.212 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:18.0.0-6713.g189714d0.el9.x86_64 19/175 2023-10-18T11:07:06.213 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6713.g189714d0.e 20/175 2023-10-18T11:07:06.213 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:18.0.0-6713.g189714d0.el9.x86_64 21/175 2023-10-18T11:07:06.213 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:18.0.0-6713.g189714d0.el9.x86_64 22/175 2023-10-18T11:07:06.213 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6713.g189714d0.el9. 23/175 2023-10-18T11:07:06.213 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 24/175 2023-10-18T11:07:06.213 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:18.0.0-6713.g189714d0.el9.x86_ 25/175 2023-10-18T11:07:06.214 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:18.0.0-6713.g189714d0.el9.x86_64 26/175 2023-10-18T11:07:06.214 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6713.g189714d0.el9 27/175 2023-10-18T11:07:06.214 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:18.0.0-6713.g189714d0.el9.x86_64 28/175 2023-10-18T11:07:06.214 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:18.0.0-6713.g189714d0.el9.x86_6 29/175 2023-10-18T11:07:06.214 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6713.g189714d0 30/175 2023-10-18T11:07:06.215 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-debuginfo-2:18.0.0-6713.g189714d0.el9. 31/175 2023-10-18T11:07:06.215 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:18.0.0-6713.g189714d0.el9.x86 32/175 2023-10-18T11:07:06.215 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6713.g189714d0.el9.x8 33/175 2023-10-18T11:07:06.215 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:18.0.0-6713.g189714d0.el9.x86_64 34/175 2023-10-18T11:07:06.215 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6713.g189714d0.el 35/175 2023-10-18T11:07:06.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:18.0.0-6713.g189714d0.el9. 36/175 2023-10-18T11:07:06.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:18.0.0-6713.g189714d0.el9.x86_6 37/175 2023-10-18T11:07:06.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6713.g189714d0 38/175 2023-10-18T11:07:06.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:18.0.0-6713.g189714d0.el9.x86_64 39/175 2023-10-18T11:07:06.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6713.g189714d0. 40/175 2023-10-18T11:07:06.216 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:18.0.0-6713.g189714d0.el9.x86_64 41/175 2023-10-18T11:07:06.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6713.g189714d0.el 42/175 2023-10-18T11:07:06.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:18.0.0-6713.g189714d0.el9.x86_64 43/175 2023-10-18T11:07:06.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6713.g189714d0.el 44/175 2023-10-18T11:07:06.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 45/175 2023-10-18T11:07:06.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9.x 46/175 2023-10-18T11:07:06.217 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 47/175 2023-10-18T11:07:06.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6713.g189714d0.el9 48/175 2023-10-18T11:07:06.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:18.0.0-6713.g189714d0.el9.x86_64 49/175 2023-10-18T11:07:06.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6713.g189714d0.el9.x8 50/175 2023-10-18T11:07:06.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6713.g189714d0. 51/175 2023-10-18T11:07:06.218 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6713.g189714d0.el9.noa 52/175 2023-10-18T11:07:06.219 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6713.g189714d0.el9.n 53/175 2023-10-18T11:07:06.219 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6713.g189 54/175 2023-10-18T11:07:06.219 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6713.g189714d0.el 55/175 2023-10-18T11:07:06.219 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6713.g189714d0.el9.noarch 56/175 2023-10-18T11:07:06.219 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6713.g189714d0.e 57/175 2023-10-18T11:07:06.219 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:18.0.0-6713.g189714d0.el9.noarch 58/175 2023-10-18T11:07:06.220 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:18.0.0-6713.g189714d0.el9.noarch 59/175 2023-10-18T11:07:06.220 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:18.0.0-6713.g189714d0.el9.noarch 60/175 2023-10-18T11:07:06.220 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 61/175 2023-10-18T11:07:06.220 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 62/175 2023-10-18T11:07:06.220 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 63/175 2023-10-18T11:07:06.221 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 64/175 2023-10-18T11:07:06.221 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 65/175 2023-10-18T11:07:06.221 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 66/175 2023-10-18T11:07:06.221 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 67/175 2023-10-18T11:07:06.221 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 68/175 2023-10-18T11:07:06.222 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 69/175 2023-10-18T11:07:06.222 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 70/175 2023-10-18T11:07:06.222 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 71/175 2023-10-18T11:07:06.222 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 72/175 2023-10-18T11:07:06.222 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 73/175 2023-10-18T11:07:06.223 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 74/175 2023-10-18T11:07:06.223 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 75/175 2023-10-18T11:07:06.223 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-13.11-1.el9.x86_64 76/175 2023-10-18T11:07:06.223 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 77/175 2023-10-18T11:07:06.223 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 78/175 2023-10-18T11:07:06.223 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 79/175 2023-10-18T11:07:06.224 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 80/175 2023-10-18T11:07:06.224 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 81/175 2023-10-18T11:07:06.224 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 82/175 2023-10-18T11:07:06.224 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 83/175 2023-10-18T11:07:06.224 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-18T11:07:06.225 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 85/175 2023-10-18T11:07:06.225 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 86/175 2023-10-18T11:07:06.225 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 87/175 2023-10-18T11:07:06.225 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/175 2023-10-18T11:07:06.225 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 89/175 2023-10-18T11:07:06.225 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 90/175 2023-10-18T11:07:06.226 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 91/175 2023-10-18T11:07:06.226 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 92/175 2023-10-18T11:07:06.226 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/175 2023-10-18T11:07:06.226 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/175 2023-10-18T11:07:06.226 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/175 2023-10-18T11:07:06.226 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 96/175 2023-10-18T11:07:06.227 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 97/175 2023-10-18T11:07:06.227 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 98/175 2023-10-18T11:07:06.227 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 99/175 2023-10-18T11:07:06.227 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 100/175 2023-10-18T11:07:06.227 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 101/175 2023-10-18T11:07:06.227 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 102/175 2023-10-18T11:07:06.228 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 103/175 2023-10-18T11:07:06.228 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 104/175 2023-10-18T11:07:06.228 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 105/175 2023-10-18T11:07:06.228 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 106/175 2023-10-18T11:07:06.228 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 107/175 2023-10-18T11:07:06.229 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 108/175 2023-10-18T11:07:06.229 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 109/175 2023-10-18T11:07:06.229 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : jq-1.6-15.el9.x86_64 110/175 2023-10-18T11:07:06.229 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 111/175 2023-10-18T11:07:06.229 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 112/175 2023-10-18T11:07:06.229 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 113/175 2023-10-18T11:07:06.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 114/175 2023-10-18T11:07:06.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 115/175 2023-10-18T11:07:06.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 116/175 2023-10-18T11:07:06.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 117/175 2023-10-18T11:07:06.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 118/175 2023-10-18T11:07:06.230 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 119/175 2023-10-18T11:07:06.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 120/175 2023-10-18T11:07:06.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 121/175 2023-10-18T11:07:06.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 122/175 2023-10-18T11:07:06.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 123/175 2023-10-18T11:07:06.231 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 124/175 2023-10-18T11:07:06.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 125/175 2023-10-18T11:07:06.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 126/175 2023-10-18T11:07:06.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 127/175 2023-10-18T11:07:06.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 128/175 2023-10-18T11:07:06.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 129/175 2023-10-18T11:07:06.232 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 130/175 2023-10-18T11:07:06.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 131/175 2023-10-18T11:07:06.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 132/175 2023-10-18T11:07:06.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 133/175 2023-10-18T11:07:06.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 134/175 2023-10-18T11:07:06.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 135/175 2023-10-18T11:07:06.233 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 136/175 2023-10-18T11:07:06.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 137/175 2023-10-18T11:07:06.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 138/175 2023-10-18T11:07:06.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 139/175 2023-10-18T11:07:06.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 140/175 2023-10-18T11:07:06.234 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/175 2023-10-18T11:07:06.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 142/175 2023-10-18T11:07:06.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 143/175 2023-10-18T11:07:06.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 144/175 2023-10-18T11:07:06.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 145/175 2023-10-18T11:07:06.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 146/175 2023-10-18T11:07:06.235 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 147/175 2023-10-18T11:07:06.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/175 2023-10-18T11:07:06.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 149/175 2023-10-18T11:07:06.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 150/175 2023-10-18T11:07:06.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 151/175 2023-10-18T11:07:06.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 152/175 2023-10-18T11:07:06.236 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/175 2023-10-18T11:07:06.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-3.el9.x86_64 154/175 2023-10-18T11:07:06.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 155/175 2023-10-18T11:07:06.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:18.0.0-6713.g189714d0.el9.x86_64 156/175 2023-10-18T11:07:06.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 157/175 2023-10-18T11:07:06.237 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:18.0.0-6713.g189714d0.el9.x86_64 158/175 2023-10-18T11:07:06.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 159/175 2023-10-18T11:07:06.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 160/175 2023-10-18T11:07:06.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 161/175 2023-10-18T11:07:06.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 162/175 2023-10-18T11:07:06.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 163/175 2023-10-18T11:07:06.238 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 164/175 2023-10-18T11:07:06.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/175 2023-10-18T11:07:06.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 166/175 2023-10-18T11:07:06.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 167/175 2023-10-18T11:07:06.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 168/175 2023-10-18T11:07:06.239 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 169/175 2023-10-18T11:07:06.240 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : acl-2.3.1-4.el9.x86_64 170/175 2023-10-18T11:07:06.240 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : acl-2.3.1-3.el9.x86_64 171/175 2023-10-18T11:07:06.240 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 172/175 2023-10-18T11:07:06.240 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-18T11:07:06.240 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 174/175 2023-10-18T11:07:08.708 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-18T11:07:08.708 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:07:08.708 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2023-10-18T11:07:08.709 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-18T11:07:08.709 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-18T11:07:08.709 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-18T11:07:08.709 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-18T11:07:08.710 INFO:teuthology.orchestra.run.smithi169.stdout: acl-2.3.1-4.el9.x86_64 2023-10-18T11:07:08.710 INFO:teuthology.orchestra.run.smithi169.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-18T11:07:08.710 INFO:teuthology.orchestra.run.smithi169.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-18T11:07:08.710 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.710 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.711 INFO:teuthology.orchestra.run.smithi169.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-18T11:07:08.711 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2023-10-18T11:07:08.711 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2023-10-18T11:07:08.711 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2023-10-18T11:07:08.711 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-18T11:07:08.712 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.712 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.712 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.712 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.712 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.713 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.713 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.713 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.713 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.713 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.714 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.714 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.714 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.714 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.714 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.715 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.715 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.715 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.715 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.715 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.716 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.716 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.716 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.716 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.716 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.716 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.717 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.717 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.717 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.717 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.717 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.718 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.718 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.718 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:08.718 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-18T11:07:08.719 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2023-10-18T11:07:08.719 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-18T11:07:08.719 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-18T11:07:08.719 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-18T11:07:08.719 INFO:teuthology.orchestra.run.smithi169.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-18T11:07:08.720 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-18T11:07:08.720 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-18T11:07:08.720 INFO:teuthology.orchestra.run.smithi169.stdout: jq-1.6-15.el9.x86_64 2023-10-18T11:07:08.720 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-18T11:07:08.720 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-18T11:07:08.721 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-18T11:07:08.721 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.721 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.721 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.721 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.722 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-18T11:07:08.722 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-18T11:07:08.722 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-18T11:07:08.722 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-18T11:07:08.722 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-18T11:07:08.723 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.723 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.723 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.723 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.723 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.723 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-18T11:07:08.724 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.724 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-18T11:07:08.724 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-18T11:07:08.724 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-18T11:07:08.724 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-18T11:07:08.725 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-18T11:07:08.725 INFO:teuthology.orchestra.run.smithi169.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-18T11:07:08.725 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-18T11:07:08.725 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-18T11:07:08.725 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-18T11:07:08.726 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-18T11:07:08.726 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-13.11-1.el9.x86_64 2023-10-18T11:07:08.726 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-18T11:07:08.726 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-18T11:07:08.726 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-18T11:07:08.727 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-18T11:07:08.727 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-18T11:07:08.727 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-18T11:07:08.727 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-18T11:07:08.727 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.727 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.728 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.728 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.728 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-18T11:07:08.728 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-18T11:07:08.728 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-18T11:07:08.729 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-18T11:07:08.729 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-18T11:07:08.729 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-18T11:07:08.729 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-18T11:07:08.729 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-18T11:07:08.730 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-18T11:07:08.730 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-18T11:07:08.730 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-18T11:07:08.730 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-18T11:07:08.730 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-18T11:07:08.731 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-18T11:07:08.731 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-18T11:07:08.731 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-18T11:07:08.731 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-18T11:07:08.731 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-18T11:07:08.732 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-18T11:07:08.732 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-18T11:07:08.732 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-18T11:07:08.732 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-18T11:07:08.732 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-18T11:07:08.732 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-18T11:07:08.733 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-18T11:07:08.733 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-18T11:07:08.733 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-18T11:07:08.733 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2023-10-18T11:07:08.733 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-18T11:07:08.734 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-18T11:07:08.734 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-18T11:07:08.734 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-18T11:07:08.734 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-18T11:07:08.734 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-18T11:07:08.735 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-18T11:07:08.735 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.735 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.735 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.735 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.736 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-18T11:07:08.736 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-18T11:07:08.736 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-18T11:07:08.736 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.736 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.736 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-18T11:07:08.737 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-18T11:07:08.737 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-18T11:07:08.737 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-18T11:07:08.737 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-18T11:07:08.737 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-18T11:07:08.738 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-18T11:07:08.738 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-18T11:07:08.738 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-18T11:07:08.738 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-18T11:07:08.738 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-18T11:07:08.739 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.739 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.739 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.739 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.739 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.740 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:08.740 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-3.el9.x86_64 2023-10-18T11:07:08.740 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-18T11:07:08.740 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-18T11:07:08.740 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-18T11:07:08.741 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-18T11:07:08.741 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-18T11:07:08.741 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-18T11:07:08.741 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:07:08.742 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2023-10-18T11:07:09.296 DEBUG:teuthology.parallel:result is None 2023-10-18T11:07:22.964 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6713.g189714d0.e 148/175 2023-10-18T11:07:23.550 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6713.g189714d0.el9. 149/175 2023-10-18T11:07:23.598 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6713.g189714d0.el9 150/175 2023-10-18T11:07:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6713.g189714d0 151/175 2023-10-18T11:07:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados2-debuginfo-2:18.0.0-6713.g189714d0.el9. 152/175 2023-10-18T11:07:35.341 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librbd1-debuginfo-2:18.0.0-6713.g189714d0.el9.x8 153/175 2023-10-18T11:07:35.450 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6713.g189714d0 154/175 2023-10-18T11:07:35.601 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6713.g189714d0. 155/175 2023-10-18T11:07:35.688 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6713.g189714d0.el 156/175 2023-10-18T11:07:35.770 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6713.g189714d0.el 157/175 2023-10-18T11:07:41.918 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9.x 158/175 2023-10-18T11:07:42.472 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6713.g189714d0.el9 159/175 2023-10-18T11:07:42.538 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6713.g189714d0.el9.x8 160/175 2023-10-18T11:07:43.850 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/175 2023-10-18T11:07:43.977 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 162/175 2023-10-18T11:07:44.033 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 163/175 2023-10-18T11:07:44.207 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/175 2023-10-18T11:07:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/175 2023-10-18T11:07:44.317 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 166/175 2023-10-18T11:07:44.317 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-18T11:07:44.455 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 167/175 2023-10-18T11:07:44.493 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 168/175 2023-10-18T11:07:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 169/175 2023-10-18T11:07:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 170/175 2023-10-18T11:07:44.637 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-18T11:07:44.637 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-18T11:07:44.967 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 171/175 2023-10-18T11:07:44.968 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-18T11:07:45.148 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 172/175 2023-10-18T11:07:45.179 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-18T11:07:45.180 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-18T11:07:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 174/175 2023-10-18T11:07:45.452 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-18T11:07:45.725 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-18T11:07:45.726 INFO:teuthology.orchestra.run.smithi151.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-18T11:07:45.726 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:07:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:18.0.0-6713.g189714d0.el9.x86_64 1/175 2023-10-18T11:07:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:18.0.0-6713.g189714d0.el9.x86_64 2/175 2023-10-18T11:07:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6713.g189714d0.el9. 3/175 2023-10-18T11:07:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 4/175 2023-10-18T11:07:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6713.g189714d0.el 5/175 2023-10-18T11:07:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_6 6/175 2023-10-18T11:07:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 7/175 2023-10-18T11:07:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9. 8/175 2023-10-18T11:07:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6713.g18971 9/175 2023-10-18T11:07:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6 10/175 2023-10-18T11:07:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:18.0.0-6713.g189714d0.el9.x86_64 11/175 2023-10-18T11:07:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6713.g189714d0.el9.x 12/175 2023-10-18T11:07:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:18.0.0-6713.g189714d0.el9.x86_64 13/175 2023-10-18T11:07:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6713.g189714d0.el9.x 14/175 2023-10-18T11:07:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:18.0.0-6713.g189714d0.el9.x86_64 15/175 2023-10-18T11:07:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6713.g189714d0.el9.x 16/175 2023-10-18T11:07:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:18.0.0-6713.g189714d0.el9.x86_64 17/175 2023-10-18T11:07:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6713.g189714d0.el9.x 18/175 2023-10-18T11:07:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:18.0.0-6713.g189714d0.el9.x86_64 19/175 2023-10-18T11:07:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6713.g189714d0.e 20/175 2023-10-18T11:07:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:18.0.0-6713.g189714d0.el9.x86_64 21/175 2023-10-18T11:07:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:18.0.0-6713.g189714d0.el9.x86_64 22/175 2023-10-18T11:07:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6713.g189714d0.el9. 23/175 2023-10-18T11:07:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 24/175 2023-10-18T11:07:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:18.0.0-6713.g189714d0.el9.x86_ 25/175 2023-10-18T11:07:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:18.0.0-6713.g189714d0.el9.x86_64 26/175 2023-10-18T11:07:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6713.g189714d0.el9 27/175 2023-10-18T11:07:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:18.0.0-6713.g189714d0.el9.x86_64 28/175 2023-10-18T11:07:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:18.0.0-6713.g189714d0.el9.x86_6 29/175 2023-10-18T11:07:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6713.g189714d0 30/175 2023-10-18T11:07:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-debuginfo-2:18.0.0-6713.g189714d0.el9. 31/175 2023-10-18T11:07:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:18.0.0-6713.g189714d0.el9.x86 32/175 2023-10-18T11:07:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6713.g189714d0.el9.x8 33/175 2023-10-18T11:07:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:18.0.0-6713.g189714d0.el9.x86_64 34/175 2023-10-18T11:07:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6713.g189714d0.el 35/175 2023-10-18T11:07:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:18.0.0-6713.g189714d0.el9. 36/175 2023-10-18T11:07:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:18.0.0-6713.g189714d0.el9.x86_6 37/175 2023-10-18T11:07:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6713.g189714d0 38/175 2023-10-18T11:07:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:18.0.0-6713.g189714d0.el9.x86_64 39/175 2023-10-18T11:07:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6713.g189714d0. 40/175 2023-10-18T11:07:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:18.0.0-6713.g189714d0.el9.x86_64 41/175 2023-10-18T11:07:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6713.g189714d0.el 42/175 2023-10-18T11:07:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:18.0.0-6713.g189714d0.el9.x86_64 43/175 2023-10-18T11:07:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6713.g189714d0.el 44/175 2023-10-18T11:07:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 45/175 2023-10-18T11:07:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9.x 46/175 2023-10-18T11:07:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 47/175 2023-10-18T11:07:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6713.g189714d0.el9 48/175 2023-10-18T11:07:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:18.0.0-6713.g189714d0.el9.x86_64 49/175 2023-10-18T11:07:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6713.g189714d0.el9.x8 50/175 2023-10-18T11:07:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6713.g189714d0. 51/175 2023-10-18T11:07:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6713.g189714d0.el9.noa 52/175 2023-10-18T11:07:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6713.g189714d0.el9.n 53/175 2023-10-18T11:07:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6713.g189 54/175 2023-10-18T11:07:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6713.g189714d0.el 55/175 2023-10-18T11:07:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6713.g189714d0.el9.noarch 56/175 2023-10-18T11:07:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6713.g189714d0.e 57/175 2023-10-18T11:07:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:18.0.0-6713.g189714d0.el9.noarch 58/175 2023-10-18T11:07:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:18.0.0-6713.g189714d0.el9.noarch 59/175 2023-10-18T11:07:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:18.0.0-6713.g189714d0.el9.noarch 60/175 2023-10-18T11:07:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 61/175 2023-10-18T11:07:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 62/175 2023-10-18T11:07:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 63/175 2023-10-18T11:07:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 64/175 2023-10-18T11:07:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 65/175 2023-10-18T11:07:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 66/175 2023-10-18T11:07:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 67/175 2023-10-18T11:07:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 68/175 2023-10-18T11:07:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 69/175 2023-10-18T11:07:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 70/175 2023-10-18T11:07:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 71/175 2023-10-18T11:07:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 72/175 2023-10-18T11:07:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 73/175 2023-10-18T11:07:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 74/175 2023-10-18T11:07:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 75/175 2023-10-18T11:07:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.11-1.el9.x86_64 76/175 2023-10-18T11:07:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 77/175 2023-10-18T11:07:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 78/175 2023-10-18T11:07:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 79/175 2023-10-18T11:07:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 80/175 2023-10-18T11:07:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 81/175 2023-10-18T11:07:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 82/175 2023-10-18T11:07:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 83/175 2023-10-18T11:07:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 84/175 2023-10-18T11:07:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 85/175 2023-10-18T11:07:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 86/175 2023-10-18T11:07:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 87/175 2023-10-18T11:07:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/175 2023-10-18T11:07:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 89/175 2023-10-18T11:07:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 90/175 2023-10-18T11:07:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 91/175 2023-10-18T11:07:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 92/175 2023-10-18T11:07:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/175 2023-10-18T11:07:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/175 2023-10-18T11:07:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/175 2023-10-18T11:07:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 96/175 2023-10-18T11:07:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 97/175 2023-10-18T11:07:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 98/175 2023-10-18T11:07:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 99/175 2023-10-18T11:07:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 100/175 2023-10-18T11:07:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 101/175 2023-10-18T11:07:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 102/175 2023-10-18T11:07:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 103/175 2023-10-18T11:07:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 104/175 2023-10-18T11:07:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 105/175 2023-10-18T11:07:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 106/175 2023-10-18T11:07:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 107/175 2023-10-18T11:07:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 108/175 2023-10-18T11:07:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 109/175 2023-10-18T11:07:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-15.el9.x86_64 110/175 2023-10-18T11:07:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 111/175 2023-10-18T11:07:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 112/175 2023-10-18T11:07:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 113/175 2023-10-18T11:07:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 114/175 2023-10-18T11:07:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 115/175 2023-10-18T11:07:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 116/175 2023-10-18T11:07:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 117/175 2023-10-18T11:07:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 118/175 2023-10-18T11:07:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 119/175 2023-10-18T11:07:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 120/175 2023-10-18T11:07:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 121/175 2023-10-18T11:07:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 122/175 2023-10-18T11:07:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 123/175 2023-10-18T11:07:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 124/175 2023-10-18T11:07:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 125/175 2023-10-18T11:07:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 126/175 2023-10-18T11:07:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 127/175 2023-10-18T11:07:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 128/175 2023-10-18T11:07:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 129/175 2023-10-18T11:07:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 130/175 2023-10-18T11:07:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 131/175 2023-10-18T11:07:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 132/175 2023-10-18T11:07:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 133/175 2023-10-18T11:07:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 134/175 2023-10-18T11:07:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 135/175 2023-10-18T11:07:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 136/175 2023-10-18T11:07:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 137/175 2023-10-18T11:07:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 138/175 2023-10-18T11:07:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 139/175 2023-10-18T11:07:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 140/175 2023-10-18T11:07:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/175 2023-10-18T11:07:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 142/175 2023-10-18T11:07:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 143/175 2023-10-18T11:07:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 144/175 2023-10-18T11:07:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 145/175 2023-10-18T11:07:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 146/175 2023-10-18T11:07:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 147/175 2023-10-18T11:07:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/175 2023-10-18T11:07:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 149/175 2023-10-18T11:07:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 150/175 2023-10-18T11:07:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 151/175 2023-10-18T11:07:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 152/175 2023-10-18T11:07:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/175 2023-10-18T11:07:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 154/175 2023-10-18T11:07:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 155/175 2023-10-18T11:07:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:18.0.0-6713.g189714d0.el9.x86_64 156/175 2023-10-18T11:07:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 157/175 2023-10-18T11:07:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:18.0.0-6713.g189714d0.el9.x86_64 158/175 2023-10-18T11:07:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 159/175 2023-10-18T11:07:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 160/175 2023-10-18T11:07:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 161/175 2023-10-18T11:07:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 162/175 2023-10-18T11:07:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 163/175 2023-10-18T11:07:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 164/175 2023-10-18T11:07:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/175 2023-10-18T11:07:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 166/175 2023-10-18T11:07:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 167/175 2023-10-18T11:07:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 168/175 2023-10-18T11:07:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 169/175 2023-10-18T11:07:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-4.el9.x86_64 170/175 2023-10-18T11:07:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-3.el9.x86_64 171/175 2023-10-18T11:07:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 172/175 2023-10-18T11:07:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 173/175 2023-10-18T11:07:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 174/175 2023-10-18T11:07:57.514 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 175/175 2023-10-18T11:07:57.515 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:07:57.515 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-10-18T11:07:57.516 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-18T11:07:57.516 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-18T11:07:57.516 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-18T11:07:57.516 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-18T11:07:57.516 INFO:teuthology.orchestra.run.smithi151.stdout: acl-2.3.1-4.el9.x86_64 2023-10-18T11:07:57.517 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-18T11:07:57.517 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-18T11:07:57.517 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.517 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.518 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-18T11:07:57.518 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-18T11:07:57.518 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2023-10-18T11:07:57.518 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2023-10-18T11:07:57.518 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-18T11:07:57.519 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.519 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.519 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.519 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.519 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.520 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.520 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.520 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.520 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.521 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.521 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.521 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.521 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.521 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.522 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.522 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.522 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.522 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.522 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.523 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.523 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.523 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.523 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.523 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.524 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.524 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.524 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.524 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.524 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.525 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.525 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.525 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.525 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.526 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:18.0.0-6713.g189714d0.el9.noarch 2023-10-18T11:07:57.526 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-18T11:07:57.526 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2023-10-18T11:07:57.526 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-18T11:07:57.526 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-18T11:07:57.527 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-18T11:07:57.527 INFO:teuthology.orchestra.run.smithi151.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-18T11:07:57.527 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-18T11:07:57.527 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-18T11:07:57.527 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-15.el9.x86_64 2023-10-18T11:07:57.528 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-18T11:07:57.528 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-18T11:07:57.528 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-18T11:07:57.528 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.528 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.529 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.529 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.529 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-18T11:07:57.529 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-18T11:07:57.529 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-18T11:07:57.530 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-18T11:07:57.530 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-18T11:07:57.530 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.530 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.530 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.531 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.531 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.531 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-18T11:07:57.531 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.531 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-18T11:07:57.532 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-18T11:07:57.532 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-18T11:07:57.532 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-18T11:07:57.532 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-18T11:07:57.532 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-18T11:07:57.532 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-18T11:07:57.533 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-18T11:07:57.533 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-18T11:07:57.533 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-18T11:07:57.533 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.11-1.el9.x86_64 2023-10-18T11:07:57.533 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-18T11:07:57.534 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-18T11:07:57.534 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-18T11:07:57.534 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-18T11:07:57.534 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-18T11:07:57.534 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-18T11:07:57.535 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-18T11:07:57.535 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.535 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.535 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.535 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.535 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-18T11:07:57.536 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-18T11:07:57.536 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-18T11:07:57.536 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-18T11:07:57.536 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-18T11:07:57.537 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-18T11:07:57.537 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-18T11:07:57.537 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-18T11:07:57.537 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-18T11:07:57.537 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-18T11:07:57.537 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-18T11:07:57.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-18T11:07:57.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-18T11:07:57.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-18T11:07:57.538 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-18T11:07:57.539 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-18T11:07:57.539 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-18T11:07:57.539 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-18T11:07:57.539 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-18T11:07:57.540 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-18T11:07:57.540 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-18T11:07:57.540 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-18T11:07:57.540 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-18T11:07:57.540 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-18T11:07:57.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-18T11:07:57.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-18T11:07:57.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-18T11:07:57.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2023-10-18T11:07:57.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-18T11:07:57.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-18T11:07:57.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-18T11:07:57.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-18T11:07:57.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-18T11:07:57.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-18T11:07:57.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-18T11:07:57.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-18T11:07:57.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-18T11:07:57.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-18T11:07:57.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-18T11:07:57.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-18T11:07:57.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-18T11:07:57.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-18T11:07:57.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-18T11:07:57.546 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-18T11:07:57.546 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-18T11:07:57.546 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-18T11:07:57.546 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-18T11:07:57.547 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-18T11:07:57.547 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-18T11:07:57.547 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.547 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.547 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.547 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.548 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.548 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-debuginfo-2:18.0.0-6713.g189714d0.el9.x86_64 2023-10-18T11:07:57.548 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2023-10-18T11:07:57.548 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-18T11:07:57.548 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-18T11:07:57.549 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-18T11:07:57.549 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-18T11:07:57.549 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-18T11:07:57.549 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-18T11:07:57.550 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:07:57.550 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-18T11:07:58.868 DEBUG:teuthology.parallel:result is None 2023-10-18T11:07:58.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=189714d033726ae2ce7d2d105c75781f0aec48f4 2023-10-18T11:07:59.093 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T11:07:59.167 INFO:teuthology.orchestra.run.smithi151.stdout:18.0.0-6713.g189714d0.el9 2023-10-18T11:07:59.168 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6713.g189714d0.el9 2023-10-18T11:07:59.168 INFO:teuthology.task.install:The correct ceph version 18.0.0-6713.g189714d0 is installed. 2023-10-18T11:07:59.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=189714d033726ae2ce7d2d105c75781f0aec48f4 2023-10-18T11:07:59.381 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T11:07:59.406 INFO:teuthology.orchestra.run.smithi169.stdout:18.0.0-6713.g189714d0.el9 2023-10-18T11:07:59.407 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6713.g189714d0.el9 2023-10-18T11:07:59.407 INFO:teuthology.task.install:The correct ceph version 18.0.0-6713.g189714d0 is installed. 2023-10-18T11:07:59.408 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-18T11:07:59.408 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:07:59.409 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T11:07:59.516 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:07:59.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T11:07:59.585 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-18T11:07:59.585 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:07:59.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T11:07:59.690 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T11:07:59.828 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:07:59.828 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T11:07:59.861 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T11:07:59.930 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-18T11:07:59.930 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:07:59.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T11:08:00.034 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T11:08:00.177 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:00.177 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T11:08:00.204 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T11:08:00.272 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-18T11:08:00.273 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:00.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T11:08:00.376 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T11:08:00.474 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:00.474 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T11:08:00.502 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T11:08:00.569 INFO:teuthology.run_tasks:Running task ceph... 2023-10-18T11:08:00.836 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-18T11:08:00.837 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-10-18T11:08:00.846 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2023-10-18T11:08:00.939 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-18T11:08:00.939 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-18T11:08:00.948 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-18T11:08:01.036 INFO:tasks.ceph:Creating extra log directories... 2023-10-18T11:08:01.037 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-18T11:08:01.045 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-18T11:08:01.137 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-18T11:08:01.137 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-18T11:08:01.157 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-18T11:08:01.158 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:01.158 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-18T11:08:01.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-18T11:08:01.505 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-18T11:08:01.601 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:01.602 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-18T11:08:01.617 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-18T11:08:01.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-18T11:08:01.769 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-18T11:08:01.769 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-18T11:08:01.770 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303', 'branch': 'wip-vshankar-testing-20231013.093215-1', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7431303', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231013.093215-1'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231013.093215-1', 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 20, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8887, 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231013.093215-1', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+obz1e7R6QP2qenWQIXMio16vXMm5EOLaNoRO+C5Io5yhLFk7H9GvwojfSrvi39nhPHCRenawVKB1AUDLwSpM=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz6kA2y2qL6G3bCydVes/q74K36e4w2Bk4w0f/Uay1pakoMGKFE88xVrNBU9Gb8S9MvTekLxvqdQcs11txniWM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '189714d033726ae2ce7d2d105c75781f0aec48f4', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '202b180cb047e798fb131047314a862593f45403', 'timestamp': '2023-10-18_10:33:40', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-18T11:08:01.771 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-18T11:08:01.780 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-18T11:08:01.831 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-10-18T11:08:01.836 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2023-10-18T11:08:01.927 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:01.927 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T11:08:01.985 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T11:08:01.985 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-10-18T11:08:02.036 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T11:08:02.037 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T11:08:02.037 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-10-18T11:08:02.037 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T11:08:02.037 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T11:08:02.038 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-18 11:07:46.164821948 +0000 2023-10-18T11:08:02.038 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-18 10:56:27.227657710 +0000 2023-10-18T11:08:02.038 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-18 10:56:27.227657710 +0000 2023-10-18T11:08:02.038 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-18 10:56:27.227657710 +0000 2023-10-18T11:08:02.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T11:08:02.126 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-18T11:08:02.127 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-18T11:08:02.127 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000362755 s, 1.4 MB/s 2023-10-18T11:08:02.130 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T11:08:02.184 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-10-18T11:08:02.235 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T11:08:02.235 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T11:08:02.236 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-10-18T11:08:02.236 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T11:08:02.236 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T11:08:02.236 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-18 11:07:46.165821935 +0000 2023-10-18T11:08:02.236 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-18 10:56:28.262645279 +0000 2023-10-18T11:08:02.237 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-18 10:56:28.262645279 +0000 2023-10-18T11:08:02.237 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-18 10:56:28.262645279 +0000 2023-10-18T11:08:02.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T11:08:02.325 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-18T11:08:02.326 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-18T11:08:02.326 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000312671 s, 1.6 MB/s 2023-10-18T11:08:02.329 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T11:08:02.388 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-10-18T11:08:02.440 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T11:08:02.440 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T11:08:02.440 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-10-18T11:08:02.440 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T11:08:02.441 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T11:08:02.441 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-18 11:07:46.166821923 +0000 2023-10-18T11:08:02.441 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-18 10:56:29.263633257 +0000 2023-10-18T11:08:02.441 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-18 10:56:29.264633245 +0000 2023-10-18T11:08:02.441 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-18 10:56:29.263633257 +0000 2023-10-18T11:08:02.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T11:08:02.534 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-18T11:08:02.535 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-18T11:08:02.535 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000328562 s, 1.6 MB/s 2023-10-18T11:08:02.538 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T11:08:02.596 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-10-18T11:08:02.645 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T11:08:02.646 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T11:08:02.646 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 691 Links: 1 2023-10-18T11:08:02.646 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T11:08:02.647 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T11:08:02.647 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-18 11:07:46.167821910 +0000 2023-10-18T11:08:02.647 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-18 10:56:30.296620850 +0000 2023-10-18T11:08:02.647 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-18 10:56:30.296620850 +0000 2023-10-18T11:08:02.647 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-18 10:56:30.296620850 +0000 2023-10-18T11:08:02.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T11:08:02.736 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-18T11:08:02.736 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-18T11:08:02.736 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000325502 s, 1.6 MB/s 2023-10-18T11:08:02.739 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T11:08:02.797 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:02.798 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:02.798 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T11:08:02.815 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T11:08:02.816 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2023-10-18T11:08:02.872 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T11:08:02.872 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T11:08:02.873 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 660 Links: 1 2023-10-18T11:08:02.873 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T11:08:02.873 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T11:08:02.873 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-10-18 11:06:57.512347038 +0000 2023-10-18T11:08:02.874 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-10-18 10:59:08.501318996 +0000 2023-10-18T11:08:02.874 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-10-18 10:59:08.501318996 +0000 2023-10-18T11:08:02.874 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2023-10-18 10:59:08.501318996 +0000 2023-10-18T11:08:02.874 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T11:08:02.940 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-10-18T11:08:02.940 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-10-18T11:08:02.940 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000213154 s, 2.4 MB/s 2023-10-18T11:08:02.941 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T11:08:02.998 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2023-10-18T11:08:03.053 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T11:08:03.054 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T11:08:03.054 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 680 Links: 1 2023-10-18T11:08:03.054 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T11:08:03.054 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T11:08:03.055 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-10-18 11:06:57.513347016 +0000 2023-10-18T11:08:03.055 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-10-18 10:59:09.013307713 +0000 2023-10-18T11:08:03.055 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-10-18 10:59:09.013307713 +0000 2023-10-18T11:08:03.055 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2023-10-18 10:59:09.013307713 +0000 2023-10-18T11:08:03.056 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T11:08:03.121 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-10-18T11:08:03.121 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-10-18T11:08:03.121 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000224885 s, 2.3 MB/s 2023-10-18T11:08:03.122 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T11:08:03.179 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2023-10-18T11:08:03.234 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T11:08:03.234 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T11:08:03.234 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 699 Links: 1 2023-10-18T11:08:03.234 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T11:08:03.235 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T11:08:03.235 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-10-18 11:06:57.513347016 +0000 2023-10-18T11:08:03.235 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-10-18 10:59:09.497297047 +0000 2023-10-18T11:08:03.235 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-10-18 10:59:09.497297047 +0000 2023-10-18T11:08:03.235 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2023-10-18 10:59:09.497297047 +0000 2023-10-18T11:08:03.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T11:08:03.299 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-10-18T11:08:03.300 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-10-18T11:08:03.300 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000212455 s, 2.4 MB/s 2023-10-18T11:08:03.301 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T11:08:03.356 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2023-10-18T11:08:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T11:08:03.411 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T11:08:03.411 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-10-18T11:08:03.411 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T11:08:03.412 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T11:08:03.412 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-10-18 11:06:57.514346995 +0000 2023-10-18T11:08:03.412 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-10-18 10:59:09.983286337 +0000 2023-10-18T11:08:03.412 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-10-18 10:59:09.983286337 +0000 2023-10-18T11:08:03.412 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2023-10-18 10:59:09.983286337 +0000 2023-10-18T11:08:03.413 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T11:08:03.476 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-10-18T11:08:03.476 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-10-18T11:08:03.476 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000203368 s, 2.5 MB/s 2023-10-18T11:08:03.477 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T11:08:03.533 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:03.533 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-18T11:08:03.534 INFO:tasks.ceph:Generating config... 2023-10-18T11:08:03.537 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-18T11:08:03.537 INFO:tasks.ceph:[client] debug client = 20 2023-10-18T11:08:03.537 INFO:tasks.ceph:[client] debug ms = 1 2023-10-18T11:08:03.538 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-18T11:08:03.538 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-18T11:08:03.538 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-10-18T11:08:03.538 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-10-18T11:08:03.539 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-18T11:08:03.539 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-10-18T11:08:03.539 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-18T11:08:03.539 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-18T11:08:03.540 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-18T11:08:03.540 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-18T11:08:03.540 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-18T11:08:03.540 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-18T11:08:03.541 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-10-18T11:08:03.541 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-18T11:08:03.541 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-18T11:08:03.541 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-18T11:08:03.542 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-18T11:08:03.542 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-18T11:08:03.542 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-18T11:08:03.543 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-18T11:08:03.543 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-18T11:08:03.543 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-18T11:08:03.543 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-18T11:08:03.544 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-10-18T11:08:03.544 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-18T11:08:03.544 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-10-18T11:08:03.544 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-18T11:08:03.544 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-18T11:08:03.545 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-18T11:08:03.545 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-18T11:08:03.545 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-18T11:08:03.546 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-18T11:08:03.546 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-18T11:08:03.546 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-18T11:08:03.546 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-18T11:08:03.547 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-18T11:08:03.547 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-10-18T11:08:03.547 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-18T11:08:03.547 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-18T11:08:03.548 INFO:tasks.ceph:Setting up mon.a... 2023-10-18T11:08:03.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-18T11:08:03.701 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.keyring 2023-10-18T11:08:03.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-18T11:08:03.846 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T11:08:03.941 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.151'), ('mon.b', '172.21.15.169'), ('mon.c', '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]')] 2023-10-18T11:08:03.941 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.151,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-18T11:08:03.942 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:03.943 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-18T11:08:03.997 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.151 --add b 172.21.15.169 --addv c '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:04.153 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:04.154 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool: generated fsid 31f501b1-61b9-452b-813c-bb68ad49056d 2023-10-18T11:08:04.154 INFO:teuthology.orchestra.run.smithi151.stdout:setting min_mon_release = pacific 2023-10-18T11:08:04.154 INFO:teuthology.orchestra.run.smithi151.stdout:epoch 0 2023-10-18T11:08:04.154 INFO:teuthology.orchestra.run.smithi151.stdout:fsid 31f501b1-61b9-452b-813c-bb68ad49056d 2023-10-18T11:08:04.154 INFO:teuthology.orchestra.run.smithi151.stdout:last_changed 2023-10-18T11:08:04.152516+0000 2023-10-18T11:08:04.155 INFO:teuthology.orchestra.run.smithi151.stdout:created 2023-10-18T11:08:04.152516+0000 2023-10-18T11:08:04.155 INFO:teuthology.orchestra.run.smithi151.stdout:min_mon_release 16 (pacific) 2023-10-18T11:08:04.155 INFO:teuthology.orchestra.run.smithi151.stdout:election_strategy: 1 2023-10-18T11:08:04.155 INFO:teuthology.orchestra.run.smithi151.stdout:0: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.a 2023-10-18T11:08:04.155 INFO:teuthology.orchestra.run.smithi151.stdout:1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2023-10-18T11:08:04.156 INFO:teuthology.orchestra.run.smithi151.stdout:2: [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] mon.c 2023-10-18T11:08:04.156 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-18T11:08:04.157 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-18T11:08:04.208 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 31f501b1-61b9-452b-813c-bb68ad49056d... 2023-10-18T11:08:04.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-18T11:08:04.214 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-18T11:08:04.266 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2023-10-18T11:08:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2023-10-18T11:08:04.266 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-18T11:08:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2023-10-18T11:08:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2023-10-18T11:08:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2023-10-18T11:08:04.267 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2023-10-18T11:08:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2023-10-18T11:08:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2023-10-18T11:08:04.268 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2023-10-18T11:08:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-18T11:08:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2023-10-18T11:08:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.269 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2023-10-18T11:08:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-18T11:08:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2023-10-18T11:08:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2023-10-18T11:08:04.270 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2023-10-18T11:08:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2023-10-18T11:08:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2023-10-18T11:08:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2023-10-18T11:08:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2023-10-18T11:08:04.271 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2023-10-18T11:08:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-18T11:08:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-18T11:08:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2023-10-18T11:08:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.272 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-18T11:08:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2023-10-18T11:08:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2023-10-18T11:08:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.273 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2023-10-18T11:08:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2023-10-18T11:08:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2023-10-18T11:08:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.151,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2023-10-18T11:08:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: mds beacon grace = 60 2023-10-18T11:08:04.274 INFO:teuthology.orchestra.run.smithi169.stdout: mds heartbeat grace = 60 2023-10-18T11:08:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on skipped message = False 2023-10-18T11:08:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: osd heartbeat grace = 60 2023-10-18T11:08:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 31f501b1-61b9-452b-813c-bb68ad49056d 2023-10-18T11:08:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.275 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2023-10-18T11:08:04.275 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2023-10-18T11:08:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2023-10-18T11:08:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2023-10-18T11:08:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2023-10-18T11:08:04.276 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2023-10-18T11:08:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2023-10-18T11:08:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2023-10-18T11:08:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2023-10-18T11:08:04.277 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2023-10-18T11:08:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2023-10-18T11:08:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2023-10-18T11:08:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.278 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2023-10-18T11:08:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2023-10-18T11:08:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2023-10-18T11:08:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.279 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2023-10-18T11:08:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2023-10-18T11:08:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2023-10-18T11:08:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2023-10-18T11:08:04.280 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2023-10-18T11:08:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore compression mode = aggressive 2023-10-18T11:08:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2023-10-18T11:08:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2023-10-18T11:08:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2023-10-18T11:08:04.281 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-10-18T11:08:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2023-10-18T11:08:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2023-10-18T11:08:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2023-10-18T11:08:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2023-10-18T11:08:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2023-10-18T11:08:04.282 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2023-10-18T11:08:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: osd fast shutdown = False 2023-10-18T11:08:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2023-10-18T11:08:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2023-10-18T11:08:04.283 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.283 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2023-10-18T11:08:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-10-18T11:08:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2023-10-18T11:08:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2023-10-18T11:08:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2023-10-18T11:08:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2023-10-18T11:08:04.284 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2023-10-18T11:08:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2023-10-18T11:08:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.285 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2023-10-18T11:08:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-10-18T11:08:04.285 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2023-10-18T11:08:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2023-10-18T11:08:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2023-10-18T11:08:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2023-10-18T11:08:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2023-10-18T11:08:04.286 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2023-10-18T11:08:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2023-10-18T11:08:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2023-10-18T11:08:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2023-10-18T11:08:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-18T11:08:04.287 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2023-10-18T11:08:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2023-10-18T11:08:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2023-10-18T11:08:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-18T11:08:04.288 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-18T11:08:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2023-10-18T11:08:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2023-10-18T11:08:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2023-10-18T11:08:04.289 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2023-10-18T11:08:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd crush smoke test = False 2023-10-18T11:08:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-10-18T11:08:04.290 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2023-10-18T11:08:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2023-10-18T11:08:04.290 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2023-10-18T11:08:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2023-10-18T11:08:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-18T11:08:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-18T11:08:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2023-10-18T11:08:04.291 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2023-10-18T11:08:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-10-18T11:08:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2023-10-18T11:08:04.292 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2023-10-18T11:08:04.292 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2023-10-18T11:08:04.292 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2023-10-18T11:08:04.292 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2023-10-18T11:08:04.293 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2023-10-18T11:08:04.293 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2023-10-18T11:08:04.293 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.e] 2023-10-18T11:08:04.293 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2023-10-18T11:08:04.293 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2023-10-18T11:08:04.294 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.f] 2023-10-18T11:08:04.294 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2023-10-18T11:08:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2023-10-18T11:08:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2023-10-18T11:08:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-10-18T11:08:04.294 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2023-10-18T11:08:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2023-10-18T11:08:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2023-10-18T11:08:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: mds valgrind exit = True 2023-10-18T11:08:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2023-10-18T11:08:04.295 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2023-10-18T11:08:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2023-10-18T11:08:04.296 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2023-10-18T11:08:04.372 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-10-18T11:08:04.372 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-10-18T11:08:04.372 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-18T11:08:04.372 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-10-18T11:08:04.373 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.373 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-10-18T11:08:04.373 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.373 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-10-18T11:08:04.373 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.374 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-10-18T11:08:04.374 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-10-18T11:08:04.374 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.374 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-10-18T11:08:04.374 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-10-18T11:08:04.375 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.375 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-18T11:08:04.375 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-10-18T11:08:04.375 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.375 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-10-18T11:08:04.375 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-18T11:08:04.376 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.376 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-10-18T11:08:04.376 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.376 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-10-18T11:08:04.376 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-10-18T11:08:04.377 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-10-18T11:08:04.377 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-10-18T11:08:04.377 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-10-18T11:08:04.377 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-10-18T11:08:04.377 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-10-18T11:08:04.378 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-18T11:08:04.378 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-18T11:08:04.378 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-10-18T11:08:04.378 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.378 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-18T11:08:04.379 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.379 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-10-18T11:08:04.379 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.379 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-10-18T11:08:04.379 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.379 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-10-18T11:08:04.380 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-10-18T11:08:04.380 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-10-18T11:08:04.380 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.151,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2023-10-18T11:08:04.380 INFO:teuthology.orchestra.run.smithi151.stdout: mds beacon grace = 60 2023-10-18T11:08:04.380 INFO:teuthology.orchestra.run.smithi151.stdout: mds heartbeat grace = 60 2023-10-18T11:08:04.381 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on skipped message = False 2023-10-18T11:08:04.381 INFO:teuthology.orchestra.run.smithi151.stdout: osd heartbeat grace = 60 2023-10-18T11:08:04.381 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 31f501b1-61b9-452b-813c-bb68ad49056d 2023-10-18T11:08:04.381 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.381 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-10-18T11:08:04.381 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-10-18T11:08:04.382 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.382 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-10-18T11:08:04.382 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-10-18T11:08:04.382 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-10-18T11:08:04.382 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.383 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-10-18T11:08:04.383 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-10-18T11:08:04.383 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.383 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-10-18T11:08:04.383 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-10-18T11:08:04.384 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-10-18T11:08:04.384 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.384 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-10-18T11:08:04.384 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-10-18T11:08:04.384 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.384 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-10-18T11:08:04.385 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.385 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-10-18T11:08:04.385 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.385 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-10-18T11:08:04.385 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-10-18T11:08:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-10-18T11:08:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-10-18T11:08:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-10-18T11:08:04.386 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-10-18T11:08:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore compression mode = aggressive 2023-10-18T11:08:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-10-18T11:08:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 20 2023-10-18T11:08:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 20 2023-10-18T11:08:04.387 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-18T11:08:04.388 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-10-18T11:08:04.388 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 10 2023-10-18T11:08:04.388 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-10-18T11:08:04.388 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-10-18T11:08:04.388 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-10-18T11:08:04.389 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-10-18T11:08:04.389 INFO:teuthology.orchestra.run.smithi151.stdout: osd fast shutdown = False 2023-10-18T11:08:04.389 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-10-18T11:08:04.389 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-18T11:08:04.389 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.389 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-10-18T11:08:04.390 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-18T11:08:04.390 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-10-18T11:08:04.390 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-18T11:08:04.390 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-18T11:08:04.390 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-18T11:08:04.391 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-18T11:08:04.391 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-10-18T11:08:04.391 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.391 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-10-18T11:08:04.391 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-18T11:08:04.391 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-18T11:08:04.392 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-10-18T11:08:04.392 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-18T11:08:04.392 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-10-18T11:08:04.392 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-10-18T11:08:04.392 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-18T11:08:04.392 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-10-18T11:08:04.393 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-10-18T11:08:04.393 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-18T11:08:04.393 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.393 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-18T11:08:04.393 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-10-18T11:08:04.393 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-10-18T11:08:04.394 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.394 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-10-18T11:08:04.394 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-18T11:08:04.394 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-18T11:08:04.394 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.395 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-10-18T11:08:04.395 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-10-18T11:08:04.395 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.395 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-10-18T11:08:04.395 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-10-18T11:08:04.395 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd crush smoke test = False 2023-10-18T11:08:04.396 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:08:04.396 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-10-18T11:08:04.396 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-10-18T11:08:04.396 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-10-18T11:08:04.396 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-10-18T11:08:04.397 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-18T11:08:04.397 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-18T11:08:04.397 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-10-18T11:08:04.397 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-10-18T11:08:04.397 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-18T11:08:04.397 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-18T11:08:04.398 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-18T11:08:04.398 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-10-18T11:08:04.398 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-10-18T11:08:04.398 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-10-18T11:08:04.398 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-18T11:08:04.398 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-18T11:08:04.399 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.e] 2023-10-18T11:08:04.399 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-18T11:08:04.399 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-18T11:08:04.399 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.f] 2023-10-18T11:08:04.399 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-10-18T11:08:04.400 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-10-18T11:08:04.400 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2023-10-18T11:08:04.400 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-18T11:08:04.400 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-10-18T11:08:04.400 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2023-10-18T11:08:04.400 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-10-18T11:08:04.401 INFO:teuthology.orchestra.run.smithi151.stdout: mds valgrind exit = True 2023-10-18T11:08:04.401 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2023-10-18T11:08:04.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-18T11:08:04.401 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-18T11:08:04.401 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-18T11:08:04.415 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-18T11:08:04.416 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-18T11:08:04.562 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-18T11:08:04.562 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:04.562 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-18T11:08:04.614 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:04.614 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-18T11:08:04.665 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:08:04.665 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:04.666 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-18T11:08:04.666 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T11:08:04.816 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:04.816 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:04.913 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:08:04.914 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:04.914 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-18T11:08:04.914 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T11:08:04.956 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:04.956 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:05.011 INFO:tasks.ceph:Setting up mon nodes... 2023-10-18T11:08:05.011 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-18T11:08:05.012 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-18T11:08:05.205 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-18T11:08:05.215 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-18T11:08:05.279 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-18T11:08:05.281 INFO:tasks.ceph:Setting up mds nodes... 2023-10-18T11:08:05.282 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-18T11:08:05.465 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-18T11:08:05.475 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-18T11:08:05.574 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-18T11:08:05.753 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-18T11:08:05.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-18T11:08:05.860 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-10-18T11:08:06.042 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-10-18T11:08:06.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-10-18T11:08:06.150 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-18T11:08:06.212 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-18T11:08:06.215 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-18T11:08:06.243 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-18T11:08:06.340 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-18T11:08:06.342 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-18T11:08:06.369 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-10-18T11:08:06.464 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-10-18T11:08:06.467 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-10-18T11:08:06.494 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-18T11:08:06.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-18T11:08:06.630 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-18T11:08:06.679 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-18T11:08:06.679 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-18T11:08:06.680 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-18T11:08:06.777 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:06.777 INFO:tasks.ceph:role: osd.0 2023-10-18T11:08:06.778 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:08:06.778 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-18T11:08:06.878 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T11:08:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T11:08:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T11:08:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-18T11:08:06.879 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T11:08:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-18T11:08:06.880 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T11:08:06.880 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-18T11:08:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T11:08:06.880 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T11:08:07.393 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-18T11:08:07.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-18T11:08:07.402 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-18T11:08:07.603 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-18T11:08:07.711 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-18T11:08:07.799 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:07.799 INFO:tasks.ceph:role: osd.1 2023-10-18T11:08:07.800 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:08:07.800 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-18T11:08:07.885 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T11:08:07.885 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T11:08:07.885 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T11:08:07.886 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-18T11:08:07.886 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T11:08:07.886 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-18T11:08:07.886 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T11:08:07.886 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-18T11:08:07.887 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T11:08:07.887 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T11:08:08.368 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-18T11:08:08.373 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-18T11:08:08.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-18T11:08:08.505 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-18T11:08:08.592 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-18T11:08:08.664 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:08.665 INFO:tasks.ceph:role: osd.2 2023-10-18T11:08:08.665 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:08:08.665 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-18T11:08:08.749 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T11:08:08.749 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T11:08:08.749 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T11:08:08.750 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-18T11:08:08.750 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T11:08:08.750 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-18T11:08:08.750 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T11:08:08.750 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-18T11:08:08.751 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T11:08:08.751 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T11:08:09.247 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-18T11:08:09.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-18T11:08:09.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-18T11:08:09.434 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-18T11:08:09.542 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-18T11:08:09.639 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:09.639 INFO:tasks.ceph:role: osd.3 2023-10-18T11:08:09.640 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:08:09.640 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-18T11:08:09.739 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T11:08:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T11:08:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T11:08:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-18T11:08:09.740 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T11:08:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-18T11:08:09.740 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T11:08:09.741 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-18T11:08:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T11:08:09.741 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T11:08:10.194 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-18T11:08:10.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-18T11:08:10.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-18T11:08:10.351 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-18T11:08:10.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:10.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:10.682+0000 7fe1f1c16500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-18T11:08:10.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:10.685+0000 7fe1f1c16500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-18T11:08:10.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:10.686+0000 7fe1f1c16500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T11:08:10.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:10.686+0000 7fe1f1c16500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T11:08:10.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:10.686+0000 7fe1f1c16500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T11:08:10.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:10.699+0000 7fe1f1c16500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-18T11:08:13.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-18T11:08:13.978 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:14.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:14.116+0000 7f90d8211500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-18T11:08:14.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:14.116+0000 7f90d8211500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-18T11:08:14.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:14.117+0000 7f90d8211500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T11:08:14.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:14.117+0000 7f90d8211500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T11:08:14.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:14.117+0000 7f90d8211500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T11:08:14.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:14.119+0000 7f90d8211500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-18T11:08:17.290 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-18T11:08:17.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:17.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:17.525+0000 7f867d1e2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-18T11:08:17.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:17.526+0000 7f867d1e2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-18T11:08:17.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:17.526+0000 7f867d1e2500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T11:08:17.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:17.526+0000 7f867d1e2500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T11:08:17.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:17.526+0000 7f867d1e2500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T11:08:17.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:17.528+0000 7f867d1e2500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-18T11:08:20.457 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-18T11:08:20.561 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:20.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:20.703+0000 7f773380e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-18T11:08:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:20.704+0000 7f773380e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-18T11:08:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:20.704+0000 7f773380e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T11:08:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:20.704+0000 7f773380e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T11:08:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:20.704+0000 7f773380e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T11:08:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:20.706+0000 7f773380e500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-18T11:08:23.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-18T11:08:23.982 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-18T11:08:24.014 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:24.014 INFO:tasks.ceph:role: osd.4 2023-10-18T11:08:24.014 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:08:24.015 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-18T11:08:24.091 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T11:08:24.091 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T11:08:24.091 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T11:08:24.092 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-18T11:08:24.092 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T11:08:24.092 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2023-10-18T11:08:24.092 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T11:08:24.092 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-18T11:08:24.092 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T11:08:24.093 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T11:08:24.599 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2023-10-18T11:08:24.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2023-10-18T11:08:24.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-18T11:08:24.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-18T11:08:24.770 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-18T11:08:24.839 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:24.839 INFO:tasks.ceph:role: osd.5 2023-10-18T11:08:24.840 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:08:24.840 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-18T11:08:24.914 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T11:08:24.914 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T11:08:24.915 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T11:08:24.915 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-18T11:08:24.915 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T11:08:24.915 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2023-10-18T11:08:24.916 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T11:08:24.916 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-18T11:08:24.916 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T11:08:24.917 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T11:08:25.368 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2023-10-18T11:08:25.370 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2023-10-18T11:08:25.371 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-18T11:08:25.462 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-18T11:08:25.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-18T11:08:25.564 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:25.565 INFO:tasks.ceph:role: osd.6 2023-10-18T11:08:25.565 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:08:25.565 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-18T11:08:25.639 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T11:08:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T11:08:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T11:08:25.640 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-18T11:08:25.640 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T11:08:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2023-10-18T11:08:25.641 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T11:08:25.641 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-18T11:08:25.641 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T11:08:25.641 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T11:08:26.125 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2023-10-18T11:08:26.127 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2023-10-18T11:08:26.128 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-18T11:08:26.282 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-18T11:08:26.318 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-18T11:08:26.387 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T11:08:26.388 INFO:tasks.ceph:role: osd.7 2023-10-18T11:08:26.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:08:26.389 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-18T11:08:26.464 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T11:08:26.464 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T11:08:26.464 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T11:08:26.464 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-18T11:08:26.465 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T11:08:26.465 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2023-10-18T11:08:26.465 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T11:08:26.466 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-18T11:08:26.466 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T11:08:26.466 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T11:08:26.964 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2023-10-18T11:08:26.967 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2023-10-18T11:08:26.967 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-18T11:08:27.102 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-18T11:08:27.138 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:27.236 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:27.233+0000 7f69077e0500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-18T11:08:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:27.234+0000 7f69077e0500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-18T11:08:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:27.234+0000 7f69077e0500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-18T11:08:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:27.234+0000 7f69077e0500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-18T11:08:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:27.234+0000 7f69077e0500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-18T11:08:27.237 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:27.234+0000 7f69077e0500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-18T11:08:30.089 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-18T11:08:30.120 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:30.212 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:30.210+0000 7faaa880e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-18T11:08:30.296 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:30.211+0000 7faaa880e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-18T11:08:30.297 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:30.211+0000 7faaa880e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-18T11:08:30.297 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:30.211+0000 7faaa880e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-18T11:08:30.297 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:30.211+0000 7faaa880e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-18T11:08:30.297 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:30.211+0000 7faaa880e500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-18T11:08:31.772 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:08:31.781 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:08:33.054 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-18T11:08:33.083 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:33.171 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:33.168+0000 7f7272e1a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-18T11:08:33.171 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:33.169+0000 7f7272e1a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-18T11:08:33.172 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:33.169+0000 7f7272e1a500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-18T11:08:33.172 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:33.169+0000 7f7272e1a500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-18T11:08:33.172 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:33.169+0000 7f7272e1a500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-18T11:08:33.172 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:33.169+0000 7f7272e1a500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-18T11:08:36.030 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-18T11:08:36.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:36.152 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:36.149+0000 7fedd6e25500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-18T11:08:36.152 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:36.150+0000 7fedd6e25500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-18T11:08:36.152 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:36.150+0000 7fedd6e25500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-18T11:08:36.152 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:36.150+0000 7fedd6e25500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-18T11:08:36.153 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:36.150+0000 7fedd6e25500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-18T11:08:36.153 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:08:36.150+0000 7fedd6e25500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-18T11:08:38.995 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-18T11:08:39.025 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-18T11:08:39.025 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:39.026 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-18T11:08:39.128 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:39.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-18T11:08:39.225 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:39.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-18T11:08:39.322 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:39.322 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-10-18T11:08:39.422 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:39.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-18T11:08:39.511 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:39.512 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-18T11:08:39.604 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:39.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-18T11:08:39.698 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:39.699 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-18T11:08:39.794 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:39.795 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-18T11:08:39.827 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:39.827 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-18T11:08:39.896 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:39.897 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-18T11:08:39.966 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:39.966 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-10-18T11:08:40.035 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:40.035 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-18T11:08:40.103 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:40.103 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-18T11:08:40.170 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:40.171 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-18T11:08:40.238 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:08:40.239 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-18T11:08:40.306 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:40.306 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-18T11:08:40.367 INFO:tasks.ceph:Adding keys to all mons... 2023-10-18T11:08:40.367 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-18T11:08:40.373 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-18T11:08:40.398 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.y] 2023-10-18T11:08:40.398 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCVvC9lHiMoDBAAC71cl+QfLygSDiKY2fxNjQ== 2023-10-18T11:08:40.398 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2023-10-18T11:08:40.399 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCVvC9lONGwGxAALo0pBaqH7GvwhUDJYPnvpA== 2023-10-18T11:08:40.399 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2023-10-18T11:08:40.399 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCVvC9llT7YLBAAn8eXw1vu8R/oijzPHkxKCg== 2023-10-18T11:08:40.399 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.e] 2023-10-18T11:08:40.399 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCWvC9l4bx0AhAAukG5iX4A2bm5tShWSwucYw== 2023-10-18T11:08:40.400 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2023-10-18T11:08:40.400 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCavC9lNVO7KBAAC+MnpvEcFWjCkhFV/iB1pA== 2023-10-18T11:08:40.400 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2023-10-18T11:08:40.400 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCevC9lnZ4ABxAANpOCiHasJ69z9gIzX0BoPg== 2023-10-18T11:08:40.400 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2023-10-18T11:08:40.401 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQChvC9lMCtkHxAAqIyboQNQj4CP3YlPoZyhbA== 2023-10-18T11:08:40.401 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.3] 2023-10-18T11:08:40.401 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCkvC9lurT+KRAAE+5bUt2VWKQafBeQDo3+iA== 2023-10-18T11:08:40.401 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2023-10-18T11:08:40.401 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCVvC9lOeyUEBAAmkkBxu6s7DIH9Hwk2G3z3Q== 2023-10-18T11:08:40.401 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2023-10-18T11:08:40.402 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCWvC9luWGTDBAACOaUesO+/WhPBuyhkV+r8A== 2023-10-18T11:08:40.402 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2023-10-18T11:08:40.402 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCWvC9l7TM6FBAAkPF40LpqtfCvZ8fX3gv67g== 2023-10-18T11:08:40.402 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.f] 2023-10-18T11:08:40.402 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCWvC9lc+SiGxAAsosGFH+tbyLuqVA9LEExZA== 2023-10-18T11:08:40.403 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.4] 2023-10-18T11:08:40.403 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCrvC9l4Y8BDhAA0EeWpFeI0LaZvQda8skA7A== 2023-10-18T11:08:40.403 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.5] 2023-10-18T11:08:40.403 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCuvC9lW3meDBAAYftp6umMGLk6Rn4Kb3M9Hg== 2023-10-18T11:08:40.403 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.6] 2023-10-18T11:08:40.403 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCxvC9lOuEgChAA7seTJoO0D3PGq6IQbrfh5w== 2023-10-18T11:08:40.404 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.7] 2023-10-18T11:08:40.404 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQC0vC9lQBr+CBAAQYWg1pkrWFiLd3uyuBYJLg== 2023-10-18T11:08:40.404 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2023-10-18T11:08:40.404 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCWvC9laxyIJRAAhxuHyWgNdfwUF2Zc883Eyg== 2023-10-18T11:08:40.452 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2023-10-18T11:08:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCVvC9lHiMoDBAAC71cl+QfLygSDiKY2fxNjQ== 2023-10-18T11:08:40.453 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-18T11:08:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCVvC9lONGwGxAALo0pBaqH7GvwhUDJYPnvpA== 2023-10-18T11:08:40.453 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-18T11:08:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCVvC9llT7YLBAAn8eXw1vu8R/oijzPHkxKCg== 2023-10-18T11:08:40.454 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.e] 2023-10-18T11:08:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCWvC9l4bx0AhAAukG5iX4A2bm5tShWSwucYw== 2023-10-18T11:08:40.454 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2023-10-18T11:08:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCavC9lNVO7KBAAC+MnpvEcFWjCkhFV/iB1pA== 2023-10-18T11:08:40.454 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2023-10-18T11:08:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCevC9lnZ4ABxAANpOCiHasJ69z9gIzX0BoPg== 2023-10-18T11:08:40.455 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2023-10-18T11:08:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQChvC9lMCtkHxAAqIyboQNQj4CP3YlPoZyhbA== 2023-10-18T11:08:40.455 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2023-10-18T11:08:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCkvC9lurT+KRAAE+5bUt2VWKQafBeQDo3+iA== 2023-10-18T11:08:40.455 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2023-10-18T11:08:40.456 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCVvC9lOeyUEBAAmkkBxu6s7DIH9Hwk2G3z3Q== 2023-10-18T11:08:40.456 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-18T11:08:40.456 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCWvC9luWGTDBAACOaUesO+/WhPBuyhkV+r8A== 2023-10-18T11:08:40.456 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-18T11:08:40.456 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCWvC9l7TM6FBAAkPF40LpqtfCvZ8fX3gv67g== 2023-10-18T11:08:40.457 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.f] 2023-10-18T11:08:40.457 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCWvC9lc+SiGxAAsosGFH+tbyLuqVA9LEExZA== 2023-10-18T11:08:40.457 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2023-10-18T11:08:40.457 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCrvC9l4Y8BDhAA0EeWpFeI0LaZvQda8skA7A== 2023-10-18T11:08:40.457 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2023-10-18T11:08:40.457 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCuvC9lW3meDBAAYftp6umMGLk6Rn4Kb3M9Hg== 2023-10-18T11:08:40.458 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2023-10-18T11:08:40.458 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCxvC9lOuEgChAA7seTJoO0D3PGq6IQbrfh5w== 2023-10-18T11:08:40.458 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2023-10-18T11:08:40.458 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQC0vC9lQBr+CBAAQYWg1pkrWFiLd3uyuBYJLg== 2023-10-18T11:08:40.458 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-10-18T11:08:40.459 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCWvC9laxyIJRAAhxuHyWgNdfwUF2Zc883Eyg== 2023-10-18T11:08:40.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T11:08:40.509 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T11:08:40.649 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:40.658 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:40.798 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:40.804 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:40.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:40.949 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:41.080 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:41.086 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:41.210 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:41.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:41.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:41.356 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:41.491 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:41.500 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:41.634 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T11:08:41.640 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T11:08:41.775 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:41.781 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:41.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:41.934 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:42.071 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:42.076 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T11:08:42.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:42.221 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:42.357 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:42.363 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:42.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:42.501 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:42.638 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:42.647 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T11:08:42.789 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T11:08:42.795 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T11:08:42.928 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-18T11:08:42.929 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-18T11:08:43.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T11:08:43.182 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-18T11:08:43.261 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-18T11:08:43.290 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T11:08:43.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-18T11:08:43.413 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-18T11:08:43.479 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T11:08:43.577 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-18T11:08:43.604 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:43.612 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-18T11:08:43.663 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-18T11:08:43.663 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-18T11:08:43.664 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-18T11:08:43.664 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-10-18T11:08:43.670 INFO:tasks.ceph.mon.a:Started 2023-10-18T11:08:43.671 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-18T11:08:43.671 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-18T11:08:43.672 DEBUG:teuthology.orchestra.run.smithi169:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-10-18T11:08:43.700 INFO:tasks.ceph.mon.b:Started 2023-10-18T11:08:43.701 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-18T11:08:43.701 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-18T11:08:43.701 DEBUG:teuthology.orchestra.run.smithi169:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-10-18T11:08:43.703 INFO:tasks.ceph.mon.c:Started 2023-10-18T11:08:43.704 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-18T11:08:43.704 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-18T11:08:43.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-10-18T11:08:43.711 INFO:tasks.ceph.mgr.y:Started 2023-10-18T11:08:43.712 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-18T11:08:43.712 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-10-18T11:08:43.714 INFO:tasks.ceph.mgr.x:Started 2023-10-18T11:08:43.715 INFO:tasks.ceph:Setting crush tunables to default 2023-10-18T11:08:43.715 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd crush tunables default 2023-10-18T11:08:43.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.896+0000 7fa430f05640 1 Processor -- start 2023-10-18T11:08:43.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.896+0000 7fa430f05640 1 -- start start 2023-10-18T11:08:43.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.897+0000 7fa430f05640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 0x7fa42c157310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:43.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.897+0000 7fa421d9b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 msgr2=0x7fa42c157310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2023-10-18T11:08:43.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.897+0000 7fa430f05640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c06f650 con 0x7fa42c0ccbf0 2023-10-18T11:08:43.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.897+0000 7fa421d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 0x7fa42c157310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T11:08:43.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.897+0000 7fa430f05640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0c8280 con 0x7fa42c0cc810 2023-10-18T11:08:43.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.897+0000 7fa430f05640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0c8560 con 0x7fa42c151250 2023-10-18T11:08:43.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.897+0000 7fa42ad9d640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa42c0ccbf0 legacy=0x7fa42c161660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.151:6789/0 2023-10-18T11:08:43.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:43.898+0000 7fa42a59c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7fa42c0cc810 legacy=0x7fa42c150b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2023-10-18T11:08:44.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:44.098+0000 7fa421d9b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 msgr2=0x7fa42c157310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2023-10-18T11:08:44.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:44.098+0000 7fa421d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 0x7fa42c157310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-18T11:08:44.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:44.099+0000 7fa42a59c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7fa42c0cc810 legacy=0x7fa42c150b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2023-10-18T11:08:44.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:44.099+0000 7fa42ad9d640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa42c0ccbf0 legacy=0x7fa42c161660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.151:6789/0 2023-10-18T11:08:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:44.499+0000 7fa421d9b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 msgr2=0x7fa42c157310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2023-10-18T11:08:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:44.499+0000 7fa421d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 0x7fa42c157310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-18T11:08:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:44.500+0000 7fa42ad9d640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa42c0ccbf0 legacy=0x7fa42c161660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.151:6789/0 2023-10-18T11:08:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:44.500+0000 7fa42a59c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7fa42c0cc810 legacy=0x7fa42c150b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2023-10-18T11:08:45.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:45.300+0000 7fa421d9b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 msgr2=0x7fa42c157310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2023-10-18T11:08:45.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:45.300+0000 7fa421d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 0x7fa42c157310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-18T11:08:45.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:45.301+0000 7fa42a59c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7fa42c0cc810 legacy=0x7fa42c150b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2023-10-18T11:08:45.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:45.301+0000 7fa42ad9d640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa42c0ccbf0 legacy=0x7fa42c161660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.151:6789/0 2023-10-18T11:08:46.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.897+0000 7fa428d99640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 msgr2=0x7fa42c157310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:46.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.897+0000 7fa428d99640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa42c151250 0x7fa42c157310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:46.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.897+0000 7fa428d99640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7fa42c0cc810 legacy=0x7fa42c150b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:46.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.897+0000 7fa428d99640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa42c0ccbf0 legacy=0x7fa42c161660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:46.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.897+0000 7fa428d99640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 0x7fa40c005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:46.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.897+0000 7fa428d99640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 0x7fa40c008620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:46.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.897+0000 7fa428d99640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0c8560 con 0x7fa40c006160 2023-10-18T11:08:46.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.897+0000 7fa428d99640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c008cd0 con 0x7fa40c0036d0 2023-10-18T11:08:46.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.898+0000 7fa421d9b640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 msgr2=0x7fa40c008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.151:3300/0 2023-10-18T11:08:46.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.898+0000 7fa42a59c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 msgr2=0x7fa40c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2023-10-18T11:08:46.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.898+0000 7fa421d9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 0x7fa40c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T11:08:46.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:46.898+0000 7fa42a59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 0x7fa40c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T11:08:47.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:47.099+0000 7fa421d9b640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 msgr2=0x7fa40c008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.151:3300/0 2023-10-18T11:08:47.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:47.099+0000 7fa42a59c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 msgr2=0x7fa40c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2023-10-18T11:08:47.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:47.099+0000 7fa421d9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 0x7fa40c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-18T11:08:47.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:47.099+0000 7fa42a59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 0x7fa40c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-18T11:08:47.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:47.500+0000 7fa421d9b640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 msgr2=0x7fa40c008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.151:3300/0 2023-10-18T11:08:47.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:47.500+0000 7fa42a59c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 msgr2=0x7fa40c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2023-10-18T11:08:47.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:47.500+0000 7fa421d9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 0x7fa40c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-18T11:08:47.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:47.500+0000 7fa42a59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 0x7fa40c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-18T11:08:48.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:48.301+0000 7fa421d9b640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 msgr2=0x7fa40c008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.151:3300/0 2023-10-18T11:08:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:48.301+0000 7fa42a59c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 msgr2=0x7fa40c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2023-10-18T11:08:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:48.301+0000 7fa42a59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 0x7fa40c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-18T11:08:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:48.301+0000 7fa421d9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 0x7fa40c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-18T11:08:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa428d99640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 msgr2=0x7fa40c005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa428d99640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0036d0 0x7fa40c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa428d99640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 msgr2=0x7fa40c008620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa428d99640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006160 0x7fa40c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa42ad9d640 1 -- reap_dead start 2023-10-18T11:08:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa428d99640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 0x7fa40c003af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa428d99640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 0x7fa40c004470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa428d99640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0c8840 con 0x7fa40c004a60 2023-10-18T11:08:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa428d99640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0c8560 con 0x7fa40c006610 2023-10-18T11:08:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa428d99640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c008cd0 con 0x7fa40c004030 2023-10-18T11:08:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa42ad9d640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa40c004a60 legacy=0x7fa40c004f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.151:6789/0 2023-10-18T11:08:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa42a59c640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 msgr2=0x7fa40c003af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.151:3300/0 2023-10-18T11:08:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa421d9b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 msgr2=0x7fa40c004470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2023-10-18T11:08:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa42a59c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 0x7fa40c003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T11:08:49.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:49.898+0000 7fa421d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 0x7fa40c004470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T11:08:50.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.099+0000 7fa42ad9d640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa40c004a60 legacy=0x7fa40c004f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.151:6789/0 2023-10-18T11:08:50.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.099+0000 7fa42a59c640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 msgr2=0x7fa40c003af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.151:3300/0 2023-10-18T11:08:50.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.099+0000 7fa421d9b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 msgr2=0x7fa40c004470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2023-10-18T11:08:50.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.099+0000 7fa42a59c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 0x7fa40c003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-18T11:08:50.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.099+0000 7fa421d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 0x7fa40c004470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-18T11:08:50.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.500+0000 7fa42ad9d640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa40c004a60 legacy=0x7fa40c004f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.151:6789/0 2023-10-18T11:08:50.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.500+0000 7fa42a59c640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 msgr2=0x7fa40c003af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.151:3300/0 2023-10-18T11:08:50.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.500+0000 7fa421d9b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 msgr2=0x7fa40c004470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2023-10-18T11:08:50.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.500+0000 7fa42a59c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 0x7fa40c003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-18T11:08:50.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:50.500+0000 7fa421d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 0x7fa40c004470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-18T11:08:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:51.301+0000 7fa42ad9d640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa40c004a60 legacy=0x7fa40c004f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.151:6789/0 2023-10-18T11:08:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:51.301+0000 7fa42a59c640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 msgr2=0x7fa40c003af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.151:3300/0 2023-10-18T11:08:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:51.301+0000 7fa42a59c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 0x7fa40c003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-18T11:08:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:51.301+0000 7fa421d9b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 msgr2=0x7fa40c004470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2023-10-18T11:08:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:51.301+0000 7fa421d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 0x7fa40c004470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-18T11:08:51.719 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:00:07.887 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:08:51.720 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:00:07.888 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:08:52.046 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:00:08.214 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:08:52.047 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:00:08.214 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:08:52.163 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:00:08.258 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:08:52.484 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:00:08.579 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:08:52.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.898+0000 7fa428d99640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 msgr2=0x7fa40c004470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:52.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.898+0000 7fa428d99640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c004030 0x7fa40c004470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:52.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.898+0000 7fa428d99640 1 -- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 msgr2=0x7fa40c003af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.898+0000 7fa428d99640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40c006610 0x7fa40c003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.898+0000 7fa428d99640 1 -- >> v1:172.21.15.151:6789/0 conn(0x7fa40c004a60 legacy=0x7fa40c004f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.898+0000 7fa428d99640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.899+0000 7fa428d99640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0c8280 con 0x7fa40c0105b0 2023-10-18T11:08:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.899+0000 7fa428d99640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0c8560 con 0x7fa40c0059f0 2023-10-18T11:08:52.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.899+0000 7fa42a59c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 msgr2=0x7fa40c010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2023-10-18T11:08:52.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.899+0000 7fa421d9b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7fa40c0105b0 legacy=0x7fa40c0129a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2023-10-18T11:08:52.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:52.899+0000 7fa42a59c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T11:08:53.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.099+0000 7fa421d9b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7fa40c0105b0 legacy=0x7fa40c0129a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2023-10-18T11:08:53.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.099+0000 7fa42a59c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 msgr2=0x7fa40c010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2023-10-18T11:08:53.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.099+0000 7fa42a59c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-18T11:08:53.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.553+0000 7fa42a59c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:08:53.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.580+0000 7fa42a59c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46330/0 (socket says 172.21.15.151:46330) 2023-10-18T11:08:53.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.580+0000 7fa42a59c640 1 -- 172.21.15.151:0/1558802800 learned_addr learned my addr 172.21.15.151:0/1558802800 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:08:53.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.630+0000 7fa42a59c640 1 -- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 msgr2=0x7fa40c010070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T11:08:53.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.630+0000 7fa42a59c640 1 -- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 msgr2=0x7fa40c010070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T11:08:53.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.630+0000 7fa42a59c640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-18T11:08:53.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.630+0000 7fa42a59c640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-18T11:08:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.858+0000 7fa421d9b640 1 -- 172.21.15.151:0/1558802800 >> v1:172.21.15.169:6789/0 conn(0x7fa40c0105b0 legacy=0x7fa40c0129a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-18T11:08:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.858+0000 7fa421d9b640 1 -- 172.21.15.151:0/1558802800 >> v1:172.21.15.169:6789/0 conn(0x7fa40c0105b0 legacy=0x7fa40c0129a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-18T11:08:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.858+0000 7fa421d9b640 1 --1- 172.21.15.151:0/1558802800 >> v1:172.21.15.169:6789/0 conn(0x7fa40c0105b0 0x7fa40c0129a0 :-1 s=OPENED pgs=1 cs=1 l=1).handle_message read tag failed 2023-10-18T11:08:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:53.858+0000 7fa421d9b640 1 --1- 172.21.15.151:0/1558802800 >> v1:172.21.15.169:6789/0 conn(0x7fa40c0105b0 0x7fa40c0129a0 :-1 s=OPENED pgs=1 cs=1 l=1).fault on lossy channel, failing 2023-10-18T11:08:54.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:54.445+0000 7fa42a59c640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:08:54.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:54.446+0000 7fa42a59c640 1 -- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 msgr2=0x7fa40c010070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-18T11:08:54.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:54.446+0000 7fa42a59c640 1 -- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 msgr2=0x7fa40c010070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T11:08:54.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:54.446+0000 7fa42a59c640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-18T11:08:54.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:54.446+0000 7fa42a59c640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-18T11:08:55.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.898+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 msgr2=0x7fa40c010070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:55.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.898+0000 7fa428d99640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c0059f0 0x7fa40c010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:55.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.898+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 >> v1:172.21.15.169:6789/0 conn(0x7fa40c0105b0 legacy=0x7fa40c0129a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-18T11:08:55.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.898+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 reap_dead start 2023-10-18T11:08:55.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.898+0000 7fa428d99640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:55.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.898+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0c8840 con 0x7fa40c004a60 2023-10-18T11:08:55.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.898+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c014e30 con 0x7fa40c003ad0 2023-10-18T11:08:55.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.898+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0c8560 con 0x7fa40c0149c0 2023-10-18T11:08:55.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.899+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:08:55.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.900+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 msgr2=0x7fa40c00afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-18T11:08:55.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.900+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 msgr2=0x7fa40c00afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T11:08:55.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.900+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-18T11:08:55.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:55.900+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T11:08:56.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.101+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:08:56.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.102+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 msgr2=0x7fa40c00afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-18T11:08:56.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.102+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 msgr2=0x7fa40c00afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T11:08:56.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.102+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-18T11:08:56.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.103+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-18T11:08:56.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.504+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:08:56.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.505+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 msgr2=0x7fa40c00afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-18T11:08:56.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.505+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 msgr2=0x7fa40c00afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T11:08:56.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.505+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-18T11:08:56.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:56.505+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-18T11:08:57.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:57.307+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:08:57.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:57.308+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 msgr2=0x7fa40c00afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-18T11:08:57.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:57.308+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 msgr2=0x7fa40c00afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T11:08:57.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:57.308+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-18T11:08:57.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:57.308+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-18T11:08:58.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.899+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 msgr2=0x7fa40c00afc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T11:08:58.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.899+0000 7fa428d99640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa40c0149c0 0x7fa40c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:58.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.899+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 >> v1:172.21.15.169:6789/0 conn(0x7fa40c003ad0 legacy=0x7fa40c003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:08:58.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.899+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 >> v1:172.21.15.151:6789/0 conn(0x7fa40c004a60 legacy=0x7fa40c004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:08:58.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.899+0000 7fa428d99640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c00b500 0x7fa40c00d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:58.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.899+0000 7fa428d99640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.151:3300/0 conn(0x7fa40c00def0 0x7fa40c0151b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:58.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.900+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0c8560 con 0x7fa40c00def0 2023-10-18T11:08:58.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.900+0000 7fa428d99640 1 -- 172.21.15.151:0/1558802800 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40c008cd0 con 0x7fa40c00b500 2023-10-18T11:08:58.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.912+0000 7fa42a59c640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.169:3300/0 conn(0x7fa40c00b500 0x7fa40c00d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:08:58.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.956+0000 7fa42a59c640 1 -- 172.21.15.151:0/1558802800 >> v2:172.21.15.151:3300/0 conn(0x7fa40c00def0 msgr2=0x7fa40c0151b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:08:58.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.956+0000 7fa42a59c640 1 --2- 172.21.15.151:0/1558802800 >> v2:172.21.15.151:3300/0 conn(0x7fa40c00def0 0x7fa40c0151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:58.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.956+0000 7fa42a59c640 1 -- 172.21.15.151:0/1558802800 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c0045e0 con 0x7fa40c00b500 2023-10-18T11:08:58.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.960+0000 7fa42a59c640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c00b500 0x7fa40c00d920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa40c004890 tx=0x7fa41c02c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbed54e74510d5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:08:58.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.991+0000 7fa429d9b640 1 -- 172.21.15.151:0/1558802800 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0094e0 con 0x7fa40c00b500 2023-10-18T11:08:58.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.991+0000 7fa429d9b640 1 -- 172.21.15.151:0/1558802800 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c02f050 con 0x7fa40c00b500 2023-10-18T11:08:58.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.991+0000 7fa429d9b640 1 -- 172.21.15.151:0/1558802800 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c009840 con 0x7fa40c00b500 2023-10-18T11:08:58.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.993+0000 7fa430f05640 1 -- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c00b500 msgr2=0x7fa40c00d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:08:58.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.993+0000 7fa430f05640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c00b500 0x7fa40c00d920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa40c004890 tx=0x7fa41c02c480 comp rx=0 tx=0).stop 2023-10-18T11:08:58.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.993+0000 7fa42ad9d640 1 -- 172.21.15.151:0/1558802800 reap_dead start 2023-10-18T11:08:58.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.993+0000 7fa430f05640 1 -- 172.21.15.151:0/1558802800 shutdown_connections 2023-10-18T11:08:58.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.993+0000 7fa430f05640 1 --2- 172.21.15.151:0/1558802800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa40c00b500 0x7fa40c00d920 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:58.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.993+0000 7fa430f05640 1 -- 172.21.15.151:0/1558802800 >> 172.21.15.151:0/1558802800 conn(0x7fa42c06fa10 msgr2=0x7fa42c06fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:08:58.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.993+0000 7fa430f05640 1 -- 172.21.15.151:0/1558802800 shutdown_connections 2023-10-18T11:08:58.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.993+0000 7fa430f05640 1 -- 172.21.15.151:0/1558802800 wait complete. 2023-10-18T11:08:59.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.997+0000 7fa430f05640 1 Processor -- start 2023-10-18T11:08:59.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.998+0000 7fa430f05640 1 -- start start 2023-10-18T11:08:59.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:58.999+0000 7fa430f05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa40c00b500 0x7fa42c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:59.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.000+0000 7fa430f05640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42c0b1100 0x7fa42c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:59.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.000+0000 7fa430f05640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa42c0b0690 0x7fa42c0b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:08:59.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.000+0000 7fa430f05640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c14fc50 con 0x7fa40c00b500 2023-10-18T11:08:59.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.000+0000 7fa430f05640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c14f5a0 con 0x7fa42c0b1100 2023-10-18T11:08:59.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.000+0000 7fa430f05640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0aff60 con 0x7fa42c0b0690 2023-10-18T11:08:59.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.000+0000 7fa421d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42c0b1100 0x7fa42c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:08:59.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.000+0000 7fa42ad9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa42c0b0690 0x7fa42c0b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:08:59.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.001+0000 7fa421d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42c0b1100 0x7fa42c06c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:34580/0 (socket says 172.21.15.151:34580) 2023-10-18T11:08:59.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.001+0000 7fa421d9b640 1 -- 172.21.15.151:0/2359401125 learned_addr learned my addr 172.21.15.151:0/2359401125 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:08:59.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.002+0000 7fa42ad9d640 1 -- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa42c0b0690 msgr2=0x7fa42c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-10-18T11:08:59.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.002+0000 7fa42ad9d640 1 -- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa42c0b0690 msgr2=0x7fa42c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-18T11:08:59.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.002+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa42c0b0690 0x7fa42c0b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-18T11:08:59.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.002+0000 7fa42ad9d640 1 --2- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa42c0b0690 0x7fa42c0b0b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T11:08:59.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.012+0000 7fa421d9b640 1 -- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa42c0b0690 msgr2=0x7fa42c0b0b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T11:08:59.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.012+0000 7fa421d9b640 1 --2- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa42c0b0690 0x7fa42c0b0b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:59.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.012+0000 7fa421d9b640 1 -- 172.21.15.151:0/2359401125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa40c00b500 msgr2=0x7fa42c0c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:08:59.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.012+0000 7fa421d9b640 1 --2- 172.21.15.151:0/2359401125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa40c00b500 0x7fa42c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:59.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.012+0000 7fa421d9b640 1 -- 172.21.15.151:0/2359401125 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0c8840 con 0x7fa42c0b1100 2023-10-18T11:08:59.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.016+0000 7fa421d9b640 1 --2- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42c0b1100 0x7fa42c06c160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa41400bab0 tx=0x7fa414009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:08:59.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.020+0000 7fa4237fe640 1 -- 172.21.15.151:0/2359401125 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41400cea0 con 0x7fa42c0b1100 2023-10-18T11:08:59.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.021+0000 7fa4237fe640 1 -- 172.21.15.151:0/2359401125 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4140060d0 con 0x7fa42c0b1100 2023-10-18T11:08:59.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.021+0000 7fa4237fe640 1 -- 172.21.15.151:0/2359401125 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414006460 con 0x7fa42c0b1100 2023-10-18T11:08:59.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.021+0000 7fa430f05640 1 -- 172.21.15.151:0/2359401125 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c14f300 con 0x7fa42c0b1100 2023-10-18T11:08:59.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.021+0000 7fa430f05640 1 -- 172.21.15.151:0/2359401125 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c0b1d20 con 0x7fa42c0b1100 2023-10-18T11:08:59.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.022+0000 7fa430f05640 1 -- 172.21.15.151:0/2359401125 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c06abc0 con 0x7fa42c0b1100 2023-10-18T11:08:59.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.228+0000 7fa4237fe640 1 -- 172.21.15.151:0/2359401125 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa414012020 con 0x7fa42c0b1100 2023-10-18T11:08:59.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.236+0000 7fa4237fe640 1 -- 172.21.15.151:0/2359401125 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa414008070 con 0x7fa42c0b1100 2023-10-18T11:08:59.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.237+0000 7fa4237fe640 1 -- 172.21.15.151:0/2359401125 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa414035b40 con 0x7fa42c0b1100 2023-10-18T11:08:59.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.318+0000 7fa430f05640 1 -- 172.21.15.151:0/2359401125 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa42c04e160 con 0x7fa42c0b1100 2023-10-18T11:08:59.780 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:08:59.778+0000 7f44d1614040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T11:08:59.834 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:08:59.831+0000 7f44d1614040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T11:08:59.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.888+0000 7fa4237fe640 1 -- 172.21.15.151:0/2359401125 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa414024070 con 0x7fa42c0b1100 2023-10-18T11:08:59.891 INFO:teuthology.orchestra.run.smithi151.stderr:adjusted tunables profile to default 2023-10-18T11:08:59.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.890+0000 7fa430f05640 1 -- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42c0b1100 msgr2=0x7fa42c06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:08:59.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.890+0000 7fa430f05640 1 --2- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42c0b1100 0x7fa42c06c160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa41400bab0 tx=0x7fa414009f70 comp rx=0 tx=0).stop 2023-10-18T11:08:59.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.890+0000 7fa430f05640 1 -- 172.21.15.151:0/2359401125 shutdown_connections 2023-10-18T11:08:59.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.891+0000 7fa430f05640 1 --2- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa42c0b0690 0x7fa42c0b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:59.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.891+0000 7fa430f05640 1 --2- 172.21.15.151:0/2359401125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa42c0b1100 0x7fa42c06c160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:59.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.891+0000 7fa430f05640 1 --2- 172.21.15.151:0/2359401125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa40c00b500 0x7fa42c0c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:08:59.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.891+0000 7fa430f05640 1 -- 172.21.15.151:0/2359401125 >> 172.21.15.151:0/2359401125 conn(0x7fa42c06fa10 msgr2=0x7fa42c06fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:08:59.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.891+0000 7fa430f05640 1 -- 172.21.15.151:0/2359401125 shutdown_connections 2023-10-18T11:08:59.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:08:59.891+0000 7fa430f05640 1 -- 172.21.15.151:0/2359401125 wait complete. 2023-10-18T11:08:59.914 INFO:tasks.ceph:check_enable_crimson: False 2023-10-18T11:08:59.915 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-18T11:08:59.915 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:59.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-18T11:08:59.979 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:08:59.977+0000 7f5de022c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T11:08:59.996 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:08:59.996 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-18T11:09:00.048 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:00.046+0000 7f5de022c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T11:09:00.121 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:09:00.121 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-18T11:09:00.245 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:09:00.246 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-18T11:09:00.353 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.351+0000 7f44d1614040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T11:09:00.375 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:09:00.375 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-18T11:09:00.403 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:09:00.403 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-18T11:09:00.406 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.404+0000 7f44d1614040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T11:09:00.433 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:09:00.433 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-18T11:09:00.455 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.453+0000 7f44d1614040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T11:09:00.482 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-10-18T11:09:00.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-18T11:09:00.512 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.510+0000 7f44d1614040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T11:09:00.539 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 9bae2190-379d-42cd-9dc8-4a0b615d9c12 0 2023-10-18T11:09:00.556 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.554+0000 7f44d1614040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T11:09:00.656 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.654+0000 7f5b85e39640 1 Processor -- start 2023-10-18T11:09:00.656 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.654+0000 7f5b85e39640 1 -- start start 2023-10-18T11:09:00.657 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.654+0000 7f5b85e39640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5b8006e860 0x7f5b8006ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:00.657 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.654+0000 7f5b85e39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800c7e20 con 0x7f5b800c5070 2023-10-18T11:09:00.657 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.654+0000 7f5b85e39640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800c5450 con 0x7f5b80159bf0 2023-10-18T11:09:00.657 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.654+0000 7f5b85e39640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b80071f40 con 0x7f5b8006e860 2023-10-18T11:09:00.658 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.655+0000 7f5b7effd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f5b80159bf0 0x7f5b80069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35790/0 (socket says 172.21.15.169:35790) 2023-10-18T11:09:00.658 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.655+0000 7f5b7effd640 1 -- 172.21.15.169:0/4224966554 learned_addr learned my addr 172.21.15.169:0/4224966554 (peer_addr_for_me v1:172.21.15.169:0/0) 2023-10-18T11:09:00.659 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.657+0000 7f5b7ffff640 1 --2- 172.21.15.169:0/4224966554 >> v2:172.21.15.151:3300/0 conn(0x7f5b8006e860 0x7f5b8006ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:00.660 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.658+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251311413 0 0) 0x7f5b800c5450 con 0x7f5b80159bf0 2023-10-18T11:09:00.660 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.658+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b68003520 con 0x7f5b80159bf0 2023-10-18T11:09:00.662 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.660+0000 7f44d1614040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-18T11:09:00.664 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449383934 0 0) 0x7f5b68003520 con 0x7f5b80159bf0 2023-10-18T11:09:00.664 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 >> v2:172.21.15.151:3300/0 conn(0x7f5b8006e860 msgr2=0x7f5b8006ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:00.664 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 --2- 172.21.15.169:0/4224966554 >> v2:172.21.15.151:3300/0 conn(0x7f5b8006e860 0x7f5b8006ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:00.665 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 >> v1:172.21.15.151:6789/0 conn(0x7f5b800c5070 legacy=0x7f5b80071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:00.665 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8015a040 con 0x7f5b80159bf0 2023-10-18T11:09:00.665 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f5b74001670 con 0x7f5b80159bf0 2023-10-18T11:09:00.665 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 >> v1:172.21.15.169:6789/0 conn(0x7f5b80159bf0 legacy=0x7f5b80069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:00.665 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b680039c0 0x7f5b68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:00.665 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:00.666 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680051d0 0x7f5b6800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:00.666 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80071f40 con 0x7f5b680039c0 2023-10-18T11:09:00.666 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800c100 con 0x7f5b680047c0 2023-10-18T11:09:00.666 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.661+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800c2c0 con 0x7f5b680051d0 2023-10-18T11:09:00.666 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.662+0000 7f5b7ffff640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680051d0 0x7f5b6800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:00.667 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.664+0000 7f5b7effd640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:00.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.667+0000 7f5b7effd640 1 -- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680051d0 msgr2=0x7f5b6800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:00.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.667+0000 7f5b7effd640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b680051d0 0x7f5b6800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:00.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.667+0000 7f5b7effd640 1 -- 172.21.15.169:0/4224966554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b680039c0 msgr2=0x7f5b68003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:00.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.667+0000 7f5b7effd640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b680039c0 0x7f5b68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:00.670 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.667+0000 7f5b7effd640 1 -- 172.21.15.169:0/4224966554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b68003520 con 0x7f5b680047c0 2023-10-18T11:09:00.670 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.667+0000 7f5b7ffff640 1 -- 172.21.15.169:0/4224966554 reap_dead start 2023-10-18T11:09:00.670 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.669+0000 7f5b7effd640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b68004c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b74007fd0 tx=0x7f5b680057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aafe5b53965aa96 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:00.674 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.672+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74005ad0 con 0x7f5b680047c0 2023-10-18T11:09:00.674 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.672+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74005c30 con 0x7f5b680047c0 2023-10-18T11:09:00.675 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.672+0000 7f5b7e7fc640 1 -- 172.21.15.169:0/4224966554 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74007070 con 0x7f5b680047c0 2023-10-18T11:09:00.675 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.673+0000 7f5b85e39640 1 -- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 msgr2=0x7f5b68004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:00.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.673+0000 7f5b85e39640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b68004c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b74007fd0 tx=0x7f5b680057f0 comp rx=0 tx=0).stop 2023-10-18T11:09:00.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.673+0000 7f5b85e39640 1 -- 172.21.15.169:0/4224966554 shutdown_connections 2023-10-18T11:09:00.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.673+0000 7f5b85e39640 1 --2- 172.21.15.169:0/4224966554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b68004c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:00.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.673+0000 7f5b85e39640 1 -- 172.21.15.169:0/4224966554 >> 172.21.15.169:0/4224966554 conn(0x7f5b8006b080 msgr2=0x7f5b8006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:00.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.673+0000 7f5b85e39640 1 -- 172.21.15.169:0/4224966554 shutdown_connections 2023-10-18T11:09:00.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.673+0000 7f5b85e39640 1 -- 172.21.15.169:0/4224966554 wait complete. 2023-10-18T11:09:00.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.674+0000 7f5b85e39640 1 Processor -- start 2023-10-18T11:09:00.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.674+0000 7f5b85e39640 1 -- start start 2023-10-18T11:09:00.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.675+0000 7f5b85e39640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b801567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:00.679 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.675+0000 7f5b85e39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b80155520 0x7f5b8006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:00.679 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.675+0000 7f5b85e39640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b800c0e10 0x7f5b800c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:00.679 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.675+0000 7f5b85e39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80153530 con 0x7f5b80155520 2023-10-18T11:09:00.679 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.675+0000 7f5b85e39640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80153dd0 con 0x7f5b680047c0 2023-10-18T11:09:00.679 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.675+0000 7f5b85e39640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800c17d0 con 0x7f5b800c0e10 2023-10-18T11:09:00.679 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.676+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b801567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:00.680 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.676+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b801567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:35390/0 (socket says 172.21.15.169:35390) 2023-10-18T11:09:00.680 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.676+0000 7f5b7f7fe640 1 -- 172.21.15.169:0/67846065 learned_addr learned my addr 172.21.15.169:0/67846065 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:00.681 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.679+0000 7f5b7f7fe640 1 -- 172.21.15.169:0/67846065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b800c0e10 msgr2=0x7f5b800c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:00.682 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.679+0000 7f5b7f7fe640 1 --2- 172.21.15.169:0/67846065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b800c0e10 0x7f5b800c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:00.682 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.679+0000 7f5b7f7fe640 1 -- 172.21.15.169:0/67846065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b80155520 msgr2=0x7f5b8006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:00.682 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.679+0000 7f5b7f7fe640 1 --2- 172.21.15.169:0/67846065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b80155520 0x7f5b8006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:00.682 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.679+0000 7f5b7f7fe640 1 -- 172.21.15.169:0/67846065 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80155a30 con 0x7f5b680047c0 2023-10-18T11:09:00.686 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.682+0000 7f5b7f7fe640 1 --2- 172.21.15.169:0/67846065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b801567b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000c410 tx=0x7f5b7000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:00.689 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.686+0000 7f5b67fff640 1 -- 172.21.15.169:0/67846065 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700035f0 con 0x7f5b680047c0 2023-10-18T11:09:00.689 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.686+0000 7f5b67fff640 1 -- 172.21.15.169:0/67846065 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70003750 con 0x7f5b680047c0 2023-10-18T11:09:00.689 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.686+0000 7f5b85e39640 1 -- 172.21.15.169:0/67846065 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b80155d10 con 0x7f5b680047c0 2023-10-18T11:09:00.689 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.686+0000 7f5b67fff640 1 -- 172.21.15.169:0/67846065 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70003b00 con 0x7f5b680047c0 2023-10-18T11:09:00.689 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.686+0000 7f5b85e39640 1 -- 172.21.15.169:0/67846065 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b80153a60 con 0x7f5b680047c0 2023-10-18T11:09:00.690 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.687+0000 7f5b85e39640 1 -- 172.21.15.169:0/67846065 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b800c4c20 con 0x7f5b680047c0 2023-10-18T11:09:00.692 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.690+0000 7f5b67fff640 1 -- 172.21.15.169:0/67846065 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5b7001c440 con 0x7f5b680047c0 2023-10-18T11:09:00.692 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.690+0000 7f5b67fff640 1 -- 172.21.15.169:0/67846065 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5b70012740 con 0x7f5b680047c0 2023-10-18T11:09:00.714 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:00.712+0000 7f5de022c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T11:09:00.742 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.740+0000 7f44d1614040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T11:09:00.777 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:00.774+0000 7f5de022c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T11:09:00.789 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.787+0000 7f44d1614040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T11:09:00.793 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.791+0000 7f5b67fff640 1 -- 172.21.15.169:0/67846065 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5b70017070 con 0x7f5b680047c0 2023-10-18T11:09:00.831 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:00.829+0000 7f5de022c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T11:09:00.845 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.843+0000 7f44d1614040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T11:09:00.884 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:00.882+0000 7f5b85e39640 1 -- 172.21.15.169:0/67846065 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9bae2190-379d-42cd-9dc8-4a0b615d9c12", "id": 0} v 0) v1 -- 0x7f5b80073be0 con 0x7f5b680047c0 2023-10-18T11:09:00.896 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:00.894+0000 7f44d1614040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T11:09:00.897 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:00.895+0000 7f5de022c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T11:09:00.951 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:00.948+0000 7f5de022c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T11:09:01.070 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:01.068+0000 7f5de022c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-18T11:09:01.128 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.126+0000 7f5b67fff640 1 -- 172.21.15.169:0/67846065 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9bae2190-379d-42cd-9dc8-4a0b615d9c12", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5b80073be0 con 0x7f5b680047c0 2023-10-18T11:09:01.129 INFO:teuthology.orchestra.run.smithi169.stdout:0 2023-10-18T11:09:01.130 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.127+0000 7f5b85e39640 1 -- 172.21.15.169:0/67846065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 msgr2=0x7f5b801567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.130 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.127+0000 7f5b85e39640 1 --2- 172.21.15.169:0/67846065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b801567b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000c410 tx=0x7f5b7000c8d0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.130 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.127+0000 7f5b85e39640 1 -- 172.21.15.169:0/67846065 shutdown_connections 2023-10-18T11:09:01.130 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.127+0000 7f5b85e39640 1 --2- 172.21.15.169:0/67846065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b800c0e10 0x7f5b800c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.130 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.127+0000 7f5b85e39640 1 --2- 172.21.15.169:0/67846065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b80155520 0x7f5b8006eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.131 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.127+0000 7f5b85e39640 1 --2- 172.21.15.169:0/67846065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b680047c0 0x7f5b801567b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.131 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.127+0000 7f5b85e39640 1 -- 172.21.15.169:0/67846065 >> 172.21.15.169:0/67846065 conn(0x7f5b8006b080 msgr2=0x7f5b80070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:01.131 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.127+0000 7f5b85e39640 1 -- 172.21.15.169:0/67846065 shutdown_connections 2023-10-18T11:09:01.131 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.127+0000 7f5b85e39640 1 -- 172.21.15.169:0/67846065 wait complete. 2023-10-18T11:09:01.143 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 93a85388-7db1-4ac8-b1a8-ce3ee49aff61 1 2023-10-18T11:09:01.155 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:01.153+0000 7f5de022c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T11:09:01.210 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:01.208+0000 7f5de022c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T11:09:01.242 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.240+0000 7f5509c39640 1 Processor -- start 2023-10-18T11:09:01.242 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.240+0000 7f5509c39640 1 -- start start 2023-10-18T11:09:01.243 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.241+0000 7f5509c39640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55040c3420 0x7f55040659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:01.244 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.241+0000 7f5509c39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5504159120 con 0x7f5504065f10 2023-10-18T11:09:01.244 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.241+0000 7f5509c39640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55040c3800 con 0x7f55040cd000 2023-10-18T11:09:01.244 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.241+0000 7f5509c39640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55040c7bb0 con 0x7f55040c3420 2023-10-18T11:09:01.244 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.241+0000 7f55037fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55040c3420 0x7f55040659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:01.245 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.242+0000 7f54faffd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f55040cd000 0x7f550406aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35792/0 (socket says 172.21.15.169:35792) 2023-10-18T11:09:01.245 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.242+0000 7f54faffd640 1 -- 172.21.15.169:0/1750755817 learned_addr learned my addr 172.21.15.169:0/1750755817 (peer_addr_for_me v1:172.21.15.169:0/0) 2023-10-18T11:09:01.247 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.245+0000 7f55037fe640 1 -- 172.21.15.169:0/1750755817 >> v1:172.21.15.169:6789/0 conn(0x7f55040cd000 legacy=0x7f550406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.247 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.245+0000 7f55037fe640 1 -- 172.21.15.169:0/1750755817 >> v1:172.21.15.151:6789/0 conn(0x7f5504065f10 legacy=0x7f55040c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.247 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.245+0000 7f55037fe640 1 -- 172.21.15.169:0/1750755817 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55041593e0 con 0x7f55040c3420 2023-10-18T11:09:01.249 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.247+0000 7f55037fe640 1 --2- 172.21.15.169:0/1750755817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55040c3420 0x7f55040659d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097d0 tx=0x7f54f402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa682e3331c58861 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:01.254 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.252+0000 7f5502ffd640 1 -- 172.21.15.169:0/1750755817 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4031890 con 0x7f55040c3420 2023-10-18T11:09:01.254 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.252+0000 7f5502ffd640 1 -- 172.21.15.169:0/1750755817 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f40319f0 con 0x7f55040c3420 2023-10-18T11:09:01.254 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.252+0000 7f5502ffd640 1 -- 172.21.15.169:0/1750755817 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4031d80 con 0x7f55040c3420 2023-10-18T11:09:01.255 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.252+0000 7f5509c39640 1 -- 172.21.15.169:0/1750755817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55040c3420 msgr2=0x7f55040659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.255 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.252+0000 7f5509c39640 1 --2- 172.21.15.169:0/1750755817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55040c3420 0x7f55040659d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097d0 tx=0x7f54f402b930 comp rx=0 tx=0).stop 2023-10-18T11:09:01.255 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.253+0000 7f5509c39640 1 -- 172.21.15.169:0/1750755817 shutdown_connections 2023-10-18T11:09:01.256 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.253+0000 7f5509c39640 1 --2- 172.21.15.169:0/1750755817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55040c3420 0x7f55040659d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.256 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.253+0000 7f5509c39640 1 -- 172.21.15.169:0/1750755817 >> 172.21.15.169:0/1750755817 conn(0x7f550406e210 msgr2=0x7f550406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:01.256 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.253+0000 7f5509c39640 1 -- 172.21.15.169:0/1750755817 shutdown_connections 2023-10-18T11:09:01.256 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.253+0000 7f5509c39640 1 -- 172.21.15.169:0/1750755817 wait complete. 2023-10-18T11:09:01.257 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.254+0000 7f5509c39640 1 Processor -- start 2023-10-18T11:09:01.257 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.254+0000 7f5509c39640 1 -- start start 2023-10-18T11:09:01.258 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.255+0000 7f5509c39640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5504065f10 0x7f55040c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:01.258 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.255+0000 7f5509c39640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55040c3420 0x7f550414fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:01.258 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.255+0000 7f5509c39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55040cd000 0x7f55040c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:01.258 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.255+0000 7f5509c39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55041f2450 con 0x7f55040cd000 2023-10-18T11:09:01.258 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.255+0000 7f5509c39640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55040c5bf0 con 0x7f55040c3420 2023-10-18T11:09:01.259 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.255+0000 7f5509c39640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55041f1b20 con 0x7f5504065f10 2023-10-18T11:09:01.259 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.255+0000 7f54faffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55040c3420 0x7f550414fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:01.260 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.256+0000 7f54faffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55040c3420 0x7f550414fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:35400/0 (socket says 172.21.15.169:35400) 2023-10-18T11:09:01.260 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.256+0000 7f54faffd640 1 -- 172.21.15.169:0/4031804101 learned_addr learned my addr 172.21.15.169:0/4031804101 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:01.260 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.256+0000 7f55037fe640 1 --2- 172.21.15.169:0/4031804101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5504065f10 0x7f55040c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:01.260 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.259+0000 7f5503fff640 1 --2- 172.21.15.169:0/4031804101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55040cd000 0x7f55040c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:01.261 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.259+0000 7f54faffd640 1 -- 172.21.15.169:0/4031804101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5504065f10 msgr2=0x7f55040c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.259+0000 7f54faffd640 1 --2- 172.21.15.169:0/4031804101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5504065f10 0x7f55040c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.259+0000 7f54faffd640 1 -- 172.21.15.169:0/4031804101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55040cd000 msgr2=0x7f55040c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.259+0000 7f54faffd640 1 --2- 172.21.15.169:0/4031804101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55040cd000 0x7f55040c3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.262 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.259+0000 7f54faffd640 1 -- 172.21.15.169:0/4031804101 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4009400 con 0x7f55040c3420 2023-10-18T11:09:01.264 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.262+0000 7f54faffd640 1 --2- 172.21.15.169:0/4031804101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55040c3420 0x7f550414fe80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00c480 tx=0x7f54ec00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:01.268 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.266+0000 7f5500ff9640 1 -- 172.21.15.169:0/4031804101 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec005ce0 con 0x7f55040c3420 2023-10-18T11:09:01.269 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.266+0000 7f5500ff9640 1 -- 172.21.15.169:0/4031804101 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec005e40 con 0x7f55040c3420 2023-10-18T11:09:01.269 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.266+0000 7f5500ff9640 1 -- 172.21.15.169:0/4031804101 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0072f0 con 0x7f55040c3420 2023-10-18T11:09:01.269 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.266+0000 7f5509c39640 1 -- 172.21.15.169:0/4031804101 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55040af3a0 con 0x7f55040c3420 2023-10-18T11:09:01.269 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.266+0000 7f5509c39640 1 -- 172.21.15.169:0/4031804101 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55040af6a0 con 0x7f55040c3420 2023-10-18T11:09:01.270 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.267+0000 7f5509c39640 1 -- 172.21.15.169:0/4031804101 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55041f2590 con 0x7f55040c3420 2023-10-18T11:09:01.273 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:01.271+0000 7f5de022c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T11:09:01.298 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:01.296+0000 7f44d1614040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-18T11:09:01.327 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:01.325+0000 7f5de022c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T11:09:01.374 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.372+0000 7f5500ff9640 1 -- 172.21.15.169:0/4031804101 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f54ec01c440 con 0x7f55040c3420 2023-10-18T11:09:01.374 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.372+0000 7f5500ff9640 1 -- 172.21.15.169:0/4031804101 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f54ec0127f0 con 0x7f55040c3420 2023-10-18T11:09:01.374 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.372+0000 7f5500ff9640 1 -- 172.21.15.169:0/4031804101 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f55041f2590 con 0x7f55040c3420 2023-10-18T11:09:01.439 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:01.437+0000 7f44d1614040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T11:09:01.533 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.446+0000 7f5509c39640 1 -- 172.21.15.169:0/4031804101 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93a85388-7db1-4ac8-b1a8-ce3ee49aff61", "id": 1} v 0) v1 -- 0x7f550404e160 con 0x7f55040c3420 2023-10-18T11:09:01.556 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:01.554+0000 7f44d1614040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T11:09:01.604 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:01.602+0000 7f44d1614040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T11:09:01.649 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.647+0000 7f5500ff9640 1 -- 172.21.15.169:0/4031804101 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93a85388-7db1-4ac8-b1a8-ce3ee49aff61", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54ec021060 con 0x7f55040c3420 2023-10-18T11:09:01.649 INFO:teuthology.orchestra.run.smithi169.stdout:1 2023-10-18T11:09:01.650 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.648+0000 7f5509c39640 1 -- 172.21.15.169:0/4031804101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55040c3420 msgr2=0x7f550414fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.651 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.648+0000 7f5509c39640 1 --2- 172.21.15.169:0/4031804101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55040c3420 0x7f550414fe80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00c480 tx=0x7f54ec00c940 comp rx=0 tx=0).stop 2023-10-18T11:09:01.651 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.648+0000 7f5509c39640 1 -- 172.21.15.169:0/4031804101 shutdown_connections 2023-10-18T11:09:01.651 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.648+0000 7f5509c39640 1 --2- 172.21.15.169:0/4031804101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55040cd000 0x7f55040c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.651 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.648+0000 7f5509c39640 1 --2- 172.21.15.169:0/4031804101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55040c3420 0x7f550414fe80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.651 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.648+0000 7f5509c39640 1 --2- 172.21.15.169:0/4031804101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5504065f10 0x7f55040c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.652 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.648+0000 7f5509c39640 1 -- 172.21.15.169:0/4031804101 >> 172.21.15.169:0/4031804101 conn(0x7f550406e210 msgr2=0x7f5504157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:01.652 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.648+0000 7f5509c39640 1 -- 172.21.15.169:0/4031804101 shutdown_connections 2023-10-18T11:09:01.652 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.648+0000 7f5509c39640 1 -- 172.21.15.169:0/4031804101 wait complete. 2023-10-18T11:09:01.660 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new f921a096-a8f1-4d85-9974-c6f873ec1948 2 2023-10-18T11:09:01.707 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:01.705+0000 7f44d1614040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T11:09:01.761 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.758+0000 7fded604b640 1 Processor -- start 2023-10-18T11:09:01.761 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.759+0000 7fded604b640 1 -- start start 2023-10-18T11:09:01.761 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.759+0000 7fded604b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fded0150f50 0x7fded0156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:01.762 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.760+0000 7fded604b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded0157ca0 con 0x7fded00659d0 2023-10-18T11:09:01.762 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.760+0000 7fded604b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded0157400 con 0x7fded00ccf20 2023-10-18T11:09:01.763 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.760+0000 7fded604b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded0157220 con 0x7fded0150f50 2023-10-18T11:09:01.763 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.760+0000 7fdecf7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fded0150f50 0x7fded0156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:01.763 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.761+0000 7fdeceffd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fded00ccf20 0x7fded00c1f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35798/0 (socket says 172.21.15.169:35798) 2023-10-18T11:09:01.764 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.761+0000 7fdeceffd640 1 -- 172.21.15.169:0/104607665 learned_addr learned my addr 172.21.15.169:0/104607665 (peer_addr_for_me v1:172.21.15.169:0/0) 2023-10-18T11:09:01.766 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.763+0000 7fdecf7fe640 1 -- 172.21.15.169:0/104607665 >> v1:172.21.15.169:6789/0 conn(0x7fded00ccf20 legacy=0x7fded00c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.766 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.764+0000 7fdecf7fe640 1 -- 172.21.15.169:0/104607665 >> v1:172.21.15.151:6789/0 conn(0x7fded00659d0 legacy=0x7fded0161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.766 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.764+0000 7fdecf7fe640 1 -- 172.21.15.169:0/104607665 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded01576e0 con 0x7fded0150f50 2023-10-18T11:09:01.771 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.769+0000 7fdecf7fe640 1 --2- 172.21.15.169:0/104607665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded0150f50 0x7fded0156ce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80097a0 tx=0x7fdeb802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0a404a03ddc903 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:01.775 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.773+0000 7fdece7fc640 1 -- 172.21.15.169:0/104607665 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8030610 con 0x7fded0150f50 2023-10-18T11:09:01.775 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.773+0000 7fdece7fc640 1 -- 172.21.15.169:0/104607665 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8030770 con 0x7fded0150f50 2023-10-18T11:09:01.775 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.773+0000 7fdece7fc640 1 -- 172.21.15.169:0/104607665 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8030b00 con 0x7fded0150f50 2023-10-18T11:09:01.776 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.774+0000 7fded604b640 1 -- 172.21.15.169:0/104607665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded0150f50 msgr2=0x7fded0156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.776 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.774+0000 7fded604b640 1 --2- 172.21.15.169:0/104607665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded0150f50 0x7fded0156ce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80097a0 tx=0x7fdeb802b960 comp rx=0 tx=0).stop 2023-10-18T11:09:01.777 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.774+0000 7fded604b640 1 -- 172.21.15.169:0/104607665 shutdown_connections 2023-10-18T11:09:01.777 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.774+0000 7fded604b640 1 --2- 172.21.15.169:0/104607665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded0150f50 0x7fded0156ce0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.777 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.774+0000 7fded604b640 1 -- 172.21.15.169:0/104607665 >> 172.21.15.169:0/104607665 conn(0x7fded006e210 msgr2=0x7fded006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:01.777 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.774+0000 7fded604b640 1 -- 172.21.15.169:0/104607665 shutdown_connections 2023-10-18T11:09:01.777 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.774+0000 7fded604b640 1 -- 172.21.15.169:0/104607665 wait complete. 2023-10-18T11:09:01.779 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.775+0000 7fded604b640 1 Processor -- start 2023-10-18T11:09:01.779 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.775+0000 7fded604b640 1 -- start start 2023-10-18T11:09:01.779 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.776+0000 7fded604b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded00659d0 0x7fded01561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:01.779 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.776+0000 7fded604b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fded00ccf20 0x7fded0155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:01.780 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.776+0000 7fded604b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded0150f50 0x7fded00c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:01.780 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.776+0000 7fded604b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded01570e0 con 0x7fded0150f50 2023-10-18T11:09:01.780 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.776+0000 7fded604b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded01ee590 con 0x7fded00659d0 2023-10-18T11:09:01.780 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.776+0000 7fded604b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded006bc20 con 0x7fded00ccf20 2023-10-18T11:09:01.780 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.776+0000 7fdecf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded00659d0 0x7fded01561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:01.781 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.776+0000 7fdeceffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fded00ccf20 0x7fded0155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:01.781 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.777+0000 7fdeceffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fded00ccf20 0x7fded0155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:52864/0 (socket says 172.21.15.169:52864) 2023-10-18T11:09:01.781 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.777+0000 7fdeceffd640 1 -- 172.21.15.169:0/2212662960 learned_addr learned my addr 172.21.15.169:0/2212662960 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:01.781 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.777+0000 7fdecf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded00659d0 0x7fded01561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:35408/0 (socket says 172.21.15.169:35408) 2023-10-18T11:09:01.782 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.778+0000 7fdecffff640 1 --2- 172.21.15.169:0/2212662960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded0150f50 0x7fded00c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:01.782 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.780+0000 7fdecf7fe640 1 -- 172.21.15.169:0/2212662960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fded00ccf20 msgr2=0x7fded0155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.783 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.780+0000 7fdecf7fe640 1 --2- 172.21.15.169:0/2212662960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fded00ccf20 0x7fded0155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.783 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.780+0000 7fdecf7fe640 1 -- 172.21.15.169:0/2212662960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded0150f50 msgr2=0x7fded00c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:01.783 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.780+0000 7fdecf7fe640 1 --2- 172.21.15.169:0/2212662960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded0150f50 0x7fded00c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:01.783 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.780+0000 7fdecf7fe640 1 -- 172.21.15.169:0/2212662960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb8009400 con 0x7fded00659d0 2023-10-18T11:09:01.783 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.780+0000 7fdecffff640 1 --2- 172.21.15.169:0/2212662960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded0150f50 0x7fded00c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T11:09:01.785 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.783+0000 7fdecf7fe640 1 --2- 172.21.15.169:0/2212662960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded00659d0 0x7fded01561e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8033000 tx=0x7fdeb80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:01.787 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:01.784+0000 7f5de022c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-18T11:09:01.788 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.786+0000 7fdec7fff640 1 -- 172.21.15.169:0/2212662960 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb803e070 con 0x7fded00659d0 2023-10-18T11:09:01.789 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.786+0000 7fdec7fff640 1 -- 172.21.15.169:0/2212662960 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8039a50 con 0x7fded00659d0 2023-10-18T11:09:01.789 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.786+0000 7fdec7fff640 1 -- 172.21.15.169:0/2212662960 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8039de0 con 0x7fded00659d0 2023-10-18T11:09:01.789 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.786+0000 7fded604b640 1 -- 172.21.15.169:0/2212662960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded01ef560 con 0x7fded00659d0 2023-10-18T11:09:01.789 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.786+0000 7fded604b640 1 -- 172.21.15.169:0/2212662960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded01ee7a0 con 0x7fded00659d0 2023-10-18T11:09:01.790 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.787+0000 7fded604b640 1 -- 172.21.15.169:0/2212662960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded004e160 con 0x7fded00659d0 2023-10-18T11:09:01.790 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.789+0000 7fdec7fff640 1 -- 172.21.15.169:0/2212662960 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdeb8042730 con 0x7fded00659d0 2023-10-18T11:09:01.810 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:01.808+0000 7f44d1614040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T11:09:01.895 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.893+0000 7fdec7fff640 1 -- 172.21.15.169:0/2212662960 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdeb80417b0 con 0x7fded00659d0 2023-10-18T11:09:01.895 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.893+0000 7fdec7fff640 1 -- 172.21.15.169:0/2212662960 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdeb8034070 con 0x7fded00659d0 2023-10-18T11:09:01.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:09:01.942 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:09:01.955 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:01.953+0000 7f5de022c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T11:09:01.956 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:01.954+0000 7f44d1614040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T11:09:01.985 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:01.983+0000 7fded604b640 1 -- 172.21.15.169:0/2212662960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f921a096-a8f1-4d85-9974-c6f873ec1948", "id": 2} v 0) v1 -- 0x7fded014afd0 con 0x7fded00659d0 2023-10-18T11:09:02.004 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:02.001+0000 7f44d1614040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T11:09:02.072 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.069+0000 7fdec7fff640 1 -- 172.21.15.169:0/2212662960 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f921a096-a8f1-4d85-9974-c6f873ec1948", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdeb8041390 con 0x7fded00659d0 2023-10-18T11:09:02.072 INFO:teuthology.orchestra.run.smithi169.stdout:2 2023-10-18T11:09:02.073 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.070+0000 7fded604b640 1 -- 172.21.15.169:0/2212662960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded00659d0 msgr2=0x7fded01561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.073 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.070+0000 7fded604b640 1 --2- 172.21.15.169:0/2212662960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded00659d0 0x7fded01561e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8033000 tx=0x7fdeb80046c0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.074 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.071+0000 7fded604b640 1 -- 172.21.15.169:0/2212662960 shutdown_connections 2023-10-18T11:09:02.074 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.071+0000 7fded604b640 1 --2- 172.21.15.169:0/2212662960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded0150f50 0x7fded00c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.074 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.071+0000 7fded604b640 1 --2- 172.21.15.169:0/2212662960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fded00ccf20 0x7fded0155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.074 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.071+0000 7fded604b640 1 --2- 172.21.15.169:0/2212662960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fded00659d0 0x7fded01561e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.074 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.071+0000 7fded604b640 1 -- 172.21.15.169:0/2212662960 >> 172.21.15.169:0/2212662960 conn(0x7fded006e210 msgr2=0x7fded014e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:02.075 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.071+0000 7fded604b640 1 -- 172.21.15.169:0/2212662960 shutdown_connections 2023-10-18T11:09:02.075 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.071+0000 7fded604b640 1 -- 172.21.15.169:0/2212662960 wait complete. 2023-10-18T11:09:02.084 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 3137ce35-4107-49be-ae80-3f8a3e82d70c 3 2023-10-18T11:09:02.156 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:02.153+0000 7f44d1614040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T11:09:02.185 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.183+0000 7f5768fa0640 1 Processor -- start 2023-10-18T11:09:02.185 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.183+0000 7f5768fa0640 1 -- start start 2023-10-18T11:09:02.186 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.184+0000 7f5768fa0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f57640c74e0 0x7f57640c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.187 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.184+0000 7f5768fa0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5764071a80 con 0x7f57640c8340 2023-10-18T11:09:02.187 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.184+0000 7f5768fa0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57640c7970 con 0x7f576414ffb0 2023-10-18T11:09:02.187 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.184+0000 7f5768fa0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640c7c40 con 0x7f57640c74e0 2023-10-18T11:09:02.187 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.184+0000 7f57637fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f576414ffb0 0x7f5764071150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35812/0 (socket says 172.21.15.169:35812) 2023-10-18T11:09:02.187 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.184+0000 7f57637fe640 1 -- 172.21.15.169:0/654208763 learned_addr learned my addr 172.21.15.169:0/654208763 (peer_addr_for_me v1:172.21.15.169:0/0) 2023-10-18T11:09:02.188 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.186+0000 7f575affd640 1 --2- 172.21.15.169:0/654208763 >> v2:172.21.15.151:3300/0 conn(0x7f57640c74e0 0x7f57640c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:02.189 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.187+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610332486 0 0) 0x7f57640c7970 con 0x7f576414ffb0 2023-10-18T11:09:02.189 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.187+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5750003520 con 0x7f576414ffb0 2023-10-18T11:09:02.193 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3280297499 0 0) 0x7f5750003520 con 0x7f576414ffb0 2023-10-18T11:09:02.193 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 >> v2:172.21.15.151:3300/0 conn(0x7f57640c74e0 msgr2=0x7f57640c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:02.193 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 --2- 172.21.15.169:0/654208763 >> v2:172.21.15.151:3300/0 conn(0x7f57640c74e0 0x7f57640c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.194 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 >> v1:172.21.15.151:6789/0 conn(0x7f57640c8340 legacy=0x7f5764155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:02.194 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640c4790 con 0x7f576414ffb0 2023-10-18T11:09:02.194 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f5754001670 con 0x7f576414ffb0 2023-10-18T11:09:02.194 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 >> v1:172.21.15.169:6789/0 conn(0x7f576414ffb0 legacy=0x7f5764071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.194 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57500039c0 0x7f5750003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.195 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57500047c0 0x7f5750004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.195 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5750005180 0x7f575000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.195 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640c7c40 con 0x7f57500039c0 2023-10-18T11:09:02.195 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575000c030 con 0x7f57500047c0 2023-10-18T11:09:02.195 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.190+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575000c1f0 con 0x7f5750005180 2023-10-18T11:09:02.196 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.191+0000 7f5763fff640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5750005180 0x7f575000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:02.196 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.192+0000 7f575affd640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57500047c0 0x7f5750004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:02.197 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.194+0000 7f5763fff640 1 -- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57500047c0 msgr2=0x7f5750004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:02.197 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.194+0000 7f5763fff640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57500047c0 0x7f5750004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.197 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.194+0000 7f5763fff640 1 -- 172.21.15.169:0/654208763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57500039c0 msgr2=0x7f5750003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:02.197 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.194+0000 7f5763fff640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57500039c0 0x7f5750003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.197 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.194+0000 7f5763fff640 1 -- 172.21.15.169:0/654208763 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750003520 con 0x7f5750005180 2023-10-18T11:09:02.198 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.194+0000 7f5763fff640 1 -- 172.21.15.169:0/654208763 reap_dead start 2023-10-18T11:09:02.198 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.196+0000 7f5763fff640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5750005180 0x7f575000b980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f575c001d50 tx=0x7f57500057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f5891c7424f7f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:02.203 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.201+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c003970 con 0x7f5750005180 2023-10-18T11:09:02.203 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.201+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c003af0 con 0x7f5750005180 2023-10-18T11:09:02.203 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.201+0000 7f5762ffd640 1 -- 172.21.15.169:0/654208763 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c003ea0 con 0x7f5750005180 2023-10-18T11:09:02.204 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.201+0000 7f5768fa0640 1 -- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5750005180 msgr2=0x7f575000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.204 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.201+0000 7f5768fa0640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5750005180 0x7f575000b980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f575c001d50 tx=0x7f57500057f0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.204 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.201+0000 7f5768fa0640 1 -- 172.21.15.169:0/654208763 shutdown_connections 2023-10-18T11:09:02.205 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.201+0000 7f5768fa0640 1 --2- 172.21.15.169:0/654208763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5750005180 0x7f575000b980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.205 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.201+0000 7f5768fa0640 1 -- 172.21.15.169:0/654208763 >> 172.21.15.169:0/654208763 conn(0x7f576406aea0 msgr2=0x7f576406b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:02.205 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.202+0000 7f5768fa0640 1 -- 172.21.15.169:0/654208763 shutdown_connections 2023-10-18T11:09:02.205 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.202+0000 7f5768fa0640 1 -- 172.21.15.169:0/654208763 wait complete. 2023-10-18T11:09:02.206 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.203+0000 7f5768fa0640 1 Processor -- start 2023-10-18T11:09:02.206 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.203+0000 7f5768fa0640 1 -- start start 2023-10-18T11:09:02.206 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.204+0000 7f5768fa0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750005180 0x7f576406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.207 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.204+0000 7f5768fa0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57641e1700 0x7f57641e0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.207 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.204+0000 7f5768fa0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57641f16f0 0x7f57641f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.207 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.204+0000 7f5768fa0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5764144300 con 0x7f57641e1700 2023-10-18T11:09:02.207 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.204+0000 7f5768fa0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57641eed30 con 0x7f5750005180 2023-10-18T11:09:02.207 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.204+0000 7f5768fa0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57641ee180 con 0x7f57641f16f0 2023-10-18T11:09:02.208 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.204+0000 7f5763fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57641f16f0 0x7f57641f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:02.208 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.204+0000 7f57637fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750005180 0x7f576406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:02.208 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.205+0000 7f5763fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57641f16f0 0x7f57641f1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:52876/0 (socket says 172.21.15.169:52876) 2023-10-18T11:09:02.209 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.205+0000 7f5763fff640 1 -- 172.21.15.169:0/1322414421 learned_addr learned my addr 172.21.15.169:0/1322414421 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:02.210 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.208+0000 7f57637fe640 1 -- 172.21.15.169:0/1322414421 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57641f16f0 msgr2=0x7f57641f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.210 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.208+0000 7f57637fe640 1 --2- 172.21.15.169:0/1322414421 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57641f16f0 0x7f57641f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.211 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.208+0000 7f57637fe640 1 -- 172.21.15.169:0/1322414421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57641e1700 msgr2=0x7f57641e0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.211 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.208+0000 7f57637fe640 1 --2- 172.21.15.169:0/1322414421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57641e1700 0x7f57641e0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.211 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.208+0000 7f57637fe640 1 -- 172.21.15.169:0/1322414421 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57641ef150 con 0x7f5750005180 2023-10-18T11:09:02.212 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.210+0000 7f57637fe640 1 --2- 172.21.15.169:0/1322414421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750005180 0x7f576406a5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f575400c730 tx=0x7f575400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:02.217 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.214+0000 7f5760ff9640 1 -- 172.21.15.169:0/1322414421 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540072d0 con 0x7f5750005180 2023-10-18T11:09:02.217 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.214+0000 7f5760ff9640 1 -- 172.21.15.169:0/1322414421 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5754007430 con 0x7f5750005180 2023-10-18T11:09:02.217 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.214+0000 7f5768fa0640 1 -- 172.21.15.169:0/1322414421 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57641e1350 con 0x7f5750005180 2023-10-18T11:09:02.217 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.214+0000 7f5760ff9640 1 -- 172.21.15.169:0/1322414421 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540047e0 con 0x7f5750005180 2023-10-18T11:09:02.217 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.214+0000 7f5768fa0640 1 -- 172.21.15.169:0/1322414421 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57641ee390 con 0x7f5750005180 2023-10-18T11:09:02.218 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.215+0000 7f5768fa0640 1 -- 172.21.15.169:0/1322414421 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57641eee70 con 0x7f5750005180 2023-10-18T11:09:02.221 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:02.219+0000 7f5de022c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T11:09:02.277 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:02.275+0000 7f5de022c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T11:09:02.322 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.319+0000 7f5760ff9640 1 -- 172.21.15.169:0/1322414421 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5754004c40 con 0x7f5750005180 2023-10-18T11:09:02.323 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.319+0000 7f5760ff9640 1 -- 172.21.15.169:0/1322414421 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f575400ae30 con 0x7f5750005180 2023-10-18T11:09:02.323 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.319+0000 7f5760ff9640 1 -- 172.21.15.169:0/1322414421 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f57641eee70 con 0x7f5750005180 2023-10-18T11:09:02.386 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:02.383+0000 7f5de022c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T11:09:02.392 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.390+0000 7f5768fa0640 1 -- 172.21.15.169:0/1322414421 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3137ce35-4107-49be-ae80-3f8a3e82d70c", "id": 3} v 0) v1 -- 0x7f5764068fd0 con 0x7f5750005180 2023-10-18T11:09:02.505 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:02.503+0000 7f5de022c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T11:09:02.573 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.571+0000 7f5760ff9640 1 -- 172.21.15.169:0/1322414421 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3137ce35-4107-49be-ae80-3f8a3e82d70c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5754022060 con 0x7f5750005180 2023-10-18T11:09:02.573 INFO:teuthology.orchestra.run.smithi169.stdout:3 2023-10-18T11:09:02.574 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.572+0000 7f5768fa0640 1 -- 172.21.15.169:0/1322414421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750005180 msgr2=0x7f576406a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.575 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.572+0000 7f5768fa0640 1 --2- 172.21.15.169:0/1322414421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750005180 0x7f576406a5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f575400c730 tx=0x7f575400cbf0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.575 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.572+0000 7f5768fa0640 1 -- 172.21.15.169:0/1322414421 shutdown_connections 2023-10-18T11:09:02.575 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.572+0000 7f5768fa0640 1 --2- 172.21.15.169:0/1322414421 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57641f16f0 0x7f57641f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.575 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.572+0000 7f5768fa0640 1 --2- 172.21.15.169:0/1322414421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57641e1700 0x7f57641e0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.575 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.572+0000 7f5768fa0640 1 --2- 172.21.15.169:0/1322414421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5750005180 0x7f576406a5a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.576 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.572+0000 7f5768fa0640 1 -- 172.21.15.169:0/1322414421 >> 172.21.15.169:0/1322414421 conn(0x7f576406aea0 msgr2=0x7f57640c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:02.576 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.572+0000 7f5768fa0640 1 -- 172.21.15.169:0/1322414421 shutdown_connections 2023-10-18T11:09:02.576 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.572+0000 7f5768fa0640 1 -- 172.21.15.169:0/1322414421 wait complete. 2023-10-18T11:09:02.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 730e6e60-5cde-4954-8d8c-aae9c0ac7fd3 4 2023-10-18T11:09:02.671 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:02.668+0000 7f5de022c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T11:09:02.687 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.685+0000 7f39eeb1d640 1 Processor -- start 2023-10-18T11:09:02.687 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.685+0000 7f39eeb1d640 1 -- start start 2023-10-18T11:09:02.688 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.685+0000 7f39eeb1d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f39e80c3420 0x7f39e80659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.688 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.685+0000 7f39eeb1d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e8159120 con 0x7f39e80cd000 2023-10-18T11:09:02.688 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.685+0000 7f39eeb1d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e80c3800 con 0x7f39e8065f10 2023-10-18T11:09:02.688 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.685+0000 7f39eeb1d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e8066320 con 0x7f39e80c3420 2023-10-18T11:09:02.689 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.686+0000 7f39ec8b9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f39e80c3420 0x7f39e80659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:02.689 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.686+0000 7f39ec8b9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f39e80c3420 0x7f39e80659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51944/0 (socket says 172.21.15.169:51944) 2023-10-18T11:09:02.689 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.686+0000 7f39ec8b9640 1 -- 172.21.15.169:0/4117355036 learned_addr learned my addr 172.21.15.169:0/4117355036 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:02.691 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.689+0000 7f39ec8b9640 1 -- 172.21.15.169:0/4117355036 >> v1:172.21.15.169:6789/0 conn(0x7f39e8065f10 legacy=0x7f39e80c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.692 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.689+0000 7f39ec8b9640 1 -- 172.21.15.169:0/4117355036 >> v1:172.21.15.151:6789/0 conn(0x7f39e80cd000 legacy=0x7f39e806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.692 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.689+0000 7f39ec8b9640 1 -- 172.21.15.169:0/4117355036 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80c7bb0 con 0x7f39e80c3420 2023-10-18T11:09:02.695 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.693+0000 7f39ec8b9640 1 --2- 172.21.15.169:0/4117355036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39e80c3420 0x7f39e80659d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009e50 tx=0x7f39d802c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828940e1f7e2b8c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:02.699 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.696+0000 7f39e77fe640 1 -- 172.21.15.169:0/4117355036 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d802cbb0 con 0x7f39e80c3420 2023-10-18T11:09:02.699 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.696+0000 7f39e77fe640 1 -- 172.21.15.169:0/4117355036 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d802cd10 con 0x7f39e80c3420 2023-10-18T11:09:02.699 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.696+0000 7f39e77fe640 1 -- 172.21.15.169:0/4117355036 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8034610 con 0x7f39e80c3420 2023-10-18T11:09:02.700 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.697+0000 7f39eeb1d640 1 -- 172.21.15.169:0/4117355036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39e80c3420 msgr2=0x7f39e80659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.700 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.697+0000 7f39eeb1d640 1 --2- 172.21.15.169:0/4117355036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39e80c3420 0x7f39e80659d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009e50 tx=0x7f39d802c010 comp rx=0 tx=0).stop 2023-10-18T11:09:02.700 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.697+0000 7f39eeb1d640 1 -- 172.21.15.169:0/4117355036 shutdown_connections 2023-10-18T11:09:02.700 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.697+0000 7f39eeb1d640 1 --2- 172.21.15.169:0/4117355036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39e80c3420 0x7f39e80659d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.701 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.697+0000 7f39eeb1d640 1 -- 172.21.15.169:0/4117355036 >> 172.21.15.169:0/4117355036 conn(0x7f39e806e210 msgr2=0x7f39e806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:02.701 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.697+0000 7f39eeb1d640 1 -- 172.21.15.169:0/4117355036 shutdown_connections 2023-10-18T11:09:02.701 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.697+0000 7f39eeb1d640 1 -- 172.21.15.169:0/4117355036 wait complete. 2023-10-18T11:09:02.702 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.698+0000 7f39eeb1d640 1 Processor -- start 2023-10-18T11:09:02.702 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.698+0000 7f39eeb1d640 1 -- start start 2023-10-18T11:09:02.703 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.699+0000 7f39eeb1d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39e8065f10 0x7f39e8151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.703 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.699+0000 7f39eeb1d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e80c3420 0x7f39e80ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.703 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.699+0000 7f39eeb1d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39e80cd000 0x7f39e81f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:02.703 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.699+0000 7f39eeb1d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8151510 con 0x7f39e80c3420 2023-10-18T11:09:02.703 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.699+0000 7f39eeb1d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8150900 con 0x7f39e80cd000 2023-10-18T11:09:02.704 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.699+0000 7f39eeb1d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8150be0 con 0x7f39e8065f10 2023-10-18T11:09:02.704 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.700+0000 7f39ec8b9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39e8065f10 0x7f39e8151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:02.704 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.700+0000 7f39ed0ba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39e80cd000 0x7f39e81f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:02.704 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.700+0000 7f39ec8b9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39e8065f10 0x7f39e8151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:54068/0 (socket says 172.21.15.169:54068) 2023-10-18T11:09:02.704 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.700+0000 7f39ec8b9640 1 -- 172.21.15.169:0/2650086734 learned_addr learned my addr 172.21.15.169:0/2650086734 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:02.705 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.701+0000 7f39e7fff640 1 --2- 172.21.15.169:0/2650086734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e80c3420 0x7f39e80ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:02.706 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.704+0000 7f39ec8b9640 1 -- 172.21.15.169:0/2650086734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39e80cd000 msgr2=0x7f39e81f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.706 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.704+0000 7f39ec8b9640 1 --2- 172.21.15.169:0/2650086734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39e80cd000 0x7f39e81f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.706 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.704+0000 7f39ec8b9640 1 -- 172.21.15.169:0/2650086734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e80c3420 msgr2=0x7f39e80ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:02.706 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.704+0000 7f39ec8b9640 1 --2- 172.21.15.169:0/2650086734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e80c3420 0x7f39e80ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:02.707 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.704+0000 7f39ec8b9640 1 -- 172.21.15.169:0/2650086734 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d8009b30 con 0x7f39e8065f10 2023-10-18T11:09:02.708 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.706+0000 7f39ec8b9640 1 --2- 172.21.15.169:0/2650086734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39e8065f10 0x7f39e8151910 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39d8000f80 tx=0x7f39d8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:02.712 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.710+0000 7f39e57fa640 1 -- 172.21.15.169:0/2650086734 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d803e450 con 0x7f39e8065f10 2023-10-18T11:09:02.713 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.710+0000 7f39e57fa640 1 -- 172.21.15.169:0/2650086734 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d803e5f0 con 0x7f39e8065f10 2023-10-18T11:09:02.713 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.710+0000 7f39eeb1d640 1 -- 172.21.15.169:0/2650086734 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e8150ec0 con 0x7f39e8065f10 2023-10-18T11:09:02.713 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.710+0000 7f39e57fa640 1 -- 172.21.15.169:0/2650086734 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d803e9a0 con 0x7f39e8065f10 2023-10-18T11:09:02.713 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.710+0000 7f39eeb1d640 1 -- 172.21.15.169:0/2650086734 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e8151e50 con 0x7f39e8065f10 2023-10-18T11:09:02.714 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.711+0000 7f39eeb1d640 1 -- 172.21.15.169:0/2650086734 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e804e160 con 0x7f39e8065f10 2023-10-18T11:09:02.722 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:02.720+0000 7f5de022c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T11:09:02.880 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:02.878+0000 7f5de022c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T11:09:02.893 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.891+0000 7f39e57fa640 1 -- 172.21.15.169:0/2650086734 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f39d8051430 con 0x7f39e8065f10 2023-10-18T11:09:02.893 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.891+0000 7f39e57fa640 1 -- 172.21.15.169:0/2650086734 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f39d803ee00 con 0x7f39e8065f10 2023-10-18T11:09:02.894 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.891+0000 7f39e57fa640 1 -- 172.21.15.169:0/2650086734 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f39d8043020 con 0x7f39e8065f10 2023-10-18T11:09:02.967 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:02.965+0000 7f39eeb1d640 1 -- 172.21.15.169:0/2650086734 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "730e6e60-5cde-4954-8d8c-aae9c0ac7fd3", "id": 4} v 0) v1 -- 0x7f39e8150d20 con 0x7f39e8065f10 2023-10-18T11:09:02.977 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:02.975+0000 7f44d1614040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T11:09:03.153 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.151+0000 7f39e57fa640 1 -- 172.21.15.169:0/2650086734 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "730e6e60-5cde-4954-8d8c-aae9c0ac7fd3", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f39e8150d20 con 0x7f39e8065f10 2023-10-18T11:09:03.154 INFO:teuthology.orchestra.run.smithi169.stdout:4 2023-10-18T11:09:03.155 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.152+0000 7f39eeb1d640 1 -- 172.21.15.169:0/2650086734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39e8065f10 msgr2=0x7f39e8151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:03.155 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.152+0000 7f39eeb1d640 1 --2- 172.21.15.169:0/2650086734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39e8065f10 0x7f39e8151910 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39d8000f80 tx=0x7f39d8004a40 comp rx=0 tx=0).stop 2023-10-18T11:09:03.155 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.152+0000 7f39eeb1d640 1 -- 172.21.15.169:0/2650086734 shutdown_connections 2023-10-18T11:09:03.155 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.152+0000 7f39eeb1d640 1 --2- 172.21.15.169:0/2650086734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39e80cd000 0x7f39e81f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:03.156 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.152+0000 7f39eeb1d640 1 --2- 172.21.15.169:0/2650086734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e80c3420 0x7f39e80ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:03.156 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.152+0000 7f39eeb1d640 1 --2- 172.21.15.169:0/2650086734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39e8065f10 0x7f39e8151910 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:03.156 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.152+0000 7f39eeb1d640 1 -- 172.21.15.169:0/2650086734 >> 172.21.15.169:0/2650086734 conn(0x7f39e806e210 msgr2=0x7f39e8156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:03.156 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.152+0000 7f39eeb1d640 1 -- 172.21.15.169:0/2650086734 shutdown_connections 2023-10-18T11:09:03.156 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.153+0000 7f39eeb1d640 1 -- 172.21.15.169:0/2650086734 wait complete. 2023-10-18T11:09:03.165 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new bb556210-8cf7-4209-afba-79cf6d8001e3 5 2023-10-18T11:09:03.265 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.263+0000 7fabaf096640 1 Processor -- start 2023-10-18T11:09:03.265 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.263+0000 7fabaf096640 1 -- start start 2023-10-18T11:09:03.266 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:03.263+0000 7f44d1614040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T11:09:03.267 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.263+0000 7fabaf096640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:03.267 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.263+0000 7fabaf096640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faba815af50 0x7faba80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:03.267 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.264+0000 7fabaf096640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba8151470 con 0x7faba80cd190 2023-10-18T11:09:03.267 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.264+0000 7fabaf096640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba80c8f00 con 0x7faba815af50 2023-10-18T11:09:03.268 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.264+0000 7fabaf096640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba815aac0 con 0x7faba8151090 2023-10-18T11:09:03.268 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.264+0000 7fabace32640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:03.268 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.265+0000 7fabace32640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:54082/0 (socket says 172.21.15.169:54082) 2023-10-18T11:09:03.268 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.265+0000 7fabace32640 1 -- 172.21.15.169:0/4241232810 learned_addr learned my addr 172.21.15.169:0/4241232810 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:03.269 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.265+0000 7faba7fff640 1 --2- 172.21.15.169:0/4241232810 >> v2:172.21.15.151:3300/0 conn(0x7faba815af50 0x7faba80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:03.269 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.267+0000 7fabace32640 1 -- 172.21.15.169:0/4241232810 >> v2:172.21.15.151:3300/0 conn(0x7faba815af50 msgr2=0x7faba80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:03.269 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.267+0000 7fabace32640 1 --2- 172.21.15.169:0/4241232810 >> v2:172.21.15.151:3300/0 conn(0x7faba815af50 0x7faba80c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:03.270 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.267+0000 7fabace32640 1 -- 172.21.15.169:0/4241232810 >> v1:172.21.15.151:6789/0 conn(0x7faba80cd190 legacy=0x7faba80659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:03.270 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.267+0000 7fabace32640 1 -- 172.21.15.169:0/4241232810 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba8157220 con 0x7faba8151090 2023-10-18T11:09:03.271 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.269+0000 7fabace32640 1 --2- 172.21.15.169:0/4241232810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8156ce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009870 tx=0x7fab9c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62fb161d18e6e928 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:03.274 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.272+0000 7faba77fe640 1 -- 172.21.15.169:0/4241232810 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c031640 con 0x7faba8151090 2023-10-18T11:09:03.275 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.272+0000 7faba77fe640 1 -- 172.21.15.169:0/4241232810 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c0317a0 con 0x7faba8151090 2023-10-18T11:09:03.275 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.272+0000 7faba77fe640 1 -- 172.21.15.169:0/4241232810 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c031b30 con 0x7faba8151090 2023-10-18T11:09:03.276 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.273+0000 7fabaf096640 1 -- 172.21.15.169:0/4241232810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 msgr2=0x7faba8156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:03.276 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.273+0000 7fabaf096640 1 --2- 172.21.15.169:0/4241232810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8156ce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009870 tx=0x7fab9c02b8f0 comp rx=0 tx=0).stop 2023-10-18T11:09:03.276 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.273+0000 7fabaf096640 1 -- 172.21.15.169:0/4241232810 shutdown_connections 2023-10-18T11:09:03.276 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.273+0000 7fabaf096640 1 --2- 172.21.15.169:0/4241232810 >> v2:172.21.15.151:3300/0 conn(0x7faba815af50 0x7faba80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:03.277 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.273+0000 7fabaf096640 1 --2- 172.21.15.169:0/4241232810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8156ce0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:03.277 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.273+0000 7fabaf096640 1 -- 172.21.15.169:0/4241232810 >> 172.21.15.169:0/4241232810 conn(0x7faba806e210 msgr2=0x7faba806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:03.277 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.273+0000 7fabaf096640 1 -- 172.21.15.169:0/4241232810 shutdown_connections 2023-10-18T11:09:03.277 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.273+0000 7fabaf096640 1 -- 172.21.15.169:0/4241232810 wait complete. 2023-10-18T11:09:03.278 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.274+0000 7fabaf096640 1 Processor -- start 2023-10-18T11:09:03.279 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.274+0000 7fabaf096640 1 -- start start 2023-10-18T11:09:03.279 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.275+0000 7fabaf096640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80cd190 0x7faba80ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:03.279 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.275+0000 7fabaf096640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:03.279 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.275+0000 7fabaf096640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba815af50 0x7faba8155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:03.280 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.275+0000 7fabaf096640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba8159d00 con 0x7faba80cd190 2023-10-18T11:09:03.280 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.275+0000 7fabaf096640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba80cc1e0 con 0x7faba815af50 2023-10-18T11:09:03.280 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.275+0000 7fabaf096640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba8154fb0 con 0x7faba8151090 2023-10-18T11:09:03.280 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.276+0000 7faba7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:03.280 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.276+0000 7fabad633640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba815af50 0x7faba8155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:03.281 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.276+0000 7faba7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:54096/0 (socket says 172.21.15.169:54096) 2023-10-18T11:09:03.281 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.276+0000 7faba7fff640 1 -- 172.21.15.169:0/3468097814 learned_addr learned my addr 172.21.15.169:0/3468097814 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:03.281 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.277+0000 7fabace32640 1 --2- 172.21.15.169:0/3468097814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80cd190 0x7faba80ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:03.283 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.281+0000 7fabad633640 1 -- 172.21.15.169:0/3468097814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 msgr2=0x7faba8155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:03.283 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.281+0000 7fabad633640 1 --2- 172.21.15.169:0/3468097814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:03.284 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.281+0000 7fabad633640 1 -- 172.21.15.169:0/3468097814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80cd190 msgr2=0x7faba80ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:03.284 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.281+0000 7fabad633640 1 --2- 172.21.15.169:0/3468097814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80cd190 0x7faba80ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:03.284 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.281+0000 7fabad633640 1 -- 172.21.15.169:0/3468097814 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0094d0 con 0x7faba815af50 2023-10-18T11:09:03.286 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.284+0000 7fabad633640 1 --2- 172.21.15.169:0/3468097814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba815af50 0x7faba8155980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faba000be20 tx=0x7faba000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:03.290 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.287+0000 7faba57fa640 1 -- 172.21.15.169:0/3468097814 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000ce10 con 0x7faba815af50 2023-10-18T11:09:03.290 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.288+0000 7faba57fa640 1 -- 172.21.15.169:0/3468097814 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba0014440 con 0x7faba815af50 2023-10-18T11:09:03.290 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.288+0000 7faba57fa640 1 -- 172.21.15.169:0/3468097814 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0014830 con 0x7faba815af50 2023-10-18T11:09:03.290 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.288+0000 7fabaf096640 1 -- 172.21.15.169:0/3468097814 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba81594f0 con 0x7faba815af50 2023-10-18T11:09:03.291 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.288+0000 7fabaf096640 1 -- 172.21.15.169:0/3468097814 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba8159210 con 0x7faba815af50 2023-10-18T11:09:03.291 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.289+0000 7fabaf096640 1 -- 172.21.15.169:0/3468097814 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba804e160 con 0x7faba815af50 2023-10-18T11:09:03.293 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.291+0000 7faba57fa640 1 -- 172.21.15.169:0/3468097814 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faba0014c90 con 0x7faba815af50 2023-10-18T11:09:03.293 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.291+0000 7faba57fa640 1 -- 172.21.15.169:0/3468097814 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7faba001d950 con 0x7faba815af50 2023-10-18T11:09:03.321 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:03.319+0000 7f44d1614040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T11:09:03.395 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.393+0000 7faba57fa640 1 -- 172.21.15.169:0/3468097814 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7faba0019070 con 0x7faba815af50 2023-10-18T11:09:03.427 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:03.425+0000 7f44d1614040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T11:09:03.493 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.491+0000 7fabaf096640 1 -- 172.21.15.169:0/3468097814 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb556210-8cf7-4209-afba-79cf6d8001e3", "id": 5} v 0) v1 -- 0x7faba81550f0 con 0x7faba815af50 2023-10-18T11:09:03.877 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:03.874+0000 7faba57fa640 1 -- 172.21.15.169:0/3468097814 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7faba001ed50 con 0x7faba815af50 2023-10-18T11:09:03.966 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:03.964+0000 7f5de022c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T11:09:03.977 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:03.975+0000 7f44cbb6e640 -1 mgr handle_mgr_map I was active but no longer am 2023-10-18T11:09:04.284 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:04.281+0000 7f5de022c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T11:09:04.318 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.316+0000 7faba57fa640 1 -- 172.21.15.169:0/3468097814 <== mon.1 v2:172.21.15.169:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb556210-8cf7-4209-afba-79cf6d8001e3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7faba0025c90 con 0x7faba815af50 2023-10-18T11:09:04.319 INFO:teuthology.orchestra.run.smithi169.stdout:5 2023-10-18T11:09:04.320 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.317+0000 7fabaf096640 1 -- 172.21.15.169:0/3468097814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba815af50 msgr2=0x7faba8155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:04.320 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.317+0000 7fabaf096640 1 --2- 172.21.15.169:0/3468097814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba815af50 0x7faba8155980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faba000be20 tx=0x7faba000bf10 comp rx=0 tx=0).stop 2023-10-18T11:09:04.320 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.317+0000 7fabaf096640 1 -- 172.21.15.169:0/3468097814 shutdown_connections 2023-10-18T11:09:04.320 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.317+0000 7fabaf096640 1 --2- 172.21.15.169:0/3468097814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba815af50 0x7faba8155980 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.321 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.317+0000 7fabaf096640 1 --2- 172.21.15.169:0/3468097814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba8151090 0x7faba8155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.321 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.317+0000 7fabaf096640 1 --2- 172.21.15.169:0/3468097814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80cd190 0x7faba80ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.321 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.317+0000 7fabaf096640 1 -- 172.21.15.169:0/3468097814 >> 172.21.15.169:0/3468097814 conn(0x7faba806e210 msgr2=0x7faba80affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:04.321 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.317+0000 7fabaf096640 1 -- 172.21.15.169:0/3468097814 shutdown_connections 2023-10-18T11:09:04.321 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.317+0000 7fabaf096640 1 -- 172.21.15.169:0/3468097814 wait complete. 2023-10-18T11:09:04.330 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new b9baf093-0094-46c4-950d-6f5e871db091 6 2023-10-18T11:09:04.348 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:04.346+0000 7f5de022c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T11:09:04.397 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:04.394+0000 7f7b8e245040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T11:09:04.435 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.432+0000 7f15dc300640 1 Processor -- start 2023-10-18T11:09:04.435 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.432+0000 7f15dc300640 1 -- start start 2023-10-18T11:09:04.436 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.433+0000 7f15dc300640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f15d40cbe20 0x7f15d415d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.436 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.433+0000 7f15dc300640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f15d40c9650 0x7f15d40c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.436 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.433+0000 7f15dc300640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d4153870 con 0x7f15d40b1340 2023-10-18T11:09:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.433+0000 7f15dc300640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40cc200 con 0x7f15d40cbe20 2023-10-18T11:09:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.433+0000 7f15dc300640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40b1e30 con 0x7f15d40c9650 2023-10-18T11:09:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.434+0000 7f15da89d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f15d40c9650 0x7f15d40c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:04.437 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.434+0000 7f15da89d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f15d40c9650 0x7f15d40c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51992/0 (socket says 172.21.15.169:51992) 2023-10-18T11:09:04.438 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.434+0000 7f15da89d640 1 -- 172.21.15.169:0/1496201577 learned_addr learned my addr 172.21.15.169:0/1496201577 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:04.439 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.436+0000 7f15da89d640 1 -- 172.21.15.169:0/1496201577 >> v2:172.21.15.151:3300/0 conn(0x7f15d40cbe20 msgr2=0x7f15d415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:04.439 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.436+0000 7f15da89d640 1 --2- 172.21.15.169:0/1496201577 >> v2:172.21.15.151:3300/0 conn(0x7f15d40cbe20 0x7f15d415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.439 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.436+0000 7f15da89d640 1 -- 172.21.15.169:0/1496201577 >> v1:172.21.15.151:6789/0 conn(0x7f15d40b1340 legacy=0x7f15d40cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:04.439 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.436+0000 7f15da89d640 1 -- 172.21.15.169:0/1496201577 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d41590d0 con 0x7f15d40c9650 2023-10-18T11:09:04.440 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.438+0000 7f15da89d640 1 --2- 172.21.15.169:0/1496201577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40c9650 0x7f15d40c9ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15d40c8e40 tx=0x7f15cc02bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d81511693e250b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:04.444 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.442+0000 7f15d909a640 1 -- 172.21.15.169:0/1496201577 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc02cb20 con 0x7f15d40c9650 2023-10-18T11:09:04.444 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.442+0000 7f15d909a640 1 -- 172.21.15.169:0/1496201577 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc02cc80 con 0x7f15d40c9650 2023-10-18T11:09:04.445 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.442+0000 7f15d909a640 1 -- 172.21.15.169:0/1496201577 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0343f0 con 0x7f15d40c9650 2023-10-18T11:09:04.446 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.443+0000 7f15dc300640 1 -- 172.21.15.169:0/1496201577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40c9650 msgr2=0x7f15d40c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:04.446 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.443+0000 7f15dc300640 1 --2- 172.21.15.169:0/1496201577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40c9650 0x7f15d40c9ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15d40c8e40 tx=0x7f15cc02bf80 comp rx=0 tx=0).stop 2023-10-18T11:09:04.446 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.443+0000 7f15dc300640 1 -- 172.21.15.169:0/1496201577 shutdown_connections 2023-10-18T11:09:04.446 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.443+0000 7f15dc300640 1 --2- 172.21.15.169:0/1496201577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40c9650 0x7f15d40c9ac0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.447 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.443+0000 7f15dc300640 1 --2- 172.21.15.169:0/1496201577 >> v2:172.21.15.151:3300/0 conn(0x7f15d40cbe20 0x7f15d415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.447 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.443+0000 7f15dc300640 1 -- 172.21.15.169:0/1496201577 >> 172.21.15.169:0/1496201577 conn(0x7f15d40659d0 msgr2=0x7f15d4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:04.447 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.443+0000 7f15dc300640 1 -- 172.21.15.169:0/1496201577 shutdown_connections 2023-10-18T11:09:04.447 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.443+0000 7f15dc300640 1 -- 172.21.15.169:0/1496201577 wait complete. 2023-10-18T11:09:04.448 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:04.444+0000 7f7b8e245040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T11:09:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.444+0000 7f15dc300640 1 Processor -- start 2023-10-18T11:09:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.444+0000 7f15dc300640 1 -- start start 2023-10-18T11:09:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.445+0000 7f15dc300640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40b1340 0x7f15d41f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.445+0000 7f15dc300640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15d40c9650 0x7f15d414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.449 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.445+0000 7f15dc300640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15d40cbe20 0x7f15d414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.450 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.445+0000 7f15dc300640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40cf400 con 0x7f15d40cbe20 2023-10-18T11:09:04.450 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.445+0000 7f15dc300640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4151940 con 0x7f15d40b1340 2023-10-18T11:09:04.450 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.445+0000 7f15dc300640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d41f2730 con 0x7f15d40c9650 2023-10-18T11:09:04.450 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.445+0000 7f15da09c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40b1340 0x7f15d41f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:04.451 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.445+0000 7f15d989b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15d40c9650 0x7f15d414ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:04.451 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.446+0000 7f15da09c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40b1340 0x7f15d41f1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:52000/0 (socket says 172.21.15.169:52000) 2023-10-18T11:09:04.451 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.446+0000 7f15da09c640 1 -- 172.21.15.169:0/2462285798 learned_addr learned my addr 172.21.15.169:0/2462285798 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:04.452 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.449+0000 7f15da09c640 1 -- 172.21.15.169:0/2462285798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15d40c9650 msgr2=0x7f15d414ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:04.452 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.449+0000 7f15da09c640 1 --2- 172.21.15.169:0/2462285798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15d40c9650 0x7f15d414ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.452 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.449+0000 7f15da09c640 1 -- 172.21.15.169:0/2462285798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15d40cbe20 msgr2=0x7f15d414f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:04.452 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.449+0000 7f15da09c640 1 --2- 172.21.15.169:0/2462285798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15d40cbe20 0x7f15d414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.453 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.449+0000 7f15da09c640 1 -- 172.21.15.169:0/2462285798 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc009b30 con 0x7f15d40b1340 2023-10-18T11:09:04.453 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.451+0000 7f15da09c640 1 --2- 172.21.15.169:0/2462285798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40b1340 0x7f15d41f1a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f15c400b410 tx=0x7f15c400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:04.457 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.455+0000 7f15caffd640 1 -- 172.21.15.169:0/2462285798 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4011830 con 0x7f15d40b1340 2023-10-18T11:09:04.457 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.455+0000 7f15caffd640 1 -- 172.21.15.169:0/2462285798 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c4011990 con 0x7f15d40b1340 2023-10-18T11:09:04.457 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.455+0000 7f15caffd640 1 -- 172.21.15.169:0/2462285798 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4011d40 con 0x7f15d40b1340 2023-10-18T11:09:04.458 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.455+0000 7f15dc300640 1 -- 172.21.15.169:0/2462285798 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d4150f20 con 0x7f15d40b1340 2023-10-18T11:09:04.458 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.455+0000 7f15dc300640 1 -- 172.21.15.169:0/2462285798 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d41508d0 con 0x7f15d40b1340 2023-10-18T11:09:04.458 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.456+0000 7f15dc300640 1 -- 172.21.15.169:0/2462285798 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d404e160 con 0x7f15d40b1340 2023-10-18T11:09:04.469 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.467+0000 7f15caffd640 1 -- 172.21.15.169:0/2462285798 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7f15c401a400 con 0x7f15d40b1340 2023-10-18T11:09:04.473 INFO:tasks.ceph.mgr.y.smithi151.stderr:2023-10-18T11:09:04.471+0000 7f5de022c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T11:09:04.582 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.579+0000 7f15caffd640 1 -- 172.21.15.169:0/2462285798 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f15c401ae10 con 0x7f15d40b1340 2023-10-18T11:09:04.582 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.580+0000 7f15caffd640 1 -- 172.21.15.169:0/2462285798 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f15c40233e0 con 0x7f15d40b1340 2023-10-18T11:09:04.667 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.665+0000 7f15dc300640 1 -- 172.21.15.169:0/2462285798 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b9baf093-0094-46c4-950d-6f5e871db091", "id": 6} v 0) v1 -- 0x7f15d40ca200 con 0x7f15d40b1340 2023-10-18T11:09:04.796 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.794+0000 7f15caffd640 1 -- 172.21.15.169:0/2462285798 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9baf093-0094-46c4-950d-6f5e871db091", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f15c4028070 con 0x7f15d40b1340 2023-10-18T11:09:04.796 INFO:teuthology.orchestra.run.smithi169.stdout:6 2023-10-18T11:09:04.797 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.795+0000 7f15dc300640 1 -- 172.21.15.169:0/2462285798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40b1340 msgr2=0x7f15d41f1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:04.798 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.795+0000 7f15dc300640 1 --2- 172.21.15.169:0/2462285798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40b1340 0x7f15d41f1a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f15c400b410 tx=0x7f15c400b8d0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.798 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.795+0000 7f15dc300640 1 -- 172.21.15.169:0/2462285798 shutdown_connections 2023-10-18T11:09:04.798 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.795+0000 7f15dc300640 1 --2- 172.21.15.169:0/2462285798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15d40cbe20 0x7f15d414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.798 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.795+0000 7f15dc300640 1 --2- 172.21.15.169:0/2462285798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15d40c9650 0x7f15d414ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.799 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.795+0000 7f15dc300640 1 --2- 172.21.15.169:0/2462285798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d40b1340 0x7f15d41f1a90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.799 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.795+0000 7f15dc300640 1 -- 172.21.15.169:0/2462285798 >> 172.21.15.169:0/2462285798 conn(0x7f15d40659d0 msgr2=0x7f15d40ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:04.799 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.795+0000 7f15dc300640 1 -- 172.21.15.169:0/2462285798 shutdown_connections 2023-10-18T11:09:04.799 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.795+0000 7f15dc300640 1 -- 172.21.15.169:0/2462285798 wait complete. 2023-10-18T11:09:04.807 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 41020b58-5044-4f0d-9d6c-515548f2d300 7 2023-10-18T11:09:04.887 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:04.885+0000 7f7b8e245040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T11:09:04.910 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.908+0000 7f7016226640 1 Processor -- start 2023-10-18T11:09:04.910 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.908+0000 7f7016226640 1 -- start start 2023-10-18T11:09:04.911 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.909+0000 7f7016226640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f70100cbe20 0x7f701015d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.912 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.909+0000 7f7016226640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100b1340 0x7f70100cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.912 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.909+0000 7f7016226640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f70100c9650 0x7f70100c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.912 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.909+0000 7f7016226640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7010153870 con 0x7f70100c9650 2023-10-18T11:09:04.912 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.909+0000 7f7016226640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70100cc200 con 0x7f70100cbe20 2023-10-18T11:09:04.912 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.909+0000 7f7016226640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70100b1e30 con 0x7f70100b1340 2023-10-18T11:09:04.913 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.909+0000 7f700effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100b1340 0x7f70100cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:04.913 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.909+0000 7f700f7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f70100cbe20 0x7f701015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:04.913 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.910+0000 7f700f7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f70100cbe20 0x7f701015d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:52012/0 (socket says 172.21.15.169:52012) 2023-10-18T11:09:04.914 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.910+0000 7f700f7fe640 1 -- 172.21.15.169:0/3313496919 learned_addr learned my addr 172.21.15.169:0/3313496919 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:04.914 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.910+0000 7f700ffff640 1 --2- 172.21.15.169:0/3313496919 >> v2:172.21.15.151:3300/0 conn(0x7f70100c9650 0x7f70100c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:04.914 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.912+0000 7f700f7fe640 1 -- 172.21.15.169:0/3313496919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100b1340 msgr2=0x7f70100cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:04.915 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.912+0000 7f700f7fe640 1 --2- 172.21.15.169:0/3313496919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100b1340 0x7f70100cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.915 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.912+0000 7f700f7fe640 1 -- 172.21.15.169:0/3313496919 >> v2:172.21.15.151:3300/0 conn(0x7f70100c9650 msgr2=0x7f70100c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:04.915 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.912+0000 7f700f7fe640 1 --2- 172.21.15.169:0/3313496919 >> v2:172.21.15.151:3300/0 conn(0x7f70100c9650 0x7f70100c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.915 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.912+0000 7f700f7fe640 1 -- 172.21.15.169:0/3313496919 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70101590d0 con 0x7f70100cbe20 2023-10-18T11:09:04.916 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.914+0000 7f700f7fe640 1 --2- 172.21.15.169:0/3313496919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70100cbe20 0x7f701015d170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f701008c5c0 tx=0x7f700402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecdff1b711704902 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:04.920 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.917+0000 7f700e7fc640 1 -- 172.21.15.169:0/3313496919 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004030860 con 0x7f70100cbe20 2023-10-18T11:09:04.920 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.917+0000 7f700e7fc640 1 -- 172.21.15.169:0/3313496919 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70040309c0 con 0x7f70100cbe20 2023-10-18T11:09:04.920 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.917+0000 7f700e7fc640 1 -- 172.21.15.169:0/3313496919 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004030d50 con 0x7f70100cbe20 2023-10-18T11:09:04.921 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.918+0000 7f7016226640 1 -- 172.21.15.169:0/3313496919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70100cbe20 msgr2=0x7f701015d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:04.922 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.918+0000 7f7016226640 1 --2- 172.21.15.169:0/3313496919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70100cbe20 0x7f701015d170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f701008c5c0 tx=0x7f700402b9a0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.922 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.918+0000 7f7016226640 1 -- 172.21.15.169:0/3313496919 shutdown_connections 2023-10-18T11:09:04.922 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.918+0000 7f7016226640 1 --2- 172.21.15.169:0/3313496919 >> v2:172.21.15.151:3300/0 conn(0x7f70100c9650 0x7f70100c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.922 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.918+0000 7f7016226640 1 --2- 172.21.15.169:0/3313496919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100b1340 0x7f70100cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.922 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.919+0000 7f7016226640 1 --2- 172.21.15.169:0/3313496919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70100cbe20 0x7f701015d170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.923 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.919+0000 7f7016226640 1 -- 172.21.15.169:0/3313496919 >> 172.21.15.169:0/3313496919 conn(0x7f70100659d0 msgr2=0x7f7010065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:04.923 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.919+0000 7f7016226640 1 -- 172.21.15.169:0/3313496919 shutdown_connections 2023-10-18T11:09:04.923 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.919+0000 7f7016226640 1 -- 172.21.15.169:0/3313496919 wait complete. 2023-10-18T11:09:04.924 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.920+0000 7f7016226640 1 Processor -- start 2023-10-18T11:09:04.924 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.920+0000 7f7016226640 1 -- start start 2023-10-18T11:09:04.925 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.921+0000 7f7016226640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70100b1340 0x7f7010154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.925 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.921+0000 7f7016226640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70100c9650 0x7f70101517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.925 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.921+0000 7f7016226640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100cbe20 0x7f70101eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:04.925 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.921+0000 7f7016226640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7010152970 con 0x7f70100c9650 2023-10-18T11:09:04.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.921+0000 7f7016226640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70101ef0b0 con 0x7f70100b1340 2023-10-18T11:09:04.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.921+0000 7f7016226640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70101523b0 con 0x7f70100cbe20 2023-10-18T11:09:04.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.921+0000 7f700f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70100b1340 0x7f7010154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:04.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.921+0000 7f700ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100cbe20 0x7f70101eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:04.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.922+0000 7f700ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100cbe20 0x7f70101eff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:54124/0 (socket says 172.21.15.169:54124) 2023-10-18T11:09:04.927 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.922+0000 7f700ffff640 1 -- 172.21.15.169:0/1110660711 learned_addr learned my addr 172.21.15.169:0/1110660711 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-10-18T11:09:04.927 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.923+0000 7f700effd640 1 --2- 172.21.15.169:0/1110660711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70100c9650 0x7f70101517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:04.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.925+0000 7f700ffff640 1 -- 172.21.15.169:0/1110660711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70100b1340 msgr2=0x7f7010154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:04.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.925+0000 7f700ffff640 1 --2- 172.21.15.169:0/1110660711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70100b1340 0x7f7010154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.925+0000 7f700ffff640 1 -- 172.21.15.169:0/1110660711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70100c9650 msgr2=0x7f70101517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:04.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.925+0000 7f700ffff640 1 --2- 172.21.15.169:0/1110660711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70100c9650 0x7f70101517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:04.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.925+0000 7f700ffff640 1 -- 172.21.15.169:0/1110660711 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70040094d0 con 0x7f70100cbe20 2023-10-18T11:09:04.929 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.927+0000 7f700ffff640 1 --2- 172.21.15.169:0/1110660711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100cbe20 0x7f70101eff90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7008007e40 tx=0x7f700800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:04.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.931+0000 7f6ff7fff640 1 -- 172.21.15.169:0/1110660711 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008014620 con 0x7f70100cbe20 2023-10-18T11:09:04.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.931+0000 7f6ff7fff640 1 -- 172.21.15.169:0/1110660711 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700800ee90 con 0x7f70100cbe20 2023-10-18T11:09:04.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.931+0000 7f7016226640 1 -- 172.21.15.169:0/1110660711 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7010152690 con 0x7f70100cbe20 2023-10-18T11:09:04.934 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.931+0000 7f6ff7fff640 1 -- 172.21.15.169:0/1110660711 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080149e0 con 0x7f70100cbe20 2023-10-18T11:09:04.934 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.931+0000 7f7016226640 1 -- 172.21.15.169:0/1110660711 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70101efa70 con 0x7f70100cbe20 2023-10-18T11:09:04.934 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:04.932+0000 7f7016226640 1 -- 172.21.15.169:0/1110660711 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70100c6070 con 0x7f70100cbe20 2023-10-18T11:09:04.939 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:04.937+0000 7f7b8e245040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T11:09:04.983 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:04.981+0000 7f7b8e245040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T11:09:05.038 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.036+0000 7f7b8e245040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T11:09:05.044 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.042+0000 7f6ff7fff640 1 -- 172.21.15.169:0/1110660711 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7f7008014b40 con 0x7f70100cbe20 2023-10-18T11:09:05.053 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.051+0000 7f6ff7fff640 1 -- 172.21.15.169:0/1110660711 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7008013d10 con 0x7f70100cbe20 2023-10-18T11:09:05.054 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.051+0000 7f6ff7fff640 1 -- 172.21.15.169:0/1110660711 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7008013b30 con 0x7f70100cbe20 2023-10-18T11:09:05.086 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.084+0000 7f7b8e245040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T11:09:05.125 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.123+0000 7f7016226640 1 -- 172.21.15.169:0/1110660711 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "41020b58-5044-4f0d-9d6c-515548f2d300", "id": 7} v 0) v1 -- 0x7f701004e160 con 0x7f70100cbe20 2023-10-18T11:09:05.186 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.184+0000 7f7b8e245040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-18T11:09:05.240 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.238+0000 7f7b8e245040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T11:09:05.284 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.282+0000 7f7b8e245040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T11:09:05.330 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.328+0000 7f6ff7fff640 1 -- 172.21.15.169:0/1110660711 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "41020b58-5044-4f0d-9d6c-515548f2d300", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f70080083a0 con 0x7f70100cbe20 2023-10-18T11:09:05.330 INFO:teuthology.orchestra.run.smithi169.stdout:7 2023-10-18T11:09:05.332 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.329+0000 7f7016226640 1 -- 172.21.15.169:0/1110660711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100cbe20 msgr2=0x7f70101eff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:05.332 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.329+0000 7f7016226640 1 --2- 172.21.15.169:0/1110660711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100cbe20 0x7f70101eff90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7008007e40 tx=0x7f700800e4b0 comp rx=0 tx=0).stop 2023-10-18T11:09:05.332 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.329+0000 7f7016226640 1 -- 172.21.15.169:0/1110660711 shutdown_connections 2023-10-18T11:09:05.332 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.329+0000 7f7016226640 1 --2- 172.21.15.169:0/1110660711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70100cbe20 0x7f70101eff90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:05.332 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.329+0000 7f7016226640 1 --2- 172.21.15.169:0/1110660711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70100c9650 0x7f70101517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:05.333 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.329+0000 7f7016226640 1 --2- 172.21.15.169:0/1110660711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70100b1340 0x7f7010154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:05.333 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.329+0000 7f7016226640 1 -- 172.21.15.169:0/1110660711 >> 172.21.15.169:0/1110660711 conn(0x7f70100659d0 msgr2=0x7f70100c6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:05.333 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.329+0000 7f7016226640 1 -- 172.21.15.169:0/1110660711 shutdown_connections 2023-10-18T11:09:05.333 INFO:teuthology.orchestra.run.smithi169.stderr:2023-10-18T11:09:05.329+0000 7f7016226640 1 -- 172.21.15.169:0/1110660711 wait complete. 2023-10-18T11:09:05.334 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.331+0000 7f7b8e245040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T11:09:05.341 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-18T11:09:05.342 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-10-18T11:09:05.351 INFO:tasks.ceph.osd.0:Started 2023-10-18T11:09:05.352 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-18T11:09:05.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-10-18T11:09:05.360 INFO:tasks.ceph.osd.1:Started 2023-10-18T11:09:05.360 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-18T11:09:05.361 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-10-18T11:09:05.366 INFO:tasks.ceph.osd.2:Started 2023-10-18T11:09:05.367 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-18T11:09:05.367 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-10-18T11:09:05.374 INFO:tasks.ceph.osd.3:Started 2023-10-18T11:09:05.374 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-18T11:09:05.374 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-10-18T11:09:05.377 INFO:tasks.ceph.osd.4:Started 2023-10-18T11:09:05.377 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-18T11:09:05.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-10-18T11:09:05.379 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.376+0000 7f7b8e245040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T11:09:05.380 INFO:tasks.ceph.osd.5:Started 2023-10-18T11:09:05.381 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-18T11:09:05.381 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-10-18T11:09:05.383 INFO:tasks.ceph.osd.6:Started 2023-10-18T11:09:05.384 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-18T11:09:05.384 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-10-18T11:09:05.386 INFO:tasks.ceph.osd.7:Started 2023-10-18T11:09:05.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:05.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.615+0000 7feec1002640 1 Processor -- start 2023-10-18T11:09:05.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.616+0000 7feec1002640 1 -- start start 2023-10-18T11:09:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.617+0000 7feec1002640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feebc150ec0 0x7feebc157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.617+0000 7feec1002640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feebc0c6820 con 0x7feebc0c5080 2023-10-18T11:09:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.617+0000 7feec1002640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feebc0c6b00 con 0x7feebc0c57a0 2023-10-18T11:09:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.617+0000 7feec1002640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc0c3b00 con 0x7feebc150ec0 2023-10-18T11:09:05.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.617+0000 7feeba59c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7feebc0c57a0 0x7feebc06d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47346/0 (socket says 172.21.15.151:47346) 2023-10-18T11:09:05.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.617+0000 7feeba59c640 1 -- 172.21.15.151:0/1076397015 learned_addr learned my addr 172.21.15.151:0/1076397015 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:05.750 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.748+0000 7f7b8e245040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-18T11:09:05.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.753+0000 7feeb9d9b640 1 -- 172.21.15.151:0/1076397015 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277263156 0 0) 0x7feebc0c6b00 con 0x7feebc0c57a0 2023-10-18T11:09:05.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.753+0000 7feeb9d9b640 1 -- 172.21.15.151:0/1076397015 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea4003520 con 0x7feebc0c57a0 2023-10-18T11:09:05.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.760+0000 7feebad9d640 1 --2- 172.21.15.151:0/1076397015 >> v2:172.21.15.151:3300/0 conn(0x7feebc150ec0 0x7feebc157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:05.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.770+0000 7feebad9d640 1 -- 172.21.15.151:0/1076397015 >> v1:172.21.15.169:6789/0 conn(0x7feebc0c57a0 legacy=0x7feebc06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:05.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.770+0000 7feebad9d640 1 -- 172.21.15.151:0/1076397015 >> v1:172.21.15.151:6789/0 conn(0x7feebc0c5080 legacy=0x7feebc15a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:05.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.770+0000 7feebad9d640 1 -- 172.21.15.151:0/1076397015 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0c1ab0 con 0x7feebc150ec0 2023-10-18T11:09:05.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.786+0000 7feebad9d640 1 --2- 172.21.15.151:0/1076397015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feebc150ec0 0x7feebc157790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feeac0097a0 tx=0x7feeac02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3816b87a56f8bfbe server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:05.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.821+0000 7feeb9d9b640 1 -- 172.21.15.151:0/1076397015 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac030610 con 0x7feebc150ec0 2023-10-18T11:09:05.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.821+0000 7feeb9d9b640 1 -- 172.21.15.151:0/1076397015 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac030770 con 0x7feebc150ec0 2023-10-18T11:09:05.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.821+0000 7feeb9d9b640 1 -- 172.21.15.151:0/1076397015 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac030b00 con 0x7feebc150ec0 2023-10-18T11:09:05.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.823+0000 7feec1002640 1 -- 172.21.15.151:0/1076397015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feebc150ec0 msgr2=0x7feebc157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:05.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.823+0000 7feec1002640 1 --2- 172.21.15.151:0/1076397015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feebc150ec0 0x7feebc157790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feeac0097a0 tx=0x7feeac02b960 comp rx=0 tx=0).stop 2023-10-18T11:09:05.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.823+0000 7feec1002640 1 -- 172.21.15.151:0/1076397015 shutdown_connections 2023-10-18T11:09:05.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.823+0000 7feec1002640 1 --2- 172.21.15.151:0/1076397015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feebc150ec0 0x7feebc157790 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:05.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.823+0000 7feec1002640 1 -- 172.21.15.151:0/1076397015 >> 172.21.15.151:0/1076397015 conn(0x7feebc0c6f10 msgr2=0x7feebc0c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:05.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.823+0000 7feec1002640 1 -- 172.21.15.151:0/1076397015 shutdown_connections 2023-10-18T11:09:05.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.823+0000 7feec1002640 1 -- 172.21.15.151:0/1076397015 wait complete. 2023-10-18T11:09:05.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.828+0000 7feec1002640 1 Processor -- start 2023-10-18T11:09:05.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.828+0000 7feec1002640 1 -- start start 2023-10-18T11:09:05.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.831+0000 7feec1002640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feebc0c5080 0x7feebc1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:05.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.831+0000 7feec1002640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feebc0c57a0 0x7feebc153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:05.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.831+0000 7feec1002640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feebc150ec0 0x7feebc1e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:05.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.831+0000 7feec1002640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc154180 con 0x7feebc150ec0 2023-10-18T11:09:05.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.831+0000 7feec1002640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc1e10b0 con 0x7feebc0c5080 2023-10-18T11:09:05.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.831+0000 7feec1002640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0c2d40 con 0x7feebc0c57a0 2023-10-18T11:09:05.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.832+0000 7feebb59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feebc150ec0 0x7feebc1e2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:05.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.832+0000 7feebad9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feebc0c5080 0x7feebc1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:05.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.832+0000 7feeba59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feebc0c57a0 0x7feebc153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:05.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.832+0000 7feebad9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feebc0c5080 0x7feebc1535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:34618/0 (socket says 172.21.15.151:34618) 2023-10-18T11:09:05.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.832+0000 7feebad9d640 1 -- 172.21.15.151:0/3903344382 learned_addr learned my addr 172.21.15.151:0/3903344382 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:05.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.835+0000 7feebad9d640 1 -- 172.21.15.151:0/3903344382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feebc0c57a0 msgr2=0x7feebc153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:05.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.835+0000 7feebad9d640 1 --2- 172.21.15.151:0/3903344382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feebc0c57a0 0x7feebc153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:05.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.835+0000 7feebad9d640 1 -- 172.21.15.151:0/3903344382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feebc150ec0 msgr2=0x7feebc1e2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:05.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.835+0000 7feebad9d640 1 --2- 172.21.15.151:0/3903344382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feebc150ec0 0x7feebc1e2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:05.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.835+0000 7feebad9d640 1 -- 172.21.15.151:0/3903344382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac009400 con 0x7feebc0c5080 2023-10-18T11:09:05.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.838+0000 7feebad9d640 1 --2- 172.21.15.151:0/3903344382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feebc0c5080 0x7feebc1535e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feeac02bf70 tx=0x7feeac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:05.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.841+0000 7feea37fe640 1 -- 172.21.15.151:0/3903344382 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac03e070 con 0x7feebc0c5080 2023-10-18T11:09:05.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.841+0000 7feea37fe640 1 -- 172.21.15.151:0/3903344382 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac030e10 con 0x7feebc0c5080 2023-10-18T11:09:05.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.841+0000 7feea37fe640 1 -- 172.21.15.151:0/3903344382 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac039c30 con 0x7feebc0c5080 2023-10-18T11:09:05.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.841+0000 7feec1002640 1 -- 172.21.15.151:0/3903344382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc1e13f0 con 0x7feebc0c5080 2023-10-18T11:09:05.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.841+0000 7feec1002640 1 -- 172.21.15.151:0/3903344382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc1e3e00 con 0x7feebc0c5080 2023-10-18T11:09:05.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.843+0000 7feec1002640 1 -- 172.21.15.151:0/3903344382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc0c62c0 con 0x7feebc0c5080 2023-10-18T11:09:05.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.862+0000 7feea37fe640 1 -- 172.21.15.151:0/3903344382 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 3) v1 ==== 88940+0+0 (secure 0 0 0) 0x7feeac055430 con 0x7feebc0c5080 2023-10-18T11:09:05.893 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.891+0000 7f7b8e245040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T11:09:05.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.961+0000 7feea37fe640 1 -- 172.21.15.151:0/3903344382 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7feeac07b010 con 0x7feebc0c5080 2023-10-18T11:09:05.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:05.965+0000 7feea37fe640 1 -- 172.21.15.151:0/3903344382 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7feeac077350 con 0x7feebc0c5080 2023-10-18T11:09:05.987 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:05.984+0000 7f7b8e245040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T11:09:06.027 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-10-18T11:09:06.025+0000 7f5e5780d500 -1 Falling back to public interface 2023-10-18T11:09:06.029 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:06.027+0000 7f7b8e245040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T11:09:06.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.040+0000 7feec1002640 1 -- 172.21.15.151:0/3903344382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feebc0c5bc0 con 0x7feebc0c5080 2023-10-18T11:09:06.045 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-10-18T11:09:06.043+0000 7fd168394500 -1 Falling back to public interface 2023-10-18T11:09:06.046 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-10-18T11:09:06.044+0000 7f9fd2915500 -1 Falling back to public interface 2023-10-18T11:09:06.080 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-10-18T11:09:06.078+0000 7f0521dbe500 -1 Falling back to public interface 2023-10-18T11:09:06.084 INFO:tasks.ceph.osd.1.smithi151.stderr:2023-10-18T11:09:06.082+0000 7f9ecd7e2500 -1 Falling back to public interface 2023-10-18T11:09:06.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.093+0000 7feea37fe640 1 -- 172.21.15.151:0/3903344382 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7feeac07a970 con 0x7feebc0c5080 2023-10-18T11:09:06.096 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:06.096 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":10,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:05.157594+0000","last_up_change":"0.000000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:09:06.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.095+0000 7feec1002640 1 -- 172.21.15.151:0/3903344382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feebc0c5080 msgr2=0x7feebc1535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:06.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.095+0000 7feec1002640 1 --2- 172.21.15.151:0/3903344382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feebc0c5080 0x7feebc1535e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feeac02bf70 tx=0x7feeac0046c0 comp rx=0 tx=0).stop 2023-10-18T11:09:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.095+0000 7feec1002640 1 -- 172.21.15.151:0/3903344382 shutdown_connections 2023-10-18T11:09:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.095+0000 7feec1002640 1 --2- 172.21.15.151:0/3903344382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feebc150ec0 0x7feebc1e2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.095+0000 7feec1002640 1 --2- 172.21.15.151:0/3903344382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feebc0c57a0 0x7feebc153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.095+0000 7feec1002640 1 --2- 172.21.15.151:0/3903344382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feebc0c5080 0x7feebc1535e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.095+0000 7feec1002640 1 -- 172.21.15.151:0/3903344382 >> 172.21.15.151:0/3903344382 conn(0x7feebc0c6f10 msgr2=0x7feebc15a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:06.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.095+0000 7feec1002640 1 -- 172.21.15.151:0/3903344382 shutdown_connections 2023-10-18T11:09:06.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:06.095+0000 7feec1002640 1 -- 172.21.15.151:0/3903344382 wait complete. 2023-10-18T11:09:06.101 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-10-18T11:09:06.099+0000 7f56f79fb500 -1 Falling back to public interface 2023-10-18T11:09:06.117 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-18T11:09:06.117 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-18T11:09:06.130 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:06.128+0000 7f7b8e245040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T11:09:06.219 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:06.218+0000 7f7b8e245040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T11:09:06.307 INFO:tasks.ceph.osd.3.smithi151.stderr:2023-10-18T11:09:06.305+0000 7f2dcf82a500 -1 Falling back to public interface 2023-10-18T11:09:06.352 INFO:tasks.ceph.osd.0.smithi151.stderr:2023-10-18T11:09:06.350+0000 7f219588c500 -1 Falling back to public interface 2023-10-18T11:09:06.356 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:06.354+0000 7f7b8e245040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T11:09:06.399 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:06.397+0000 7f7b8e245040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T11:09:06.516 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:06.514+0000 7f7b8e245040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T11:09:06.922 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:07.088 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.086+0000 7f3c44a26640 1 Processor -- start 2023-10-18T11:09:07.088 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.086+0000 7f3c44a26640 1 -- start start 2023-10-18T11:09:07.089 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.087+0000 7f3c44a26640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 0x7f3c400c1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:07.090 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.087+0000 7f3c44a26640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3c4006e400 0x7f3c4006fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:07.090 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.087+0000 7f3c44a26640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c40155d60 con 0x7f3c400c4eb0 2023-10-18T11:09:07.090 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.087+0000 7f3c44a26640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c400c30c0 con 0x7f3c4006e400 2023-10-18T11:09:07.090 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.087+0000 7f3c44a26640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400c1fc0 con 0x7f3c40150090 2023-10-18T11:09:07.091 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.088+0000 7f3c3e59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 0x7f3c400c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:07.091 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.088+0000 7f3c3dd9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3c4006e400 0x7f3c4006fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:07.091 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.088+0000 7f3c3ed9d640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f3c400c4eb0 0x7f3c400c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:41160/0 (socket says 172.21.15.151:41160) 2023-10-18T11:09:07.092 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.088+0000 7f3c3ed9d640 1 -- 172.21.15.151:0/3520110109 learned_addr learned my addr 172.21.15.151:0/3520110109 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:07.093 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.091+0000 7f3c3dd9b640 1 -- 172.21.15.151:0/3520110109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 msgr2=0x7f3c400c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:07.093 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.091+0000 7f3c3dd9b640 1 --2- 172.21.15.151:0/3520110109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 0x7f3c400c1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:07.093 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.091+0000 7f3c3dd9b640 1 -- 172.21.15.151:0/3520110109 >> v1:172.21.15.151:6789/0 conn(0x7f3c400c4eb0 legacy=0x7f3c400c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:07.093 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.091+0000 7f3c3dd9b640 1 -- 172.21.15.151:0/3520110109 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40156020 con 0x7f3c4006e400 2023-10-18T11:09:07.094 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.093+0000 7f3c3dd9b640 1 --2- 172.21.15.151:0/3520110109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c4006e400 0x7f3c4006fce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3c340097a0 tx=0x7f3c3402db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aacf2bade33f66b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:07.098 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.096+0000 7f3c3d59a640 1 -- 172.21.15.151:0/3520110109 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3402e920 con 0x7f3c4006e400 2023-10-18T11:09:07.098 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.096+0000 7f3c3d59a640 1 -- 172.21.15.151:0/3520110109 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3402ea80 con 0x7f3c4006e400 2023-10-18T11:09:07.099 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.096+0000 7f3c3d59a640 1 -- 172.21.15.151:0/3520110109 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3402ee10 con 0x7f3c4006e400 2023-10-18T11:09:07.100 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.097+0000 7f3c44a26640 1 -- 172.21.15.151:0/3520110109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c4006e400 msgr2=0x7f3c4006fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:07.100 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.097+0000 7f3c44a26640 1 --2- 172.21.15.151:0/3520110109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c4006e400 0x7f3c4006fce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3c340097a0 tx=0x7f3c3402db70 comp rx=0 tx=0).stop 2023-10-18T11:09:07.100 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.097+0000 7f3c44a26640 1 -- 172.21.15.151:0/3520110109 shutdown_connections 2023-10-18T11:09:07.100 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.097+0000 7f3c44a26640 1 --2- 172.21.15.151:0/3520110109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c4006e400 0x7f3c4006fce0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:07.100 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.097+0000 7f3c44a26640 1 --2- 172.21.15.151:0/3520110109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 0x7f3c400c1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:07.101 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.097+0000 7f3c44a26640 1 -- 172.21.15.151:0/3520110109 >> 172.21.15.151:0/3520110109 conn(0x7f3c40069d90 msgr2=0x7f3c4006a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:07.101 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.097+0000 7f3c44a26640 1 -- 172.21.15.151:0/3520110109 shutdown_connections 2023-10-18T11:09:07.101 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.097+0000 7f3c44a26640 1 -- 172.21.15.151:0/3520110109 wait complete. 2023-10-18T11:09:07.102 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.099+0000 7f3c44a26640 1 Processor -- start 2023-10-18T11:09:07.102 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.099+0000 7f3c44a26640 1 -- start start 2023-10-18T11:09:07.103 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.100+0000 7f3c44a26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c4006e400 0x7f3c4014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:07.103 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.100+0000 7f3c44a26640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c400c4eb0 0x7f3c401487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:07.103 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.100+0000 7f3c44a26640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 0x7f3c40148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:07.103 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.100+0000 7f3c44a26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c401efb50 con 0x7f3c4006e400 2023-10-18T11:09:07.103 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.100+0000 7f3c44a26640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c401eec60 con 0x7f3c400c4eb0 2023-10-18T11:09:07.103 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.100+0000 7f3c44a26640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c401eef40 con 0x7f3c40150090 2023-10-18T11:09:07.104 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.101+0000 7f3c3e59c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c4006e400 0x7f3c4014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:07.104 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.101+0000 7f3c3ed9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 0x7f3c40148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:07.105 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.101+0000 7f3c3dd9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c400c4eb0 0x7f3c401487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:07.105 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.101+0000 7f3c3e59c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c4006e400 0x7f3c4014e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51552/0 (socket says 172.21.15.151:51552) 2023-10-18T11:09:07.105 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.101+0000 7f3c3e59c640 1 -- 172.21.15.151:0/1731135035 learned_addr learned my addr 172.21.15.151:0/1731135035 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:07.106 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.104+0000 7f3c3dd9b640 1 -- 172.21.15.151:0/1731135035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 msgr2=0x7f3c40148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:07.107 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.104+0000 7f3c3dd9b640 1 --2- 172.21.15.151:0/1731135035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 0x7f3c40148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:07.107 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.104+0000 7f3c3dd9b640 1 -- 172.21.15.151:0/1731135035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c4006e400 msgr2=0x7f3c4014e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:07.107 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.104+0000 7f3c3dd9b640 1 --2- 172.21.15.151:0/1731135035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c4006e400 0x7f3c4014e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:07.107 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.104+0000 7f3c3dd9b640 1 -- 172.21.15.151:0/1731135035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34009400 con 0x7f3c400c4eb0 2023-10-18T11:09:07.108 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.106+0000 7f3c3dd9b640 1 --2- 172.21.15.151:0/1731135035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c400c4eb0 0x7f3c401487b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c34035000 tx=0x7f3c340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:07.112 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.110+0000 7f3c2effd640 1 -- 172.21.15.151:0/1731135035 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3403f620 con 0x7f3c400c4eb0 2023-10-18T11:09:07.113 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.110+0000 7f3c2effd640 1 -- 172.21.15.151:0/1731135035 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3403f7a0 con 0x7f3c400c4eb0 2023-10-18T11:09:07.113 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.110+0000 7f3c2effd640 1 -- 172.21.15.151:0/1731135035 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3403fb50 con 0x7f3c400c4eb0 2023-10-18T11:09:07.113 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.110+0000 7f3c44a26640 1 -- 172.21.15.151:0/1731135035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c401ef220 con 0x7f3c400c4eb0 2023-10-18T11:09:07.113 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.110+0000 7f3c44a26640 1 -- 172.21.15.151:0/1731135035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c401ef7e0 con 0x7f3c400c4eb0 2023-10-18T11:09:07.114 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.112+0000 7f3c44a26640 1 -- 172.21.15.151:0/1731135035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c401ef970 con 0x7f3c400c4eb0 2023-10-18T11:09:07.131 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:07.129+0000 7f7b8e245040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T11:09:07.233 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.231+0000 7f3c2effd640 1 -- 172.21.15.151:0/1731135035 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 3) v1 ==== 88940+0+0 (secure 0 0 0) 0x7f3c3403d070 con 0x7f3c400c4eb0 2023-10-18T11:09:07.237 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.235+0000 7f3c2effd640 1 -- 172.21.15.151:0/1731135035 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3c3407aa30 con 0x7f3c400c4eb0 2023-10-18T11:09:07.237 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.235+0000 7f3c2effd640 1 -- 172.21.15.151:0/1731135035 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3c34076d70 con 0x7f3c400c4eb0 2023-10-18T11:09:07.304 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.303+0000 7f3c44a26640 1 -- 172.21.15.151:0/1731135035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c40150470 con 0x7f3c400c4eb0 2023-10-18T11:09:07.320 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.318+0000 7f3c2effd640 1 -- 172.21.15.151:0/1731135035 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3c34043020 con 0x7f3c400c4eb0 2023-10-18T11:09:07.320 INFO:teuthology.misc.health.smithi151.stdout: 2023-10-18T11:09:07.321 INFO:teuthology.misc.health.smithi151.stdout:{"epoch":10,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:05.157594+0000","last_up_change":"0.000000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:09:07.322 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.319+0000 7f3c44a26640 1 -- 172.21.15.151:0/1731135035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c400c4eb0 msgr2=0x7f3c401487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:07.322 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.319+0000 7f3c44a26640 1 --2- 172.21.15.151:0/1731135035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c400c4eb0 0x7f3c401487b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c34035000 tx=0x7f3c340046c0 comp rx=0 tx=0).stop 2023-10-18T11:09:07.322 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.320+0000 7f3c44a26640 1 -- 172.21.15.151:0/1731135035 shutdown_connections 2023-10-18T11:09:07.322 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.320+0000 7f3c44a26640 1 --2- 172.21.15.151:0/1731135035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c40150090 0x7f3c40148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:07.322 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.320+0000 7f3c44a26640 1 --2- 172.21.15.151:0/1731135035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c400c4eb0 0x7f3c401487b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:07.323 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.320+0000 7f3c44a26640 1 --2- 172.21.15.151:0/1731135035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c4006e400 0x7f3c4014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:07.323 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.320+0000 7f3c44a26640 1 -- 172.21.15.151:0/1731135035 >> 172.21.15.151:0/1731135035 conn(0x7f3c40069d90 msgr2=0x7f3c400c3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:07.323 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.320+0000 7f3c44a26640 1 -- 172.21.15.151:0/1731135035 shutdown_connections 2023-10-18T11:09:07.324 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:07.320+0000 7f3c44a26640 1 -- 172.21.15.151:0/1731135035 wait complete. 2023-10-18T11:09:07.338 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-18T11:09:07.398 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:07.396+0000 7f7b8e245040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T11:09:07.448 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:07.446+0000 7f7b8e245040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T11:09:07.548 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:07.546+0000 7f7b8e245040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T11:09:09.490 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-10-18T11:09:09.488+0000 7f5e5780d500 -1 osd.4 0 log_to_monitors true 2023-10-18T11:09:09.570 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-10-18T11:09:09.568+0000 7f9fd2915500 -1 osd.6 0 log_to_monitors true 2023-10-18T11:09:09.576 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-10-18T11:09:09.574+0000 7fd168394500 -1 osd.5 0 log_to_monitors true 2023-10-18T11:09:09.585 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-10-18T11:09:09.583+0000 7f0521dbe500 -1 osd.7 0 log_to_monitors true 2023-10-18T11:09:09.618 INFO:tasks.ceph.osd.1.smithi151.stderr:2023-10-18T11:09:09.616+0000 7f9ecd7e2500 -1 osd.1 0 log_to_monitors true 2023-10-18T11:09:09.668 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-10-18T11:09:09.666+0000 7f56f79fb500 -1 osd.2 0 log_to_monitors true 2023-10-18T11:09:09.679 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:09.677+0000 7f7b2f678640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-18T11:09:09.696 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:09:09.694+0000 7f7b2f678640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-18T11:09:09.856 INFO:tasks.ceph.osd.3.smithi151.stderr:2023-10-18T11:09:09.854+0000 7f2dcf82a500 -1 osd.3 0 log_to_monitors true 2023-10-18T11:09:09.953 INFO:tasks.ceph.osd.0.smithi151.stderr:2023-10-18T11:09:09.951+0000 7f219588c500 -1 osd.0 0 log_to_monitors true 2023-10-18T11:09:12.933 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-10-18T11:09:12.930+0000 7f9fce8a1640 -1 osd.6 0 waiting for initial osdmap 2023-10-18T11:09:12.946 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-10-18T11:09:12.944+0000 7f5e53125640 -1 osd.4 0 waiting for initial osdmap 2023-10-18T11:09:12.995 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-10-18T11:09:12.993+0000 7f9fc66c1640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T11:09:13.008 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-10-18T11:09:13.006+0000 7f5e4af45640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T11:09:13.010 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-10-18T11:09:13.007+0000 7fd164320640 -1 osd.5 0 waiting for initial osdmap 2023-10-18T11:09:13.060 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-10-18T11:09:13.058+0000 7fd15c140640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T11:09:13.272 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-10-18T11:09:13.270+0000 7f051dd4a640 -1 osd.7 0 waiting for initial osdmap 2023-10-18T11:09:13.384 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-10-18T11:09:13.382+0000 7f0515b6a640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T11:09:13.476 INFO:tasks.ceph.osd.3.smithi151.stderr:2023-10-18T11:09:13.474+0000 7f2dcb575640 -1 osd.3 0 waiting for initial osdmap 2023-10-18T11:09:13.499 INFO:tasks.ceph.osd.3.smithi151.stderr:2023-10-18T11:09:13.497+0000 7f2dc2b7f640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T11:09:13.519 INFO:tasks.ceph.osd.1.smithi151.stderr:2023-10-18T11:09:13.517+0000 7f9ec9f86640 -1 osd.1 0 waiting for initial osdmap 2023-10-18T11:09:13.550 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-10-18T11:09:13.548+0000 7f56f3989640 -1 osd.2 0 waiting for initial osdmap 2023-10-18T11:09:13.569 INFO:tasks.ceph.osd.1.smithi151.stderr:2023-10-18T11:09:13.567+0000 7f9ec1590640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T11:09:13.574 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-10-18T11:09:13.572+0000 7f56eb7a9640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T11:09:13.598 INFO:tasks.ceph.osd.0.smithi151.stderr:2023-10-18T11:09:13.596+0000 7f219181a640 -1 osd.0 0 waiting for initial osdmap 2023-10-18T11:09:13.709 INFO:tasks.ceph.osd.0.smithi151.stderr:2023-10-18T11:09:13.707+0000 7f218963a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T11:09:14.145 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:14.314 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.312+0000 7fd2e6de2640 1 Processor -- start 2023-10-18T11:09:14.314 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.312+0000 7fd2e6de2640 1 -- start start 2023-10-18T11:09:14.315 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.313+0000 7fd2e6de2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd2e006e400 0x7fd2e00c1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:14.316 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.313+0000 7fd2e6de2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd2e00c4eb0 0x7fd2e00c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:14.316 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.313+0000 7fd2e6de2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e0155d60 con 0x7fd2e0150090 2023-10-18T11:09:14.316 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.313+0000 7fd2e6de2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e00c30c0 con 0x7fd2e00c4eb0 2023-10-18T11:09:14.316 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.313+0000 7fd2e6de2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e00c1fc0 con 0x7fd2e006e400 2023-10-18T11:09:14.318 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.316+0000 7fd2e537f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd2e00c4eb0 0x7fd2e00c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:14.320 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.318+0000 7fd2e537f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd2e00c4eb0 0x7fd2e00c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49698/0 (socket says 172.21.15.151:49698) 2023-10-18T11:09:14.320 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.318+0000 7fd2e537f640 1 -- 172.21.15.151:0/770291190 learned_addr learned my addr 172.21.15.151:0/770291190 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:14.322 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.321+0000 7fd2e537f640 1 -- 172.21.15.151:0/770291190 >> v2:172.21.15.169:3300/0 conn(0x7fd2e006e400 msgr2=0x7fd2e00c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:14.323 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.321+0000 7fd2e537f640 1 --2- 172.21.15.151:0/770291190 >> v2:172.21.15.169:3300/0 conn(0x7fd2e006e400 0x7fd2e00c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:14.323 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.321+0000 7fd2e537f640 1 -- 172.21.15.151:0/770291190 >> v1:172.21.15.169:6789/0 conn(0x7fd2e0150090 legacy=0x7fd2e006fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:14.323 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.321+0000 7fd2e537f640 1 -- 172.21.15.151:0/770291190 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e0156020 con 0x7fd2e00c4eb0 2023-10-18T11:09:14.325 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.324+0000 7fd2e537f640 1 --2- 172.21.15.151:0/770291190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e00c4eb0 0x7fd2e00c3710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd2e006a970 tx=0x7fd2d802e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37e4dbd644ce486 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:14.331 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.329+0000 7fd2d77fe640 1 -- 172.21.15.151:0/770291190 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d800b0d0 con 0x7fd2e00c4eb0 2023-10-18T11:09:14.333 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.331+0000 7fd2d77fe640 1 -- 172.21.15.151:0/770291190 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d800b230 con 0x7fd2e00c4eb0 2023-10-18T11:09:14.333 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.331+0000 7fd2d77fe640 1 -- 172.21.15.151:0/770291190 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8009600 con 0x7fd2e00c4eb0 2023-10-18T11:09:14.334 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.332+0000 7fd2e6de2640 1 -- 172.21.15.151:0/770291190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e00c4eb0 msgr2=0x7fd2e00c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:14.334 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.332+0000 7fd2e6de2640 1 --2- 172.21.15.151:0/770291190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e00c4eb0 0x7fd2e00c3710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd2e006a970 tx=0x7fd2d802e180 comp rx=0 tx=0).stop 2023-10-18T11:09:14.335 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.332+0000 7fd2e6de2640 1 -- 172.21.15.151:0/770291190 shutdown_connections 2023-10-18T11:09:14.335 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.332+0000 7fd2e6de2640 1 --2- 172.21.15.151:0/770291190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e00c4eb0 0x7fd2e00c3710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:14.335 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.332+0000 7fd2e6de2640 1 --2- 172.21.15.151:0/770291190 >> v2:172.21.15.169:3300/0 conn(0x7fd2e006e400 0x7fd2e00c1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:14.335 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.332+0000 7fd2e6de2640 1 -- 172.21.15.151:0/770291190 >> 172.21.15.151:0/770291190 conn(0x7fd2e0069d90 msgr2=0x7fd2e006a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:14.335 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.332+0000 7fd2e6de2640 1 -- 172.21.15.151:0/770291190 shutdown_connections 2023-10-18T11:09:14.335 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.332+0000 7fd2e6de2640 1 -- 172.21.15.151:0/770291190 wait complete. 2023-10-18T11:09:14.336 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.334+0000 7fd2e6de2640 1 Processor -- start 2023-10-18T11:09:14.336 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.334+0000 7fd2e6de2640 1 -- start start 2023-10-18T11:09:14.337 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.335+0000 7fd2e6de2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e006e400 0x7fd2e0149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:14.337 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.335+0000 7fd2e6de2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2e00c4eb0 0x7fd2e014dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:14.338 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.335+0000 7fd2e6de2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e0150090 0x7fd2e014a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:14.338 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.335+0000 7fd2e6de2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e01effb0 con 0x7fd2e006e400 2023-10-18T11:09:14.338 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.335+0000 7fd2e6de2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e014cd30 con 0x7fd2e00c4eb0 2023-10-18T11:09:14.338 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.335+0000 7fd2e6de2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e01ef9a0 con 0x7fd2e0150090 2023-10-18T11:09:14.339 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.336+0000 7fd2e4b7e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e006e400 0x7fd2e0149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:14.339 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.336+0000 7fd2e537f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e0150090 0x7fd2e014a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:14.339 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.336+0000 7fd2e4b7e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e006e400 0x7fd2e0149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49712/0 (socket says 172.21.15.151:49712) 2023-10-18T11:09:14.339 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.336+0000 7fd2e4b7e640 1 -- 172.21.15.151:0/532344748 learned_addr learned my addr 172.21.15.151:0/532344748 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:14.341 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.339+0000 7fd2e4b7e640 1 -- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e0150090 msgr2=0x7fd2e014a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:14.342 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.339+0000 7fd2e4b7e640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e0150090 0x7fd2e014a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:14.342 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.339+0000 7fd2e4b7e640 1 -- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2e00c4eb0 msgr2=0x7fd2e014dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:14.342 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.339+0000 7fd2e4b7e640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2e00c4eb0 0x7fd2e014dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:14.342 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.339+0000 7fd2e4b7e640 1 -- 172.21.15.151:0/532344748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d800bd40 con 0x7fd2e006e400 2023-10-18T11:09:14.344 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.342+0000 7fd2e4b7e640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e006e400 0x7fd2e0149300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c410 tx=0x7fd2dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:14.348 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.346+0000 7fd2d57fa640 1 -- 172.21.15.151:0/532344748 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0035f0 con 0x7fd2e006e400 2023-10-18T11:09:14.348 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.346+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e014e4f0 con 0x7fd2e006e400 2023-10-18T11:09:14.349 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.346+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e014ca50 con 0x7fd2e006e400 2023-10-18T11:09:14.349 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.347+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e004e160 con 0x7fd2e006e400 2023-10-18T11:09:14.352 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.350+0000 7fd2d57fa640 1 -- 172.21.15.151:0/532344748 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc001120 con 0x7fd2e006e400 2023-10-18T11:09:14.353 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.351+0000 7fd2d57fa640 1 -- 172.21.15.151:0/532344748 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc007220 con 0x7fd2e006e400 2023-10-18T11:09:14.778 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.775+0000 7fd2d57fa640 1 -- 172.21.15.151:0/532344748 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 6) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fd2dc007380 con 0x7fd2e006e400 2023-10-18T11:09:14.781 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.779+0000 7fd2d57fa640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd2cc06ade0 0x7fd2cc06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:14.782 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.780+0000 7fd2d7fff640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd2cc06ade0 0x7fd2cc06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:14.783 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.781+0000 7fd2d7fff640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd2cc06ade0 0x7fd2cc06d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00c6830 tx=0x7fd2d0006bf0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:14.796 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.794+0000 7fd2d57fa640 1 -- 172.21.15.151:0/532344748 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7fd2dc057f50 con 0x7fd2e006e400 2023-10-18T11:09:14.796 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:14.794+0000 7fd2d57fa640 1 -- 172.21.15.151:0/532344748 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2dc054290 con 0x7fd2e006e400 2023-10-18T11:09:15.013 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.010+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2e00c45e0 con 0x7fd2e006e400 2023-10-18T11:09:15.303 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.301+0000 7fd2d57fa640 1 -- 172.21.15.151:0/532344748 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7566 (secure 0 0 0) 0x7fd2dc017090 con 0x7fd2e006e400 2023-10-18T11:09:15.304 INFO:teuthology.misc.health.smithi151.stdout: 2023-10-18T11:09:15.304 INFO:teuthology.misc.health.smithi151.stdout:{"epoch":14,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:13.275572+0000","last_up_change":"2023-10-18T11:09:13.275572+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:09:15.308 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd2cc06ade0 msgr2=0x7fd2cc06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:15.308 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd2cc06ade0 0x7fd2cc06d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00c6830 tx=0x7fd2d0006bf0 comp rx=0 tx=0).stop 2023-10-18T11:09:15.308 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e006e400 msgr2=0x7fd2e0149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:15.308 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e006e400 0x7fd2e0149300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c410 tx=0x7fd2dc00c8d0 comp rx=0 tx=0).stop 2023-10-18T11:09:15.309 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 shutdown_connections 2023-10-18T11:09:15.309 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2e0150090 0x7fd2e014a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:15.309 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd2cc06ade0 0x7fd2cc06d2a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:15.309 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2e00c4eb0 0x7fd2e014dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:15.309 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 --2- 172.21.15.151:0/532344748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2e006e400 0x7fd2e0149300 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:15.309 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.305+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 >> 172.21.15.151:0/532344748 conn(0x7fd2e0069d90 msgr2=0x7fd2e014afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:15.310 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.306+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 shutdown_connections 2023-10-18T11:09:15.310 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:15.306+0000 7fd2e6de2640 1 -- 172.21.15.151:0/532344748 wait complete. 2023-10-18T11:09:15.324 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-10-18T11:09:22.130 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:22.293 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.291+0000 7f5840133640 1 Processor -- start 2023-10-18T11:09:22.293 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.291+0000 7f5840133640 1 -- start start 2023-10-18T11:09:22.294 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.292+0000 7f5840133640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f583806e400 0x7f58380c1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:22.295 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.292+0000 7f5840133640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5838155d60 con 0x7f5838150090 2023-10-18T11:09:22.295 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.292+0000 7f5840133640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58380c1fc0 con 0x7f58380c4eb0 2023-10-18T11:09:22.295 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.292+0000 7f5840133640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58380c30c0 con 0x7f583806e400 2023-10-18T11:09:22.296 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.293+0000 7f583e6d0640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f58380c4eb0 0x7f58380c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50048/0 (socket says 172.21.15.151:50048) 2023-10-18T11:09:22.296 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.293+0000 7f583e6d0640 1 -- 172.21.15.151:0/1519493383 learned_addr learned my addr 172.21.15.151:0/1519493383 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:22.296 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.294+0000 7f583d6ce640 1 --2- 172.21.15.151:0/1519493383 >> v2:172.21.15.151:3300/0 conn(0x7f583806e400 0x7f58380c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:22.298 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.296+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432581324 0 0) 0x7f58380c1fc0 con 0x7f58380c4eb0 2023-10-18T11:09:22.298 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.296+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5824005730 con 0x7f58380c4eb0 2023-10-18T11:09:22.303 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2641030339 0 0) 0x7f5824005730 con 0x7f58380c4eb0 2023-10-18T11:09:22.303 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 >> v2:172.21.15.151:3300/0 conn(0x7f583806e400 msgr2=0x7f58380c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:22.303 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 --2- 172.21.15.151:0/1519493383 >> v2:172.21.15.151:3300/0 conn(0x7f583806e400 0x7f58380c1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:22.303 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 >> v1:172.21.15.151:6789/0 conn(0x7f5838150090 legacy=0x7f583806fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:22.303 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838156020 con 0x7f58380c4eb0 2023-10-18T11:09:22.303 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f58300019f0 con 0x7f58380c4eb0 2023-10-18T11:09:22.304 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 >> v1:172.21.15.169:6789/0 conn(0x7f58380c4eb0 legacy=0x7f58380c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:22.304 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5824005bd0 0x7f5824005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:22.304 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58240069d0 0x7f5824006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:22.304 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5824007390 0x7f582400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:22.304 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582400e240 con 0x7f5824007390 2023-10-18T11:09:22.305 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582400e3b0 con 0x7f58240069d0 2023-10-18T11:09:22.305 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.300+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582400e570 con 0x7f5824005bd0 2023-10-18T11:09:22.305 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.301+0000 7f583decf640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5824005bd0 0x7f5824005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:22.306 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.303+0000 7f583d6ce640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58240069d0 0x7f5824006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:22.306 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.304+0000 7f583decf640 1 -- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58240069d0 msgr2=0x7f5824006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:22.306 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.304+0000 7f583decf640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58240069d0 0x7f5824006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:22.307 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.304+0000 7f583decf640 1 -- 172.21.15.151:0/1519493383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5824007390 msgr2=0x7f582400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:22.307 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.304+0000 7f583decf640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5824007390 0x7f582400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:22.307 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.304+0000 7f583decf640 1 -- 172.21.15.151:0/1519493383 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824005730 con 0x7f5824005bd0 2023-10-18T11:09:22.307 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.304+0000 7f583e6d0640 1 -- 172.21.15.151:0/1519493383 reap_dead start 2023-10-18T11:09:22.308 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.306+0000 7f583decf640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5824005bd0 0x7f5824005ff0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5834001750 tx=0x7f5824007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=152f3f244cf8456f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:22.312 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.310+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340052d0 con 0x7f5824005bd0 2023-10-18T11:09:22.313 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.310+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583402e050 con 0x7f5824005bd0 2023-10-18T11:09:22.313 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.311+0000 7f583cecd640 1 -- 172.21.15.151:0/1519493383 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834003830 con 0x7f5824005bd0 2023-10-18T11:09:22.314 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.311+0000 7f5840133640 1 -- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5824005bd0 msgr2=0x7f5824005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:22.314 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.311+0000 7f5840133640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5824005bd0 0x7f5824005ff0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5834001750 tx=0x7f5824007a00 comp rx=0 tx=0).stop 2023-10-18T11:09:22.314 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.311+0000 7f5840133640 1 -- 172.21.15.151:0/1519493383 shutdown_connections 2023-10-18T11:09:22.314 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.311+0000 7f5840133640 1 --2- 172.21.15.151:0/1519493383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5824005bd0 0x7f5824005ff0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:22.315 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.311+0000 7f5840133640 1 -- 172.21.15.151:0/1519493383 >> 172.21.15.151:0/1519493383 conn(0x7f5838069d90 msgr2=0x7f583806a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:22.315 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.311+0000 7f5840133640 1 -- 172.21.15.151:0/1519493383 shutdown_connections 2023-10-18T11:09:22.315 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.312+0000 7f5840133640 1 -- 172.21.15.151:0/1519493383 wait complete. 2023-10-18T11:09:22.315 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.313+0000 7f5840133640 1 Processor -- start 2023-10-18T11:09:22.316 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.313+0000 7f5840133640 1 -- start start 2023-10-18T11:09:22.316 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.314+0000 7f5840133640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5824005bd0 0x7f58381e5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:22.316 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.314+0000 7f5840133640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58380c73d0 0x7f5838148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:22.317 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.314+0000 7f5840133640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f583814c1b0 0x7f5838146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:22.317 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.314+0000 7f5840133640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5838155120 con 0x7f583814c1b0 2023-10-18T11:09:22.317 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.314+0000 7f5840133640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380c66e0 con 0x7f5824005bd0 2023-10-18T11:09:22.317 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.314+0000 7f5840133640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583814be80 con 0x7f58380c73d0 2023-10-18T11:09:22.318 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.315+0000 7f583decf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5824005bd0 0x7f58381e5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:22.318 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.315+0000 7f583d6ce640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58380c73d0 0x7f5838148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:22.318 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.315+0000 7f583e6d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f583814c1b0 0x7f5838146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:22.319 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.315+0000 7f583decf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5824005bd0 0x7f58381e5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36980/0 (socket says 172.21.15.151:36980) 2023-10-18T11:09:22.319 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.315+0000 7f583decf640 1 -- 172.21.15.151:0/3032390448 learned_addr learned my addr 172.21.15.151:0/3032390448 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:22.321 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.319+0000 7f583decf640 1 -- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58380c73d0 msgr2=0x7f5838148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:22.321 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.319+0000 7f583decf640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58380c73d0 0x7f5838148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:22.322 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.319+0000 7f583decf640 1 -- 172.21.15.151:0/3032390448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f583814c1b0 msgr2=0x7f5838146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:22.322 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.319+0000 7f583decf640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f583814c1b0 0x7f5838146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:22.322 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.319+0000 7f583decf640 1 -- 172.21.15.151:0/3032390448 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583814bba0 con 0x7f5824005bd0 2023-10-18T11:09:22.323 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.322+0000 7f583decf640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5824005bd0 0x7f58381e5ae0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f583402bc30 tx=0x7f5834001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:22.328 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.326+0000 7f582e7fc640 1 -- 172.21.15.151:0/3032390448 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340076c0 con 0x7f5824005bd0 2023-10-18T11:09:22.328 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.326+0000 7f582e7fc640 1 -- 172.21.15.151:0/3032390448 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834007a30 con 0x7f5824005bd0 2023-10-18T11:09:22.328 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.326+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5838154780 con 0x7f5824005bd0 2023-10-18T11:09:22.328 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.326+0000 7f582e7fc640 1 -- 172.21.15.151:0/3032390448 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834006be0 con 0x7f5824005bd0 2023-10-18T11:09:22.329 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.326+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5838154d40 con 0x7f5824005bd0 2023-10-18T11:09:22.329 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.327+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58380c66e0 con 0x7f5824005bd0 2023-10-18T11:09:22.585 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.583+0000 7f582e7fc640 1 -- 172.21.15.151:0/3032390448 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 6) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f5834006d40 con 0x7f5824005bd0 2023-10-18T11:09:22.587 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.585+0000 7f582e7fc640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f581c06ae10 0x7f581c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:22.588 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.586+0000 7f582e7fc640 1 -- 172.21.15.151:0/3032390448 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f58340ab150 con 0x7f5824005bd0 2023-10-18T11:09:22.588 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.586+0000 7f583d6ce640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f581c06ae10 0x7f581c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:22.589 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.587+0000 7f583d6ce640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f581c06ae10 0x7f581c06d2d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f583815a350 tx=0x7f5828009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:22.596 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.594+0000 7f582e7fc640 1 -- 172.21.15.151:0/3032390448 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58340768e0 con 0x7f5824005bd0 2023-10-18T11:09:22.798 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:22.796+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58380c66e0 con 0x7f5824005bd0 2023-10-18T11:09:23.161 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.158+0000 7f582e7fc640 1 -- 172.21.15.151:0/3032390448 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12910 (secure 0 0 0) 0x7f58380c66e0 con 0x7f5824005bd0 2023-10-18T11:09:23.161 INFO:teuthology.misc.health.smithi151.stdout: 2023-10-18T11:09:23.162 INFO:teuthology.misc.health.smithi151.stdout:{"epoch":19,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:20.293357+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:09:23.164 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f581c06ae10 msgr2=0x7f581c06d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:23.164 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f581c06ae10 0x7f581c06d2d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f583815a350 tx=0x7f5828009190 comp rx=0 tx=0).stop 2023-10-18T11:09:23.165 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5824005bd0 msgr2=0x7f58381e5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:23.165 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5824005bd0 0x7f58381e5ae0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f583402bc30 tx=0x7f5834001120 comp rx=0 tx=0).stop 2023-10-18T11:09:23.165 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 shutdown_connections 2023-10-18T11:09:23.165 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f583814c1b0 0x7f5838146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:23.165 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58380c73d0 0x7f5838148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:23.166 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f581c06ae10 0x7f581c06d2d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:23.166 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 --2- 172.21.15.151:0/3032390448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5824005bd0 0x7f58381e5ae0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:23.166 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 >> 172.21.15.151:0/3032390448 conn(0x7f5838069d90 msgr2=0x7f58380c86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:23.166 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 shutdown_connections 2023-10-18T11:09:23.166 INFO:teuthology.misc.health.smithi151.stderr:2023-10-18T11:09:23.162+0000 7f5840133640 1 -- 172.21.15.151:0/3032390448 wait complete. 2023-10-18T11:09:23.181 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-18T11:09:23.181 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-18T11:09:23.182 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-18T11:09:23.182 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-18T11:09:23.182 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-10-18T11:09:23.188 INFO:tasks.ceph.mds.a:Started 2023-10-18T11:09:23.188 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-18T11:09:23.189 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-18T11:09:23.189 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-10-18T11:09:23.194 INFO:tasks.ceph.mds.c:Started 2023-10-18T11:09:23.195 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-18T11:09:23.195 INFO:tasks.ceph.mds.e:Restarting daemon 2023-10-18T11:09:23.195 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-10-18T11:09:23.202 INFO:tasks.ceph.mds.e:Started 2023-10-18T11:09:23.202 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-18T11:09:23.203 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-18T11:09:23.203 DEBUG:teuthology.orchestra.run.smithi169:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-10-18T11:09:23.205 INFO:tasks.ceph.mds.b:Started 2023-10-18T11:09:23.206 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-18T11:09:23.206 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-18T11:09:23.206 DEBUG:teuthology.orchestra.run.smithi169:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-10-18T11:09:23.209 INFO:tasks.ceph.mds.d:Started 2023-10-18T11:09:23.209 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-18T11:09:23.210 INFO:tasks.ceph.mds.f:Restarting daemon 2023-10-18T11:09:23.210 DEBUG:teuthology.orchestra.run.smithi169:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-10-18T11:09:23.213 INFO:tasks.ceph.mds.f:Started 2023-10-18T11:09:23.213 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-18T11:09:23.214 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:23.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.404+0000 7f19f759e640 1 Processor -- start 2023-10-18T11:09:23.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.404+0000 7f19f759e640 1 -- start start 2023-10-18T11:09:23.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.406+0000 7f19f759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f19f806c5e0 0x7f19f806e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:23.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.406+0000 7f19f759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f806af40 con 0x7f19f80c7530 2023-10-18T11:09:23.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.406+0000 7f19f759e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f806b220 con 0x7f19f815cfe0 2023-10-18T11:09:23.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.406+0000 7f19f759e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f806b500 con 0x7f19f806c5e0 2023-10-18T11:09:23.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.497+0000 7f19f6d9d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f19f815cfe0 0x7f19f8163840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50064/0 (socket says 172.21.15.151:50064) 2023-10-18T11:09:23.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.497+0000 7f19f6d9d640 1 -- 172.21.15.151:0/2031743794 learned_addr learned my addr 172.21.15.151:0/2031743794 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:23.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.560+0000 7f19f5d9b640 1 --2- 172.21.15.151:0/2031743794 >> v2:172.21.15.151:3300/0 conn(0x7f19f806c5e0 0x7f19f806e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.565+0000 7f19f559a640 1 -- 172.21.15.151:0/2031743794 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023480801 0 0) 0x7f19f806af40 con 0x7f19f80c7530 2023-10-18T11:09:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.565+0000 7f19f559a640 1 -- 172.21.15.151:0/2031743794 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19e0003520 con 0x7f19f80c7530 2023-10-18T11:09:23.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.567+0000 7f19f5d9b640 1 -- 172.21.15.151:0/2031743794 >> v1:172.21.15.169:6789/0 conn(0x7f19f815cfe0 legacy=0x7f19f8163840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:23.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.567+0000 7f19f5d9b640 1 -- 172.21.15.151:0/2031743794 >> v1:172.21.15.151:6789/0 conn(0x7f19f80c7530 legacy=0x7f19f815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:23.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.567+0000 7f19f5d9b640 1 -- 172.21.15.151:0/2031743794 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f806b7e0 con 0x7f19f806c5e0 2023-10-18T11:09:23.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.573+0000 7f19f5d9b640 1 --2- 172.21.15.151:0/2031743794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f806c5e0 0x7f19f806e8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0097a0 tx=0x7f19ec02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0672ef1cadc2a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:23.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.589+0000 7f19f559a640 1 -- 172.21.15.151:0/2031743794 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec030610 con 0x7f19f806c5e0 2023-10-18T11:09:23.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.589+0000 7f19f559a640 1 -- 172.21.15.151:0/2031743794 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec030770 con 0x7f19f806c5e0 2023-10-18T11:09:23.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.589+0000 7f19f559a640 1 -- 172.21.15.151:0/2031743794 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec030b00 con 0x7f19f806c5e0 2023-10-18T11:09:23.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.590+0000 7f19f759e640 1 -- 172.21.15.151:0/2031743794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f806c5e0 msgr2=0x7f19f806e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:23.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.590+0000 7f19f759e640 1 --2- 172.21.15.151:0/2031743794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f806c5e0 0x7f19f806e8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0097a0 tx=0x7f19ec02b960 comp rx=0 tx=0).stop 2023-10-18T11:09:23.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.590+0000 7f19f759e640 1 -- 172.21.15.151:0/2031743794 shutdown_connections 2023-10-18T11:09:23.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.590+0000 7f19f759e640 1 --2- 172.21.15.151:0/2031743794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f806c5e0 0x7f19f806e8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:23.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.590+0000 7f19f759e640 1 -- 172.21.15.151:0/2031743794 >> 172.21.15.151:0/2031743794 conn(0x7f19f806a3c0 msgr2=0x7f19f806f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:23.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.590+0000 7f19f759e640 1 -- 172.21.15.151:0/2031743794 shutdown_connections 2023-10-18T11:09:23.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.590+0000 7f19f759e640 1 -- 172.21.15.151:0/2031743794 wait complete. 2023-10-18T11:09:23.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.593+0000 7f19f759e640 1 Processor -- start 2023-10-18T11:09:23.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.593+0000 7f19f759e640 1 -- start start 2023-10-18T11:09:23.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.595+0000 7f19f759e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19f806c5e0 0x7f19f80cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:23.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.595+0000 7f19f759e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19f80c7530 0x7f19f81586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:23.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.595+0000 7f19f759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f815cfe0 0x7f19f8158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:23.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.595+0000 7f19f759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f81575c0 con 0x7f19f815cfe0 2023-10-18T11:09:23.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.595+0000 7f19f759e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f81ef920 con 0x7f19f806c5e0 2023-10-18T11:09:23.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.595+0000 7f19f759e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f814ac30 con 0x7f19f80c7530 2023-10-18T11:09:23.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.595+0000 7f19f6d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f815cfe0 0x7f19f8158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:23.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.596+0000 7f19f5d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19f80c7530 0x7f19f81586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:23.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.596+0000 7f19f6d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f815cfe0 0x7f19f8158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50728/0 (socket says 172.21.15.151:50728) 2023-10-18T11:09:23.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.596+0000 7f19f6d9d640 1 -- 172.21.15.151:0/3375669440 learned_addr learned my addr 172.21.15.151:0/3375669440 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:23.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.600+0000 7f19f6d9d640 1 -- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19f80c7530 msgr2=0x7f19f81586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:23.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.600+0000 7f19f6d9d640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19f80c7530 0x7f19f81586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:23.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.600+0000 7f19f6d9d640 1 -- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19f806c5e0 msgr2=0x7f19f80cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:23.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.600+0000 7f19f6d9d640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19f806c5e0 0x7f19f80cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:23.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.600+0000 7f19f6d9d640 1 -- 172.21.15.151:0/3375669440 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec009400 con 0x7f19f815cfe0 2023-10-18T11:09:23.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.603+0000 7f19f6d9d640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f815cfe0 0x7f19f8158c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f19f000cab0 tx=0x7f19f000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:23.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.608+0000 7f19e6ffd640 1 -- 172.21.15.151:0/3375669440 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f000abd0 con 0x7f19f815cfe0 2023-10-18T11:09:23.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.608+0000 7f19e6ffd640 1 -- 172.21.15.151:0/3375669440 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f000ad30 con 0x7f19f815cfe0 2023-10-18T11:09:23.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.608+0000 7f19e6ffd640 1 -- 172.21.15.151:0/3375669440 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f000aea0 con 0x7f19f815cfe0 2023-10-18T11:09:23.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.608+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f80cad40 con 0x7f19f815cfe0 2023-10-18T11:09:23.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.608+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f80cb020 con 0x7f19f815cfe0 2023-10-18T11:09:23.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.610+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f804e160 con 0x7f19f815cfe0 2023-10-18T11:09:23.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.868+0000 7f19e6ffd640 1 -- 172.21.15.151:0/3375669440 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f19f0007070 con 0x7f19f815cfe0 2023-10-18T11:09:23.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.870+0000 7f19e6ffd640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f19d806aec0 0x7f19d806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:23.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.870+0000 7f19f659c640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f19d806aec0 0x7f19d806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:23.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.871+0000 7f19f659c640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f19d806aec0 0x7f19d806d380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19e80010e0 tx=0x7f19e8007950 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:23.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.885+0000 7f19e6ffd640 1 -- 172.21.15.151:0/3375669440 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19f0058670 con 0x7f19f815cfe0 2023-10-18T11:09:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:23.885+0000 7f19e6ffd640 1 -- 172.21.15.151:0/3375669440 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19f00549b0 con 0x7f19f815cfe0 2023-10-18T11:09:24.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.107+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19f806c1b0 con 0x7f19f815cfe0 2023-10-18T11:09:24.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.214+0000 7f19e6ffd640 1 -- 172.21.15.151:0/3375669440 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12910 (secure 0 0 0) 0x7f19f0017020 con 0x7f19f815cfe0 2023-10-18T11:09:24.217 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:24.218 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":19,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:20.293357+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:09:24.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f19d806aec0 msgr2=0x7f19d806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:24.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f19d806aec0 0x7f19d806d380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19e80010e0 tx=0x7f19e8007950 comp rx=0 tx=0).stop 2023-10-18T11:09:24.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f815cfe0 msgr2=0x7f19f8158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:24.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f815cfe0 0x7f19f8158c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f19f000cab0 tx=0x7f19f000cf70 comp rx=0 tx=0).stop 2023-10-18T11:09:24.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 shutdown_connections 2023-10-18T11:09:24.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19f815cfe0 0x7f19f8158c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:24.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19f80c7530 0x7f19f81586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:24.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f19d806aec0 0x7f19d806d380 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:24.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 --2- 172.21.15.151:0/3375669440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19f806c5e0 0x7f19f80cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:24.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 >> 172.21.15.151:0/3375669440 conn(0x7f19f806a3c0 msgr2=0x7f19f80659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:24.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 shutdown_connections 2023-10-18T11:09:24.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.217+0000 7f19f759e640 1 -- 172.21.15.151:0/3375669440 wait complete. 2023-10-18T11:09:24.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T11:09:16.833723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T11:09:24.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T11:09:24.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.417+0000 7fcfccc21640 1 Processor -- start 2023-10-18T11:09:24.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.418+0000 7fcfccc21640 1 -- start start 2023-10-18T11:09:24.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.419+0000 7fcfccc21640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc80c5670 0x7fcfc806dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:24.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.419+0000 7fcfccc21640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcfc80c63b0 0x7fcfc806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:24.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.419+0000 7fcfccc21640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc8070ea0 con 0x7fcfc8157920 2023-10-18T11:09:24.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.419+0000 7fcfccc21640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc806d7d0 con 0x7fcfc80c63b0 2023-10-18T11:09:24.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.419+0000 7fcfccc21640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc80713d0 con 0x7fcfc80c5670 2023-10-18T11:09:24.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.420+0000 7fcfc5d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc80c5670 0x7fcfc806dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:24.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.420+0000 7fcfc659c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fcfc8157920 0x7fcfc8160af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50076/0 (socket says 172.21.15.151:50076) 2023-10-18T11:09:24.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.420+0000 7fcfc659c640 1 -- 172.21.15.151:0/483029818 learned_addr learned my addr 172.21.15.151:0/483029818 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:24.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.420+0000 7fcfc6d9d640 1 --2- 172.21.15.151:0/483029818 >> v2:172.21.15.169:3300/0 conn(0x7fcfc80c63b0 0x7fcfc806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:24.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.423+0000 7fcfc6d9d640 1 -- 172.21.15.151:0/483029818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc80c5670 msgr2=0x7fcfc806dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:24.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.424+0000 7fcfc6d9d640 1 --2- 172.21.15.151:0/483029818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc80c5670 0x7fcfc806dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:24.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.424+0000 7fcfc6d9d640 1 -- 172.21.15.151:0/483029818 >> v1:172.21.15.169:6789/0 conn(0x7fcfc8157920 legacy=0x7fcfc8160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:24.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.424+0000 7fcfc6d9d640 1 -- 172.21.15.151:0/483029818 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc80c6840 con 0x7fcfc80c63b0 2023-10-18T11:09:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.430+0000 7fcfc6d9d640 1 --2- 172.21.15.151:0/483029818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c63b0 0x7fcfc806fc80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009d90 tx=0x7fcfc002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f5efe0cad9372e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:24.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.440+0000 7fcfc559a640 1 -- 172.21.15.151:0/483029818 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc002cbd0 con 0x7fcfc80c63b0 2023-10-18T11:09:24.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.441+0000 7fcfc559a640 1 -- 172.21.15.151:0/483029818 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc002cd30 con 0x7fcfc80c63b0 2023-10-18T11:09:24.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.441+0000 7fcfc559a640 1 -- 172.21.15.151:0/483029818 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc002cea0 con 0x7fcfc80c63b0 2023-10-18T11:09:24.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.442+0000 7fcfccc21640 1 -- 172.21.15.151:0/483029818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c63b0 msgr2=0x7fcfc806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:24.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.442+0000 7fcfccc21640 1 --2- 172.21.15.151:0/483029818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c63b0 0x7fcfc806fc80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009d90 tx=0x7fcfc002be20 comp rx=0 tx=0).stop 2023-10-18T11:09:24.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.442+0000 7fcfccc21640 1 -- 172.21.15.151:0/483029818 shutdown_connections 2023-10-18T11:09:24.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.442+0000 7fcfccc21640 1 --2- 172.21.15.151:0/483029818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c63b0 0x7fcfc806fc80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:24.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.442+0000 7fcfccc21640 1 --2- 172.21.15.151:0/483029818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc80c5670 0x7fcfc806dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:24.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.442+0000 7fcfccc21640 1 -- 172.21.15.151:0/483029818 >> 172.21.15.151:0/483029818 conn(0x7fcfc8069d90 msgr2=0x7fcfc806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:24.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.442+0000 7fcfccc21640 1 -- 172.21.15.151:0/483029818 shutdown_connections 2023-10-18T11:09:24.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.442+0000 7fcfccc21640 1 -- 172.21.15.151:0/483029818 wait complete. 2023-10-18T11:09:24.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.444+0000 7fcfccc21640 1 Processor -- start 2023-10-18T11:09:24.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.444+0000 7fcfccc21640 1 -- start start 2023-10-18T11:09:24.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.445+0000 7fcfccc21640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c5670 0x7fcfc80c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:24.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.446+0000 7fcfccc21640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfc80c63b0 0x7fcfc8159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:24.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.446+0000 7fcfccc21640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc8157920 0x7fcfc81606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:24.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.446+0000 7fcfccc21640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc815fc30 con 0x7fcfc80c63b0 2023-10-18T11:09:24.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.446+0000 7fcfccc21640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc80ca260 con 0x7fcfc80c5670 2023-10-18T11:09:24.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.446+0000 7fcfccc21640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc80cab50 con 0x7fcfc8157920 2023-10-18T11:09:24.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.446+0000 7fcfc659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c5670 0x7fcfc80c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:24.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.446+0000 7fcfc659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c5670 0x7fcfc80c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:37016/0 (socket says 172.21.15.151:37016) 2023-10-18T11:09:24.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.446+0000 7fcfc659c640 1 -- 172.21.15.151:0/3610400521 learned_addr learned my addr 172.21.15.151:0/3610400521 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:24.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.447+0000 7fcfc6d9d640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc8157920 0x7fcfc81606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:24.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.451+0000 7fcfc659c640 1 -- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc8157920 msgr2=0x7fcfc81606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:24.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.451+0000 7fcfc659c640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc8157920 0x7fcfc81606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:24.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.451+0000 7fcfc659c640 1 -- 172.21.15.151:0/3610400521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfc80c63b0 msgr2=0x7fcfc8159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:24.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.451+0000 7fcfc659c640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfc80c63b0 0x7fcfc8159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:24.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.452+0000 7fcfc659c640 1 -- 172.21.15.151:0/3610400521 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0009a70 con 0x7fcfc80c5670 2023-10-18T11:09:24.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.455+0000 7fcfc659c640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c5670 0x7fcfc80c9d20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800c4a0 tx=0x7fcfb800c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:24.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.459+0000 7fcfb6ffd640 1 -- 172.21.15.151:0/3610400521 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8005ce0 con 0x7fcfc80c5670 2023-10-18T11:09:24.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.460+0000 7fcfb6ffd640 1 -- 172.21.15.151:0/3610400521 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8005e40 con 0x7fcfc80c5670 2023-10-18T11:09:24.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.460+0000 7fcfb6ffd640 1 -- 172.21.15.151:0/3610400521 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8007270 con 0x7fcfc80c5670 2023-10-18T11:09:24.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.460+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc80cae30 con 0x7fcfc80c5670 2023-10-18T11:09:24.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.460+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc815fea0 con 0x7fcfc80c5670 2023-10-18T11:09:24.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.461+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc804e160 con 0x7fcfc80c5670 2023-10-18T11:09:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.759+0000 7fcfb6ffd640 1 -- 172.21.15.151:0/3610400521 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcfb80073d0 con 0x7fcfc80c5670 2023-10-18T11:09:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.760+0000 7fcfb6ffd640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcfa806aef0 0x7fcfa806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.761+0000 7fcfc5d9b640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcfa806aef0 0x7fcfa806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.762+0000 7fcfc5d9b640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcfa806aef0 0x7fcfa806d3b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc006a90 tx=0x7fcfbc006a20 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.763+0000 7fcfb6ffd640 1 -- 172.21.15.151:0/3610400521 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcfb8057db0 con 0x7fcfc80c5670 2023-10-18T11:09:24.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:24.778+0000 7fcfb6ffd640 1 -- 172.21.15.151:0/3610400521 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcfb80540f0 con 0x7fcfc80c5670 2023-10-18T11:09:25.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.014+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfc8071680 con 0x7fcfc80c5670 2023-10-18T11:09:25.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.049+0000 7fcfb6ffd640 1 -- 172.21.15.151:0/3610400521 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfb80170a0 con 0x7fcfc80c5670 2023-10-18T11:09:25.052 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-10-18T11:09:25.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcfa806aef0 msgr2=0x7fcfa806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:25.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcfa806aef0 0x7fcfa806d3b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc006a90 tx=0x7fcfbc006a20 comp rx=0 tx=0).stop 2023-10-18T11:09:25.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c5670 msgr2=0x7fcfc80c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:25.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c5670 0x7fcfc80c9d20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800c4a0 tx=0x7fcfb800c960 comp rx=0 tx=0).stop 2023-10-18T11:09:25.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 shutdown_connections 2023-10-18T11:09:25.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfc8157920 0x7fcfc81606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfc80c63b0 0x7fcfc8159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcfa806aef0 0x7fcfa806d3b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 --2- 172.21.15.151:0/3610400521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfc80c5670 0x7fcfc80c9d20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 >> 172.21.15.151:0/3610400521 conn(0x7fcfc8069d90 msgr2=0x7fcfc8157e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:25.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 shutdown_connections 2023-10-18T11:09:25.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.052+0000 7fcfccc21640 1 -- 172.21.15.151:0/3610400521 wait complete. 2023-10-18T11:09:25.072 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:09:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.253+0000 7fe43b539640 1 Processor -- start 2023-10-18T11:09:25.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.253+0000 7fe43b539640 1 -- start start 2023-10-18T11:09:25.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.255+0000 7fe43b539640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe4340c6a50 0x7fe4340705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:25.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.255+0000 7fe43b539640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe434153800 con 0x7fe434153420 2023-10-18T11:09:25.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.255+0000 7fe43b539640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe434071e90 con 0x7fe434070d50 2023-10-18T11:09:25.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.255+0000 7fe43b539640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe434072130 con 0x7fe4340c6a50 2023-10-18T11:09:25.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.255+0000 7fe439ad6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe4340c6a50 0x7fe4340705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:25.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.256+0000 7fe4392d5640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe434153420 0x7fe434071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:59372/0 (socket says 172.21.15.151:59372) 2023-10-18T11:09:25.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.256+0000 7fe4392d5640 1 -- 172.21.15.151:0/3742185255 learned_addr learned my addr 172.21.15.151:0/3742185255 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:25.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.259+0000 7fe439ad6640 1 -- 172.21.15.151:0/3742185255 >> v1:172.21.15.169:6789/0 conn(0x7fe434070d50 legacy=0x7fe4340c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:25.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.259+0000 7fe439ad6640 1 -- 172.21.15.151:0/3742185255 >> v1:172.21.15.151:6789/0 conn(0x7fe434153420 legacy=0x7fe434071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:25.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.259+0000 7fe439ad6640 1 -- 172.21.15.151:0/3742185255 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340723d0 con 0x7fe4340c6a50 2023-10-18T11:09:25.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.263+0000 7fe439ad6640 1 --2- 172.21.15.151:0/3742185255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4340c6a50 0x7fe4340705d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009d90 tx=0x7fe42c02bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3a665f4f4499378 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:25.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.267+0000 7fe42bfff640 1 -- 172.21.15.151:0/3742185255 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c02cd80 con 0x7fe4340c6a50 2023-10-18T11:09:25.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.267+0000 7fe42bfff640 1 -- 172.21.15.151:0/3742185255 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c034440 con 0x7fe4340c6a50 2023-10-18T11:09:25.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.267+0000 7fe42bfff640 1 -- 172.21.15.151:0/3742185255 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0347d0 con 0x7fe4340c6a50 2023-10-18T11:09:25.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.268+0000 7fe43b539640 1 -- 172.21.15.151:0/3742185255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4340c6a50 msgr2=0x7fe4340705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:25.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.268+0000 7fe43b539640 1 --2- 172.21.15.151:0/3742185255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4340c6a50 0x7fe4340705d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009d90 tx=0x7fe42c02bfd0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.268+0000 7fe43b539640 1 -- 172.21.15.151:0/3742185255 shutdown_connections 2023-10-18T11:09:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.268+0000 7fe43b539640 1 --2- 172.21.15.151:0/3742185255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4340c6a50 0x7fe4340705d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.268+0000 7fe43b539640 1 -- 172.21.15.151:0/3742185255 >> 172.21.15.151:0/3742185255 conn(0x7fe4340cae00 msgr2=0x7fe4340cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.268+0000 7fe43b539640 1 -- 172.21.15.151:0/3742185255 shutdown_connections 2023-10-18T11:09:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.268+0000 7fe43b539640 1 -- 172.21.15.151:0/3742185255 wait complete. 2023-10-18T11:09:25.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.270+0000 7fe43b539640 1 Processor -- start 2023-10-18T11:09:25.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.270+0000 7fe43b539640 1 -- start start 2023-10-18T11:09:25.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.271+0000 7fe43b539640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe434070d50 0x7fe434146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:25.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.271+0000 7fe43b539640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4340c6a50 0x7fe43415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:25.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.271+0000 7fe43b539640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe434153420 0x7fe43414bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:25.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.271+0000 7fe43b539640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4341ef240 con 0x7fe434153420 2023-10-18T11:09:25.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.271+0000 7fe43b539640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43415a430 con 0x7fe434070d50 2023-10-18T11:09:25.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.271+0000 7fe43b539640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe434147130 con 0x7fe4340c6a50 2023-10-18T11:09:25.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.272+0000 7fe4392d5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe434070d50 0x7fe434146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:25.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.272+0000 7fe4392d5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe434070d50 0x7fe434146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:37032/0 (socket says 172.21.15.151:37032) 2023-10-18T11:09:25.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.272+0000 7fe4392d5640 1 -- 172.21.15.151:0/2275978485 learned_addr learned my addr 172.21.15.151:0/2275978485 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:25.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.272+0000 7fe438ad4640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4340c6a50 0x7fe43415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:25.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.272+0000 7fe439ad6640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe434153420 0x7fe43414bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:25.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.276+0000 7fe4392d5640 1 -- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4340c6a50 msgr2=0x7fe43415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:25.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.276+0000 7fe4392d5640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4340c6a50 0x7fe43415b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.276+0000 7fe4392d5640 1 -- 172.21.15.151:0/2275978485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe434153420 msgr2=0x7fe43414bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:25.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.276+0000 7fe4392d5640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe434153420 0x7fe43414bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.276+0000 7fe4392d5640 1 -- 172.21.15.151:0/2275978485 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c009a70 con 0x7fe434070d50 2023-10-18T11:09:25.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.278+0000 7fe4392d5640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe434070d50 0x7fe434146bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe43000c4a0 tx=0x7fe43000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.280+0000 7fe429ffb640 1 -- 172.21.15.151:0/2275978485 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430005ce0 con 0x7fe434070d50 2023-10-18T11:09:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.280+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4341ee6c0 con 0x7fe434070d50 2023-10-18T11:09:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.281+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4341eec80 con 0x7fe434070d50 2023-10-18T11:09:25.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.282+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43415a1e0 con 0x7fe434070d50 2023-10-18T11:09:25.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.282+0000 7fe429ffb640 1 -- 172.21.15.151:0/2275978485 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe430005e40 con 0x7fe434070d50 2023-10-18T11:09:25.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.282+0000 7fe429ffb640 1 -- 172.21.15.151:0/2275978485 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430007270 con 0x7fe434070d50 2023-10-18T11:09:25.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.573+0000 7fe429ffb640 1 -- 172.21.15.151:0/2275978485 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe4300073d0 con 0x7fe434070d50 2023-10-18T11:09:25.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.575+0000 7fe429ffb640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe41806aea0 0x7fe41806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:25.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.576+0000 7fe438ad4640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe41806aea0 0x7fe41806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:25.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.576+0000 7fe429ffb640 1 -- 172.21.15.151:0/2275978485 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe4300580d0 con 0x7fe434070d50 2023-10-18T11:09:25.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.577+0000 7fe438ad4640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe41806aea0 0x7fe41806d360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe43414d200 tx=0x7fe424009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:25.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.595+0000 7fe429ffb640 1 -- 172.21.15.151:0/2275978485 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe430054410 con 0x7fe434070d50 2023-10-18T11:09:25.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.835+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe434156c70 con 0x7fe434070d50 2023-10-18T11:09:25.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.861+0000 7fe429ffb640 1 -- 172.21.15.151:0/2275978485 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fe430021090 con 0x7fe434070d50 2023-10-18T11:09:25.864 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:25.864 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-18T11:09:25.864 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 1 2023-10-18T11:09:25.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe41806aea0 msgr2=0x7fe41806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:25.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe41806aea0 0x7fe41806d360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe43414d200 tx=0x7fe424009040 comp rx=0 tx=0).stop 2023-10-18T11:09:25.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe434070d50 msgr2=0x7fe434146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:25.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe434070d50 0x7fe434146bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe43000c4a0 tx=0x7fe43000c960 comp rx=0 tx=0).stop 2023-10-18T11:09:25.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 shutdown_connections 2023-10-18T11:09:25.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe434153420 0x7fe43414bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe4340c6a50 0x7fe43415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe41806aea0 0x7fe41806d360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:25.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 --2- 172.21.15.151:0/2275978485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe434070d50 0x7fe434146bf0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe43000c4a0 tx=0x7fe43000c960 comp rx=0 tx=0).stop 2023-10-18T11:09:25.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 >> 172.21.15.151:0/2275978485 conn(0x7fe4340cae00 msgr2=0x7fe434069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:25.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 shutdown_connections 2023-10-18T11:09:25.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:25.864+0000 7fe43b539640 1 -- 172.21.15.151:0/2275978485 wait complete. 2023-10-18T11:09:27.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:09:28.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.070+0000 7ff569347640 1 Processor -- start 2023-10-18T11:09:28.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.070+0000 7ff569347640 1 -- start start 2023-10-18T11:09:28.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.071+0000 7ff569347640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c7e60 0x7ff5640cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:28.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.071+0000 7ff569347640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff5640c83b0 0x7ff5640cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:28.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.072+0000 7ff569347640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5640c19b0 con 0x7ff564150e80 2023-10-18T11:09:28.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.072+0000 7ff569347640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640c1430 con 0x7ff5640c83b0 2023-10-18T11:09:28.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.072+0000 7ff569347640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640c6ed0 con 0x7ff5640c7e60 2023-10-18T11:09:28.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.098+0000 7ff563fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7ff564150e80 0x7ff564156c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:55506/0 (socket says 172.21.15.151:55506) 2023-10-18T11:09:28.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.098+0000 7ff563fff640 1 -- 172.21.15.151:0/3258829849 learned_addr learned my addr 172.21.15.151:0/3258829849 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:28.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.105+0000 7ff5637fe640 1 --2- 172.21.15.151:0/3258829849 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c7e60 0x7ff5640cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:28.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.108+0000 7ff568b46640 1 --2- 172.21.15.151:0/3258829849 >> v2:172.21.15.151:3300/0 conn(0x7ff5640c83b0 0x7ff5640cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:28.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.108+0000 7ff5637fe640 1 -- 172.21.15.151:0/3258829849 >> v2:172.21.15.151:3300/0 conn(0x7ff5640c83b0 msgr2=0x7ff5640cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:28.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.108+0000 7ff5637fe640 1 --2- 172.21.15.151:0/3258829849 >> v2:172.21.15.151:3300/0 conn(0x7ff5640c83b0 0x7ff5640cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.108+0000 7ff5637fe640 1 -- 172.21.15.151:0/3258829849 >> v1:172.21.15.169:6789/0 conn(0x7ff564150e80 legacy=0x7ff564156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:28.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.108+0000 7ff5637fe640 1 -- 172.21.15.151:0/3258829849 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5640c7170 con 0x7ff5640c7e60 2023-10-18T11:09:28.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.113+0000 7ff5637fe640 1 --2- 172.21.15.151:0/3258829849 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c7e60 0x7ff5640cc4c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5580097a0 tx=0x7ff55802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=694d3d9176d6f4d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:28.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.117+0000 7ff562ffd640 1 -- 172.21.15.151:0/3258829849 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558031830 con 0x7ff5640c7e60 2023-10-18T11:09:28.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.118+0000 7ff562ffd640 1 -- 172.21.15.151:0/3258829849 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558031990 con 0x7ff5640c7e60 2023-10-18T11:09:28.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.118+0000 7ff562ffd640 1 -- 172.21.15.151:0/3258829849 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558031d20 con 0x7ff5640c7e60 2023-10-18T11:09:28.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.119+0000 7ff569347640 1 -- 172.21.15.151:0/3258829849 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c7e60 msgr2=0x7ff5640cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:28.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.119+0000 7ff569347640 1 --2- 172.21.15.151:0/3258829849 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c7e60 0x7ff5640cc4c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5580097a0 tx=0x7ff55802b8d0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.119+0000 7ff569347640 1 -- 172.21.15.151:0/3258829849 shutdown_connections 2023-10-18T11:09:28.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.119+0000 7ff569347640 1 --2- 172.21.15.151:0/3258829849 >> v2:172.21.15.151:3300/0 conn(0x7ff5640c83b0 0x7ff5640cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.119+0000 7ff569347640 1 --2- 172.21.15.151:0/3258829849 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c7e60 0x7ff5640cc4c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.119+0000 7ff569347640 1 -- 172.21.15.151:0/3258829849 >> 172.21.15.151:0/3258829849 conn(0x7ff56406a3c0 msgr2=0x7ff56406f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:28.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.119+0000 7ff569347640 1 -- 172.21.15.151:0/3258829849 shutdown_connections 2023-10-18T11:09:28.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.119+0000 7ff569347640 1 -- 172.21.15.151:0/3258829849 wait complete. 2023-10-18T11:09:28.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.122+0000 7ff569347640 1 Processor -- start 2023-10-18T11:09:28.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.122+0000 7ff569347640 1 -- start start 2023-10-18T11:09:28.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.124+0000 7ff569347640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5640c7e60 0x7ff5640c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:28.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.124+0000 7ff569347640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c83b0 0x7ff56414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:28.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.124+0000 7ff569347640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff564150e80 0x7ff5640c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:28.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.124+0000 7ff569347640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5641ef0e0 con 0x7ff5640c7e60 2023-10-18T11:09:28.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.124+0000 7ff569347640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640afdc0 con 0x7ff564150e80 2023-10-18T11:09:28.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.124+0000 7ff569347640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5641ef5d0 con 0x7ff5640c83b0 2023-10-18T11:09:28.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.124+0000 7ff5637fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c83b0 0x7ff56414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:28.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.124+0000 7ff563fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5640c7e60 0x7ff5640c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:28.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.124+0000 7ff568b46640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff564150e80 0x7ff5640c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:28.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.125+0000 7ff5637fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c83b0 0x7ff56414d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:40658/0 (socket says 172.21.15.151:40658) 2023-10-18T11:09:28.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.125+0000 7ff5637fe640 1 -- 172.21.15.151:0/2072692408 learned_addr learned my addr 172.21.15.151:0/2072692408 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:28.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.130+0000 7ff568b46640 1 -- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c83b0 msgr2=0x7ff56414d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:28.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.130+0000 7ff568b46640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c83b0 0x7ff56414d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.130+0000 7ff568b46640 1 -- 172.21.15.151:0/2072692408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5640c7e60 msgr2=0x7ff5640c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:28.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.130+0000 7ff568b46640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5640c7e60 0x7ff5640c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.130+0000 7ff568b46640 1 -- 172.21.15.151:0/2072692408 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558009400 con 0x7ff564150e80 2023-10-18T11:09:28.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.130+0000 7ff5637fe640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c83b0 0x7ff56414d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:09:28.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.133+0000 7ff568b46640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff564150e80 0x7ff5640c3980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00ccb0 tx=0x7ff55c00a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:28.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.136+0000 7ff560ff9640 1 -- 172.21.15.151:0/2072692408 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c003b90 con 0x7ff564150e80 2023-10-18T11:09:28.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.136+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5640b0310 con 0x7ff564150e80 2023-10-18T11:09:28.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.136+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5640b05b0 con 0x7ff564150e80 2023-10-18T11:09:28.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.137+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56404e160 con 0x7ff564150e80 2023-10-18T11:09:28.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.139+0000 7ff560ff9640 1 -- 172.21.15.151:0/2072692408 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c0078b0 con 0x7ff564150e80 2023-10-18T11:09:28.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.139+0000 7ff560ff9640 1 -- 172.21.15.151:0/2072692408 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c004020 con 0x7ff564150e80 2023-10-18T11:09:28.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.446+0000 7ff560ff9640 1 -- 172.21.15.151:0/2072692408 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff55c004180 con 0x7ff564150e80 2023-10-18T11:09:28.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.447+0000 7ff560ff9640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff55006ae70 0x7ff55006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:28.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.448+0000 7ff563fff640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff55006ae70 0x7ff55006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:28.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.448+0000 7ff563fff640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff55006ae70 0x7ff55006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff554005880 tx=0x7ff554009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:28.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.450+0000 7ff560ff9640 1 -- 172.21.15.151:0/2072692408 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff55c012070 con 0x7ff564150e80 2023-10-18T11:09:28.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.466+0000 7ff560ff9640 1 -- 172.21.15.151:0/2072692408 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff55c055450 con 0x7ff564150e80 2023-10-18T11:09:28.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.694+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff56406ee40 con 0x7ff564150e80 2023-10-18T11:09:28.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.702+0000 7ff560ff9640 1 -- 172.21.15.151:0/2072692408 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7ff55c058a70 con 0x7ff564150e80 2023-10-18T11:09:28.704 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:28.705 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-18T11:09:28.705 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 1 2023-10-18T11:09:28.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff55006ae70 msgr2=0x7ff55006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:28.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff55006ae70 0x7ff55006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff554005880 tx=0x7ff554009040 comp rx=0 tx=0).stop 2023-10-18T11:09:28.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff564150e80 msgr2=0x7ff5640c3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:28.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff564150e80 0x7ff5640c3980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00ccb0 tx=0x7ff55c00a660 comp rx=0 tx=0).stop 2023-10-18T11:09:28.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 shutdown_connections 2023-10-18T11:09:28.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff55006ae70 0x7ff55006d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff564150e80 0x7ff5640c3980 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5640c83b0 0x7ff56414d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 --2- 172.21.15.151:0/2072692408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5640c7e60 0x7ff5640c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:28.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 >> 172.21.15.151:0/2072692408 conn(0x7ff56406a3c0 msgr2=0x7ff5640cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:28.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 shutdown_connections 2023-10-18T11:09:28.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:28.705+0000 7ff569347640 1 -- 172.21.15.151:0/2072692408 wait complete. 2023-10-18T11:09:29.651 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2023-10-18T11:09:29.670 INFO:tasks.ceph.mds.f.smithi169.stdout:starting mds.f at 2023-10-18T11:09:29.758 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2023-10-18T11:09:30.162 INFO:tasks.ceph.mds.c.smithi151.stdout:starting mds.c at 2023-10-18T11:09:30.273 INFO:tasks.ceph.mds.a.smithi151.stdout:starting mds.a at 2023-10-18T11:09:30.363 INFO:tasks.ceph.mds.e.smithi151.stdout:starting mds.e at 2023-10-18T11:09:30.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:09:30.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.913+0000 7f5d5c7e7640 1 Processor -- start 2023-10-18T11:09:30.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.914+0000 7f5d5c7e7640 1 -- start start 2023-10-18T11:09:30.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.915+0000 7f5d5c7e7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5d540c4a80 0x7f5d54162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:30.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.915+0000 7f5d5c7e7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d54151570 con 0x7f5d540c7000 2023-10-18T11:09:30.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.915+0000 7f5d5c7e7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5406dcb0 con 0x7f5d54151190 2023-10-18T11:09:30.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.915+0000 7f5d5c7e7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d540c5ad0 con 0x7f5d540c4a80 2023-10-18T11:09:30.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.916+0000 7f5d5a583640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f5d54151190 0x7f5d5406e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:55522/0 (socket says 172.21.15.151:55522) 2023-10-18T11:09:30.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.916+0000 7f5d5a583640 1 -- 172.21.15.151:0/2863411183 learned_addr learned my addr 172.21.15.151:0/2863411183 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:30.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.916+0000 7f5d5ad84640 1 --2- 172.21.15.151:0/2863411183 >> v2:172.21.15.151:3300/0 conn(0x7f5d540c4a80 0x7f5d54162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:30.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.918+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582299239 0 0) 0x7f5d5406dcb0 con 0x7f5d54151190 2023-10-18T11:09:30.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.918+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d3c003520 con 0x7f5d54151190 2023-10-18T11:09:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.921+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3341674716 0 0) 0x7f5d3c003520 con 0x7f5d54151190 2023-10-18T11:09:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.921+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 >> v2:172.21.15.151:3300/0 conn(0x7f5d540c4a80 msgr2=0x7f5d54162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.921+0000 7f5d59581640 1 --2- 172.21.15.151:0/2863411183 >> v2:172.21.15.151:3300/0 conn(0x7f5d540c4a80 0x7f5d54162670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.921+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 >> v1:172.21.15.151:6789/0 conn(0x7f5d540c7000 legacy=0x7f5d540c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.921+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5406e270 con 0x7f5d54151190 2023-10-18T11:09:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.921+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f5d4c0019f0 con 0x7f5d54151190 2023-10-18T11:09:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.921+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 >> v1:172.21.15.169:6789/0 conn(0x7f5d54151190 legacy=0x7f5d5406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.922+0000 7f5d59581640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d3c003970 0x7f5d3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.922+0000 7f5d59581640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:30.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.922+0000 7f5d59581640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d3c005180 0x7f5d3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:30.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.922+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540c5ad0 con 0x7f5d3c005180 2023-10-18T11:09:30.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.922+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c00c020 con 0x7f5d3c003970 2023-10-18T11:09:30.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.922+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c00c1e0 con 0x7f5d3c0047c0 2023-10-18T11:09:30.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.922+0000 7f5d59d82640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:30.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.925+0000 7f5d5a583640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d3c003970 0x7f5d3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:30.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.925+0000 7f5d59d82640 1 -- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d3c003970 msgr2=0x7f5d3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:30.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.925+0000 7f5d59d82640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d3c003970 0x7f5d3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:30.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.925+0000 7f5d59d82640 1 -- 172.21.15.151:0/2863411183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d3c005180 msgr2=0x7f5d3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:30.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.925+0000 7f5d59d82640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d3c005180 0x7f5d3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:30.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.925+0000 7f5d59d82640 1 -- 172.21.15.151:0/2863411183 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c003520 con 0x7f5d3c0047c0 2023-10-18T11:09:30.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.925+0000 7f5d5ad84640 1 -- 172.21.15.151:0/2863411183 reap_dead start 2023-10-18T11:09:30.930 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.928+0000 7f5d59d82640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d3c004c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d48001580 tx=0x7f5d3c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8cf5cae08609f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:30.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.931+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d480052d0 con 0x7f5d3c0047c0 2023-10-18T11:09:30.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.931+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4802e050 con 0x7f5d3c0047c0 2023-10-18T11:09:30.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.931+0000 7f5d59581640 1 -- 172.21.15.151:0/2863411183 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48003830 con 0x7f5d3c0047c0 2023-10-18T11:09:30.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.932+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 msgr2=0x7f5d3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:30.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.932+0000 7f5d5c7e7640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d3c004c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d48001580 tx=0x7f5d3c0057f0 comp rx=0 tx=0).stop 2023-10-18T11:09:30.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.932+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/2863411183 shutdown_connections 2023-10-18T11:09:30.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.932+0000 7f5d5c7e7640 1 --2- 172.21.15.151:0/2863411183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d3c004c40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:30.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.932+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/2863411183 >> 172.21.15.151:0/2863411183 conn(0x7f5d540659d0 msgr2=0x7f5d54065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:30.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.932+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/2863411183 shutdown_connections 2023-10-18T11:09:30.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.932+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/2863411183 wait complete. 2023-10-18T11:09:30.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.934+0000 7f5d5c7e7640 1 Processor -- start 2023-10-18T11:09:30.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.934+0000 7f5d5c7e7640 1 -- start start 2023-10-18T11:09:30.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.935+0000 7f5d5c7e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d5414d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:30.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.935+0000 7f5d5c7e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5406cbf0 0x7f5d540cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:30.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.935+0000 7f5d5c7e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d540cbae0 0x7f5d5406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:30.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.935+0000 7f5d5c7e7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54153c70 con 0x7f5d5406cbf0 2023-10-18T11:09:30.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.935+0000 7f5d5c7e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541ef800 con 0x7f5d540cbae0 2023-10-18T11:09:30.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.935+0000 7f5d5c7e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541ee6a0 con 0x7f5d3c0047c0 2023-10-18T11:09:30.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.936+0000 7f5d59d82640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5406cbf0 0x7f5d540cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:30.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.936+0000 7f5d5a583640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d5414d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:30.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.936+0000 7f5d5ad84640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d540cbae0 0x7f5d5406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:30.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.936+0000 7f5d59d82640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5406cbf0 0x7f5d540cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41156/0 (socket says 172.21.15.151:41156) 2023-10-18T11:09:30.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.936+0000 7f5d59d82640 1 -- 172.21.15.151:0/4174106089 learned_addr learned my addr 172.21.15.151:0/4174106089 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:30.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.939+0000 7f5d5a583640 1 -- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d540cbae0 msgr2=0x7f5d5406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:30.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.939+0000 7f5d5a583640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d540cbae0 0x7f5d5406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:30.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.939+0000 7f5d5a583640 1 -- 172.21.15.151:0/4174106089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5406cbf0 msgr2=0x7f5d540cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:30.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.939+0000 7f5d5a583640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5406cbf0 0x7f5d540cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:30.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.939+0000 7f5d5a583640 1 -- 172.21.15.151:0/4174106089 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d540ca500 con 0x7f5d3c0047c0 2023-10-18T11:09:30.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.939+0000 7f5d59d82640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5406cbf0 0x7f5d540cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:09:30.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.942+0000 7f5d5a583640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d5414d450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0013d0 tx=0x7f5d4c00e530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:30.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.945+0000 7f5d52ffd640 1 -- 172.21.15.151:0/4174106089 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c00ee50 con 0x7f5d3c0047c0 2023-10-18T11:09:30.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.945+0000 7f5d52ffd640 1 -- 172.21.15.151:0/4174106089 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c013420 con 0x7f5d3c0047c0 2023-10-18T11:09:30.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.945+0000 7f5d52ffd640 1 -- 172.21.15.151:0/4174106089 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0137d0 con 0x7f5d3c0047c0 2023-10-18T11:09:30.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.945+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d540ca7e0 con 0x7f5d3c0047c0 2023-10-18T11:09:30.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.946+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d540cada0 con 0x7f5d3c0047c0 2023-10-18T11:09:30.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:30.947+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d540c7890 con 0x7f5d3c0047c0 2023-10-18T11:09:31.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.198+0000 7f5d52ffd640 1 -- 172.21.15.151:0/4174106089 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5d4c013930 con 0x7f5d3c0047c0 2023-10-18T11:09:31.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.200+0000 7f5d52ffd640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5d4006aef0 0x7f5d4006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:31.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.201+0000 7f5d52ffd640 1 -- 172.21.15.151:0/4174106089 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d4c08a380 con 0x7f5d3c0047c0 2023-10-18T11:09:31.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.201+0000 7f5d59d82640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5d4006aef0 0x7f5d4006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:31.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.202+0000 7f5d59d82640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5d4006aef0 0x7f5d4006d3b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5d48034040 tx=0x7f5d48009030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.208+0000 7f5d52ffd640 1 -- 172.21.15.151:0/4174106089 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d4c055780 con 0x7f5d3c0047c0 2023-10-18T11:09:31.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.447+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d540b1b70 con 0x7f5d3c0047c0 2023-10-18T11:09:31.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.585+0000 7f5d52ffd640 1 -- 172.21.15.151:0/4174106089 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5280 (secure 0 0 0) 0x7f5d4c058da0 con 0x7f5d3c0047c0 2023-10-18T11:09:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:31.588 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2025487091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2025487091},{"type":"v1","addr":"172.21.15.169:6835","nonce":2025487091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/872383111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":872383111},{"type":"v1","addr":"172.21.15.169:6837","nonce":872383111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/520473080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":520473080},{"type":"v1","addr":"172.21.15.169:6839","nonce":520473080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2666139932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2666139932},{"type":"v1","addr":"172.21.15.151:6835","nonce":2666139932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/251484638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":251484638},{"type":"v1","addr":"172.21.15.151:6833","nonce":251484638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/909327926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":909327926},{"type":"v1","addr":"172.21.15.151:6837","nonce":909327926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-18T11:09:31.589 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 3 2023-10-18T11:09:31.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.589+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5d4006aef0 msgr2=0x7f5d4006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:31.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.589+0000 7f5d5c7e7640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5d4006aef0 0x7f5d4006d3b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5d48034040 tx=0x7f5d48009030 comp rx=0 tx=0).stop 2023-10-18T11:09:31.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 msgr2=0x7f5d5414d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:31.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d5414d450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0013d0 tx=0x7f5d4c00e530 comp rx=0 tx=0).stop 2023-10-18T11:09:31.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 shutdown_connections 2023-10-18T11:09:31.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5d4006aef0 0x7f5d4006d3b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:31.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d540cbae0 0x7f5d5406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:31.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d5406cbf0 0x7f5d540cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:31.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 --2- 172.21.15.151:0/4174106089 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0047c0 0x7f5d5414d450 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:31.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 >> 172.21.15.151:0/4174106089 conn(0x7f5d540659d0 msgr2=0x7f5d54154c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:31.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 shutdown_connections 2023-10-18T11:09:31.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.590+0000 7f5d5c7e7640 1 -- 172.21.15.151:0/4174106089 wait complete. 2023-10-18T11:09:31.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.857+0000 7f5af1410640 1 Processor -- start 2023-10-18T11:09:31.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.857+0000 7f5af1410640 1 -- start start 2023-10-18T11:09:31.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.858+0000 7f5af1410640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5aec151190 0x7f5aec06e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:31.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.858+0000 7f5af1410640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec161660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:31.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.858+0000 7f5af1410640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec151570 con 0x7f5aec0c7000 2023-10-18T11:09:31.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.858+0000 7f5af1410640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aec0c5ad0 con 0x7f5aec151190 2023-10-18T11:09:31.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.858+0000 7f5af1410640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0c7730 con 0x7f5aec0c4a80 2023-10-18T11:09:31.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.859+0000 7f5aeb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:31.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.859+0000 7f5aeb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec161660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:40740/0 (socket says 172.21.15.151:40740) 2023-10-18T11:09:31.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.859+0000 7f5aeb7fe640 1 -- 172.21.15.151:0/1814309264 learned_addr learned my addr 172.21.15.151:0/1814309264 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.859+0000 7f5aeaffd640 1 --2- 172.21.15.151:0/1814309264 >> v2:172.21.15.151:3300/0 conn(0x7f5aec151190 0x7f5aec06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.862+0000 7f5aeb7fe640 1 -- 172.21.15.151:0/1814309264 >> v2:172.21.15.151:3300/0 conn(0x7f5aec151190 msgr2=0x7f5aec06e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.862+0000 7f5aeb7fe640 1 --2- 172.21.15.151:0/1814309264 >> v2:172.21.15.151:3300/0 conn(0x7f5aec151190 0x7f5aec06e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.862+0000 7f5aeb7fe640 1 -- 172.21.15.151:0/1814309264 >> v1:172.21.15.151:6789/0 conn(0x7f5aec0c7000 legacy=0x7f5aec0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.862+0000 7f5aeb7fe640 1 -- 172.21.15.151:0/1814309264 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec06dcb0 con 0x7f5aec0c4a80 2023-10-18T11:09:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.865+0000 7f5aeb7fe640 1 --2- 172.21.15.151:0/1814309264 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec161660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009e50 tx=0x7f5ae402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7571f9e0c5d21ec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.869+0000 7f5ae9ffb640 1 -- 172.21.15.151:0/1814309264 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae402cb00 con 0x7f5aec0c4a80 2023-10-18T11:09:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.869+0000 7f5ae9ffb640 1 -- 172.21.15.151:0/1814309264 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae402cc60 con 0x7f5aec0c4a80 2023-10-18T11:09:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.869+0000 7f5ae9ffb640 1 -- 172.21.15.151:0/1814309264 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40343f0 con 0x7f5aec0c4a80 2023-10-18T11:09:31.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.870+0000 7f5af1410640 1 -- 172.21.15.151:0/1814309264 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 msgr2=0x7f5aec161660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:31.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.870+0000 7f5af1410640 1 --2- 172.21.15.151:0/1814309264 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec161660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009e50 tx=0x7f5ae402bf60 comp rx=0 tx=0).stop 2023-10-18T11:09:31.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.870+0000 7f5af1410640 1 -- 172.21.15.151:0/1814309264 shutdown_connections 2023-10-18T11:09:31.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.870+0000 7f5af1410640 1 --2- 172.21.15.151:0/1814309264 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec161660 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:31.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.870+0000 7f5af1410640 1 --2- 172.21.15.151:0/1814309264 >> v2:172.21.15.151:3300/0 conn(0x7f5aec151190 0x7f5aec06e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:31.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.870+0000 7f5af1410640 1 -- 172.21.15.151:0/1814309264 >> 172.21.15.151:0/1814309264 conn(0x7f5aec0659d0 msgr2=0x7f5aec065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:31.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.871+0000 7f5af1410640 1 -- 172.21.15.151:0/1814309264 shutdown_connections 2023-10-18T11:09:31.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.871+0000 7f5af1410640 1 -- 172.21.15.151:0/1814309264 wait complete. 2023-10-18T11:09:31.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.873+0000 7f5af1410640 1 Processor -- start 2023-10-18T11:09:31.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.873+0000 7f5af1410640 1 -- start start 2023-10-18T11:09:31.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.874+0000 7f5af1410640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec06b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:31.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.874+0000 7f5af1410640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aec0c7000 0x7f5aec156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:31.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.874+0000 7f5af1410640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5aec151190 0x7f5aec156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:31.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.874+0000 7f5af1410640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec1eefc0 con 0x7f5aec0c7000 2023-10-18T11:09:31.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.874+0000 7f5af1410640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec1565f0 con 0x7f5aec151190 2023-10-18T11:09:31.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.874+0000 7f5af1410640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec1eea40 con 0x7f5aec0c4a80 2023-10-18T11:09:31.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.875+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec06b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:31.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.875+0000 7f5aeb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5aec151190 0x7f5aec156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:31.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.875+0000 7f5aea7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aec0c7000 0x7f5aec156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:31.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.875+0000 7f5aeaffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec06b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:40746/0 (socket says 172.21.15.151:40746) 2023-10-18T11:09:31.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.875+0000 7f5aeaffd640 1 -- 172.21.15.151:0/1448467114 learned_addr learned my addr 172.21.15.151:0/1448467114 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.879+0000 7f5aeaffd640 1 -- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5aec151190 msgr2=0x7f5aec156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.879+0000 7f5aeaffd640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5aec151190 0x7f5aec156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.879+0000 7f5aeaffd640 1 -- 172.21.15.151:0/1448467114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aec0c7000 msgr2=0x7f5aec156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:31.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.879+0000 7f5aeaffd640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aec0c7000 0x7f5aec156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:31.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.879+0000 7f5aeaffd640 1 -- 172.21.15.151:0/1448467114 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae4009b30 con 0x7f5aec0c4a80 2023-10-18T11:09:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.881+0000 7f5aeaffd640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec06b9f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00e9b0 tx=0x7f5adc00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:31.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.885+0000 7f5ad37fe640 1 -- 172.21.15.151:0/1448467114 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc009670 con 0x7f5aec0c4a80 2023-10-18T11:09:31.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.885+0000 7f5ad37fe640 1 -- 172.21.15.151:0/1448467114 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc00c9a0 con 0x7f5aec0c4a80 2023-10-18T11:09:31.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.885+0000 7f5ad37fe640 1 -- 172.21.15.151:0/1448467114 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc00cd50 con 0x7f5aec0c4a80 2023-10-18T11:09:31.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.885+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec1eece0 con 0x7f5aec0c4a80 2023-10-18T11:09:31.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.886+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec155fa0 con 0x7f5aec0c4a80 2023-10-18T11:09:31.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.887+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec04e1d0 con 0x7f5aec0c4a80 2023-10-18T11:09:31.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.915+0000 7f5ad37fe640 1 -- 172.21.15.151:0/1448467114 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5adc013470 con 0x7f5aec0c4a80 2023-10-18T11:09:31.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.917+0000 7f5ad37fe640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5ad806aef0 0x7f5ad806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:31.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.917+0000 7f5aea7fc640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5ad806aef0 0x7f5ad806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:31.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.917+0000 7f5ad37fe640 1 -- 172.21.15.151:0/1448467114 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5adc058d80 con 0x7f5aec0c4a80 2023-10-18T11:09:31.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:31.918+0000 7f5aea7fc640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5ad806aef0 0x7f5ad806d3b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5aec06b710 tx=0x7f5ae0009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:32.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.153+0000 7f5ad37fe640 1 -- 172.21.15.151:0/1448467114 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5adc0550c0 con 0x7f5aec0c4a80 2023-10-18T11:09:32.221 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:09:32.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:09:32.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.348+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5aec0c7890 con 0x7f5aec0c4a80 2023-10-18T11:09:32.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.467+0000 7f5ad37fe640 1 -- 172.21.15.151:0/1448467114 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12910 (secure 0 0 0) 0x7f5adc021020 con 0x7f5aec0c4a80 2023-10-18T11:09:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:32.470 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":19,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:20.293357+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:09:32.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5ad806aef0 msgr2=0x7f5ad806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:32.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5ad806aef0 0x7f5ad806d3b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5aec06b710 tx=0x7f5ae0009040 comp rx=0 tx=0).stop 2023-10-18T11:09:32.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 msgr2=0x7f5aec06b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:32.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec06b9f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00e9b0 tx=0x7f5adc00ee70 comp rx=0 tx=0).stop 2023-10-18T11:09:32.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 shutdown_connections 2023-10-18T11:09:32.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5ad806aef0 0x7f5ad806d3b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:32.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5aec151190 0x7f5aec156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:32.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aec0c7000 0x7f5aec156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:32.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 --2- 172.21.15.151:0/1448467114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aec0c4a80 0x7f5aec06b9f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:32.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 >> 172.21.15.151:0/1448467114 conn(0x7f5aec0659d0 msgr2=0x7f5aec0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:32.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 shutdown_connections 2023-10-18T11:09:32.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.470+0000 7f5af1410640 1 -- 172.21.15.151:0/1448467114 wait complete. 2023-10-18T11:09:32.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T11:09:16.833723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T11:09:32.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T11:09:32.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.703+0000 7fa11e6fc640 1 Processor -- start 2023-10-18T11:09:32.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.704+0000 7fa11e6fc640 1 -- start start 2023-10-18T11:09:32.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.706+0000 7fa11e6fc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa1180c2ff0 0x7fa1180c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:32.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.706+0000 7fa11e6fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa1180cc5a0 0x7fa1180cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:32.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.706+0000 7fa11e6fc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180c80e0 con 0x7fa1181565e0 2023-10-18T11:09:32.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.706+0000 7fa11e6fc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1181569c0 con 0x7fa1180c2ff0 2023-10-18T11:09:32.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.706+0000 7fa11e6fc640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1180c7170 con 0x7fa1180cc5a0 2023-10-18T11:09:32.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.706+0000 7fa11cc99640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa1180cc5a0 0x7fa1180cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:32.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.707+0000 7fa117fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fa1181565e0 0x7fa11806aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:55534/0 (socket says 172.21.15.151:55534) 2023-10-18T11:09:32.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.707+0000 7fa117fff640 1 -- 172.21.15.151:0/172546115 learned_addr learned my addr 172.21.15.151:0/172546115 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:32.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.710+0000 7fa11cc99640 1 -- 172.21.15.151:0/172546115 >> v2:172.21.15.151:3300/0 conn(0x7fa1180c2ff0 msgr2=0x7fa1180c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:32.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.710+0000 7fa11cc99640 1 --2- 172.21.15.151:0/172546115 >> v2:172.21.15.151:3300/0 conn(0x7fa1180c2ff0 0x7fa1180c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:32.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.710+0000 7fa11cc99640 1 -- 172.21.15.151:0/172546115 >> v1:172.21.15.169:6789/0 conn(0x7fa1181565e0 legacy=0x7fa11806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:32.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.710+0000 7fa11cc99640 1 -- 172.21.15.151:0/172546115 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1180c7450 con 0x7fa1180cc5a0 2023-10-18T11:09:32.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.714+0000 7fa11cc99640 1 --2- 172.21.15.151:0/172546115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 0x7fa1180cca10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1180ca4c0 tx=0x7fa11002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebf9e00513f4505 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:32.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.718+0000 7fa1177fe640 1 -- 172.21.15.151:0/172546115 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11002cd00 con 0x7fa1180cc5a0 2023-10-18T11:09:32.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.764+0000 7fa1177fe640 1 -- 172.21.15.151:0/172546115 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11002ce60 con 0x7fa1180cc5a0 2023-10-18T11:09:32.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.764+0000 7fa1177fe640 1 -- 172.21.15.151:0/172546115 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110034660 con 0x7fa1180cc5a0 2023-10-18T11:09:32.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.765+0000 7fa11e6fc640 1 -- 172.21.15.151:0/172546115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 msgr2=0x7fa1180cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:32.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.765+0000 7fa11e6fc640 1 --2- 172.21.15.151:0/172546115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 0x7fa1180cca10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1180ca4c0 tx=0x7fa11002bf50 comp rx=0 tx=0).stop 2023-10-18T11:09:32.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.765+0000 7fa11e6fc640 1 -- 172.21.15.151:0/172546115 shutdown_connections 2023-10-18T11:09:32.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.765+0000 7fa11e6fc640 1 --2- 172.21.15.151:0/172546115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 0x7fa1180cca10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:32.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.765+0000 7fa11e6fc640 1 --2- 172.21.15.151:0/172546115 >> v2:172.21.15.151:3300/0 conn(0x7fa1180c2ff0 0x7fa1180c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:32.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.765+0000 7fa11e6fc640 1 -- 172.21.15.151:0/172546115 >> 172.21.15.151:0/172546115 conn(0x7fa11806fa10 msgr2=0x7fa11806fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:32.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.766+0000 7fa11e6fc640 1 -- 172.21.15.151:0/172546115 shutdown_connections 2023-10-18T11:09:32.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.766+0000 7fa11e6fc640 1 -- 172.21.15.151:0/172546115 wait complete. 2023-10-18T11:09:32.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.769+0000 7fa11e6fc640 1 Processor -- start 2023-10-18T11:09:32.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.769+0000 7fa11e6fc640 1 -- start start 2023-10-18T11:09:32.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.771+0000 7fa11e6fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1180c2ff0 0x7fa11815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:32.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.771+0000 7fa11e6fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 0x7fa11815b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:32.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.771+0000 7fa11e6fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1181565e0 0x7fa1180cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:32.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.771+0000 7fa11e6fc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11815be40 con 0x7fa1181565e0 2023-10-18T11:09:32.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.771+0000 7fa11e6fc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa118152310 con 0x7fa1180cc5a0 2023-10-18T11:09:32.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.771+0000 7fa11e6fc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa118151fe0 con 0x7fa1180c2ff0 2023-10-18T11:09:32.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.772+0000 7fa117fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1180c2ff0 0x7fa11815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:32.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.772+0000 7fa10ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 0x7fa11815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:32.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.772+0000 7fa10ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 0x7fa11815b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:43156/0 (socket says 172.21.15.151:43156) 2023-10-18T11:09:32.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.772+0000 7fa117fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1180c2ff0 0x7fa11815aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:40756/0 (socket says 172.21.15.151:40756) 2023-10-18T11:09:32.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.772+0000 7fa10ffff640 1 -- 172.21.15.151:0/2662024492 learned_addr learned my addr 172.21.15.151:0/2662024492 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:32.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.775+0000 7fa117fff640 1 -- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 msgr2=0x7fa11815b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:32.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.775+0000 7fa117fff640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 0x7fa11815b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:32.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.775+0000 7fa117fff640 1 -- 172.21.15.151:0/2662024492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1181565e0 msgr2=0x7fa1180cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:32.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.775+0000 7fa117fff640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1181565e0 0x7fa1180cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:32.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.775+0000 7fa117fff640 1 -- 172.21.15.151:0/2662024492 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110009a70 con 0x7fa1180c2ff0 2023-10-18T11:09:32.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.780+0000 7fa117fff640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1180c2ff0 0x7fa11815aaf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa10800c470 tx=0x7fa10800c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:32.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.784+0000 7fa1157fa640 1 -- 172.21.15.151:0/2662024492 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108005ce0 con 0x7fa1180c2ff0 2023-10-18T11:09:32.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.784+0000 7fa1157fa640 1 -- 172.21.15.151:0/2662024492 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa108005e40 con 0x7fa1180c2ff0 2023-10-18T11:09:32.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.784+0000 7fa1157fa640 1 -- 172.21.15.151:0/2662024492 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080072d0 con 0x7fa1180c2ff0 2023-10-18T11:09:32.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.784+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11815c820 con 0x7fa1180c2ff0 2023-10-18T11:09:32.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.784+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11815cde0 con 0x7fa1180c2ff0 2023-10-18T11:09:32.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.785+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11804e160 con 0x7fa1180c2ff0 2023-10-18T11:09:32.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.807+0000 7fa1157fa640 1 -- 172.21.15.151:0/2662024492 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa108007430 con 0x7fa1180c2ff0 2023-10-18T11:09:32.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.808+0000 7fa1157fa640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa0f806aec0 0x7fa0f806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:32.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.809+0000 7fa10ffff640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa0f806aec0 0x7fa0f806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:32.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.809+0000 7fa1157fa640 1 -- 172.21.15.151:0/2662024492 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa108058080 con 0x7fa1180c2ff0 2023-10-18T11:09:32.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:32.809+0000 7fa10ffff640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa0f806aec0 0x7fa0f806d380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa11806cf70 tx=0x7fa1000091c0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.051+0000 7fa1157fa640 1 -- 172.21.15.151:0/2662024492 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1080543c0 con 0x7fa1180c2ff0 2023-10-18T11:09:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.247+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1180cd430 con 0x7fa1180c2ff0 2023-10-18T11:09:33.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.268+0000 7fa1157fa640 1 -- 172.21.15.151:0/2662024492 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa108017020 con 0x7fa1180c2ff0 2023-10-18T11:09:33.271 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-10-18T11:09:33.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa0f806aec0 msgr2=0x7fa0f806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:33.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa0f806aec0 0x7fa0f806d380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa11806cf70 tx=0x7fa1000091c0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1180c2ff0 msgr2=0x7fa11815aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:33.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1180c2ff0 0x7fa11815aaf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa10800c470 tx=0x7fa10800c930 comp rx=0 tx=0).stop 2023-10-18T11:09:33.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 shutdown_connections 2023-10-18T11:09:33.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1181565e0 0x7fa1180cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa0f806aec0 0x7fa0f806d380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1180cc5a0 0x7fa11815b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 --2- 172.21.15.151:0/2662024492 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1180c2ff0 0x7fa11815aaf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 >> 172.21.15.151:0/2662024492 conn(0x7fa11806fa10 msgr2=0x7fa11806aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:33.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 shutdown_connections 2023-10-18T11:09:33.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.271+0000 7fa11e6fc640 1 -- 172.21.15.151:0/2662024492 wait complete. 2023-10-18T11:09:33.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-18T11:09:33.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.503+0000 7f2c00826640 1 Processor -- start 2023-10-18T11:09:33.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.503+0000 7f2c00826640 1 -- start start 2023-10-18T11:09:33.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.505+0000 7f2c00826640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc0c6820 0x7f2bfc06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:33.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.505+0000 7f2c00826640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2bfc070280 0x7f2bfc06d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:33.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.505+0000 7f2c00826640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc157a90 con 0x7f2bfc1576b0 2023-10-18T11:09:33.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.505+0000 7f2c00826640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc0c5ab0 con 0x7f2bfc070280 2023-10-18T11:09:33.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.505+0000 7f2c00826640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc161850 con 0x7f2bfc0c6820 2023-10-18T11:09:33.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.505+0000 7f2bfad9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2bfc070280 0x7f2bfc06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:33.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.505+0000 7f2bf9d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc0c6820 0x7f2bfc06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:33.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.506+0000 7f2bf9d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc0c6820 0x7f2bfc06fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:40764/0 (socket says 172.21.15.151:40764) 2023-10-18T11:09:33.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.506+0000 7f2bf9d9b640 1 -- 172.21.15.151:0/1894441562 learned_addr learned my addr 172.21.15.151:0/1894441562 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:33.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.508+0000 7f2bf9d9b640 1 -- 172.21.15.151:0/1894441562 >> v2:172.21.15.169:3300/0 conn(0x7f2bfc070280 msgr2=0x7f2bfc06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:33.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.508+0000 7f2bf9d9b640 1 --2- 172.21.15.151:0/1894441562 >> v2:172.21.15.169:3300/0 conn(0x7f2bfc070280 0x7f2bfc06d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.508+0000 7f2bf9d9b640 1 -- 172.21.15.151:0/1894441562 >> v1:172.21.15.169:6789/0 conn(0x7f2bfc1576b0 legacy=0x7f2bfc15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:33.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.508+0000 7f2bf9d9b640 1 -- 172.21.15.151:0/1894441562 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0c57d0 con 0x7f2bfc0c6820 2023-10-18T11:09:33.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.510+0000 7f2bf9d9b640 1 --2- 172.21.15.151:0/1894441562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc0c6820 0x7f2bfc06fd40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009870 tx=0x7f2bec02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=437509bfe3d31ba5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:33.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.514+0000 7f2bf959a640 1 -- 172.21.15.151:0/1894441562 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec02f830 con 0x7f2bfc0c6820 2023-10-18T11:09:33.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.514+0000 7f2bf959a640 1 -- 172.21.15.151:0/1894441562 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec02f990 con 0x7f2bfc0c6820 2023-10-18T11:09:33.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.514+0000 7f2bf959a640 1 -- 172.21.15.151:0/1894441562 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec02fd20 con 0x7f2bfc0c6820 2023-10-18T11:09:33.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.514+0000 7f2c00826640 1 -- 172.21.15.151:0/1894441562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc0c6820 msgr2=0x7f2bfc06fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:33.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.514+0000 7f2c00826640 1 --2- 172.21.15.151:0/1894441562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc0c6820 0x7f2bfc06fd40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009870 tx=0x7f2bec02ba10 comp rx=0 tx=0).stop 2023-10-18T11:09:33.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.515+0000 7f2c00826640 1 -- 172.21.15.151:0/1894441562 shutdown_connections 2023-10-18T11:09:33.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.515+0000 7f2c00826640 1 --2- 172.21.15.151:0/1894441562 >> v2:172.21.15.169:3300/0 conn(0x7f2bfc070280 0x7f2bfc06d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.515+0000 7f2c00826640 1 --2- 172.21.15.151:0/1894441562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc0c6820 0x7f2bfc06fd40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.515+0000 7f2c00826640 1 -- 172.21.15.151:0/1894441562 >> 172.21.15.151:0/1894441562 conn(0x7f2bfc0c6f10 msgr2=0x7f2bfc0c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:33.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.515+0000 7f2c00826640 1 -- 172.21.15.151:0/1894441562 shutdown_connections 2023-10-18T11:09:33.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.515+0000 7f2c00826640 1 -- 172.21.15.151:0/1894441562 wait complete. 2023-10-18T11:09:33.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.517+0000 7f2c00826640 1 Processor -- start 2023-10-18T11:09:33.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.517+0000 7f2c00826640 1 -- start start 2023-10-18T11:09:33.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.519+0000 7f2c00826640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bfc070280 0x7f2bfc14ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:33.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.519+0000 7f2c00826640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bfc0c6820 0x7f2bfc1f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:33.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.519+0000 7f2c00826640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc1576b0 0x7f2bfc15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:33.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.519+0000 7f2c00826640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc15ea50 con 0x7f2bfc070280 2023-10-18T11:09:33.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.519+0000 7f2c00826640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1f2ac0 con 0x7f2bfc0c6820 2023-10-18T11:09:33.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.519+0000 7f2c00826640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1f2da0 con 0x7f2bfc1576b0 2023-10-18T11:09:33.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.519+0000 7f2bf9d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bfc0c6820 0x7f2bfc1f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:33.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.520+0000 7f2bfad9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc1576b0 0x7f2bfc15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:33.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.520+0000 7f2bfa59c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bfc070280 0x7f2bfc14ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:33.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.520+0000 7f2bf9d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bfc0c6820 0x7f2bfc1f21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:43176/0 (socket says 172.21.15.151:43176) 2023-10-18T11:09:33.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.520+0000 7f2bf9d9b640 1 -- 172.21.15.151:0/3270646532 learned_addr learned my addr 172.21.15.151:0/3270646532 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.523+0000 7f2bf9d9b640 1 -- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc1576b0 msgr2=0x7f2bfc15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.523+0000 7f2bf9d9b640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc1576b0 0x7f2bfc15ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.523+0000 7f2bf9d9b640 1 -- 172.21.15.151:0/3270646532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bfc070280 msgr2=0x7f2bfc14ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.523+0000 7f2bf9d9b640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bfc070280 0x7f2bfc14ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.523+0000 7f2bf9d9b640 1 -- 172.21.15.151:0/3270646532 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec0094d0 con 0x7f2bfc0c6820 2023-10-18T11:09:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.526+0000 7f2bf9d9b640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bfc0c6820 0x7f2bfc1f21a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bec02ba50 tx=0x7f2bec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.529+0000 7f2bf2ffd640 1 -- 172.21.15.151:0/3270646532 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec037c40 con 0x7f2bfc0c6820 2023-10-18T11:09:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.530+0000 7f2bf2ffd640 1 -- 172.21.15.151:0/3270646532 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec037da0 con 0x7f2bfc0c6820 2023-10-18T11:09:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.530+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc15e390 con 0x7f2bfc0c6820 2023-10-18T11:09:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.530+0000 7f2bf2ffd640 1 -- 172.21.15.151:0/3270646532 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0426c0 con 0x7f2bfc0c6820 2023-10-18T11:09:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.530+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc1f3080 con 0x7f2bfc0c6820 2023-10-18T11:09:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.531+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc0c5f80 con 0x7f2bfc0c6820 2023-10-18T11:09:33.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.782+0000 7f2bf2ffd640 1 -- 172.21.15.151:0/3270646532 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2bec02d3c0 con 0x7f2bfc0c6820 2023-10-18T11:09:33.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.784+0000 7f2bf2ffd640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2bdc06aec0 0x7f2bdc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:33.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.784+0000 7f2bf2ffd640 1 -- 172.21.15.151:0/3270646532 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2bec03c070 con 0x7f2bfc0c6820 2023-10-18T11:09:33.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.784+0000 7f2bfa59c640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2bdc06aec0 0x7f2bdc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:33.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.785+0000 7f2bfa59c640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2bdc06aec0 0x7f2bdc06d380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2be4000f60 tx=0x7f2be4009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:33.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:33.796+0000 7f2bf2ffd640 1 -- 172.21.15.151:0/3270646532 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2bec0772b0 con 0x7f2bfc0c6820 2023-10-18T11:09:34.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.028+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2bfc161020 con 0x7f2bfc0c6820 2023-10-18T11:09:34.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.035+0000 7f2bf2ffd640 1 -- 172.21.15.151:0/3270646532 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2bec047060 con 0x7f2bfc0c6820 2023-10-18T11:09:34.037 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:34.038 INFO:teuthology.orchestra.run.smithi151.stdout:[ 2023-10-18T11:09:34.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-10-18T11:09:34.038 INFO:teuthology.orchestra.run.smithi151.stdout: "poolnum": 1, 2023-10-18T11:09:34.038 INFO:teuthology.orchestra.run.smithi151.stdout: "poolname": ".mgr" 2023-10-18T11:09:34.038 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-10-18T11:09:34.039 INFO:teuthology.orchestra.run.smithi151.stdout:] 2023-10-18T11:09:34.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2bdc06aec0 msgr2=0x7f2bdc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:34.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2bdc06aec0 0x7f2bdc06d380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2be4000f60 tx=0x7f2be4009040 comp rx=0 tx=0).stop 2023-10-18T11:09:34.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bfc0c6820 msgr2=0x7f2bfc1f21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:34.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bfc0c6820 0x7f2bfc1f21a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bec02ba50 tx=0x7f2bec004730 comp rx=0 tx=0).stop 2023-10-18T11:09:34.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 shutdown_connections 2023-10-18T11:09:34.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2bfc1576b0 0x7f2bfc15ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:34.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2bdc06aec0 0x7f2bdc06d380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:34.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2bfc0c6820 0x7f2bfc1f21a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:34.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 --2- 172.21.15.151:0/3270646532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bfc070280 0x7f2bfc14ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:34.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 >> 172.21.15.151:0/3270646532 conn(0x7f2bfc0c6f10 msgr2=0x7f2bfc0c3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:34.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 shutdown_connections 2023-10-18T11:09:34.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.038+0000 7f2c00826640 1 -- 172.21.15.151:0/3270646532 wait complete. 2023-10-18T11:09:34.059 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-18T11:09:34.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-18T11:09:34.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.264+0000 7f661aeea640 1 Processor -- start 2023-10-18T11:09:34.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.264+0000 7f661aeea640 1 -- start start 2023-10-18T11:09:34.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.266+0000 7f661aeea640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6614158f10 0x7f6614159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:34.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.266+0000 7f661aeea640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661406c3f0 con 0x7f66140c51e0 2023-10-18T11:09:34.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.266+0000 7f661aeea640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66140c1b10 con 0x7f661414f600 2023-10-18T11:09:34.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.266+0000 7f661aeea640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661414f9e0 con 0x7f6614158f10 2023-10-18T11:09:34.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.266+0000 7f661a6e9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6614158f10 0x7f6614159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:34.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.267+0000 7f6619ee8640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f661414f600 0x7f661406c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:55550/0 (socket says 172.21.15.151:55550) 2023-10-18T11:09:34.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.267+0000 7f6619ee8640 1 -- 172.21.15.151:0/2445760467 learned_addr learned my addr 172.21.15.151:0/2445760467 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:34.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.269+0000 7f661a6e9640 1 -- 172.21.15.151:0/2445760467 >> v1:172.21.15.169:6789/0 conn(0x7f661414f600 legacy=0x7f661406c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:34.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.269+0000 7f661a6e9640 1 -- 172.21.15.151:0/2445760467 >> v1:172.21.15.151:6789/0 conn(0x7f66140c51e0 legacy=0x7f6614158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:34.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.269+0000 7f661a6e9640 1 -- 172.21.15.151:0/2445760467 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661406cf90 con 0x7f6614158f10 2023-10-18T11:09:34.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.269+0000 7f6618ee6640 1 -- 172.21.15.151:0/2445760467 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380670866 0 0) 0x7f66140c1b10 con 0x7f661414f600 2023-10-18T11:09:34.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.271+0000 7f661a6e9640 1 --2- 172.21.15.151:0/2445760467 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6614158f10 0x7f6614159380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f661414fb20 tx=0x7f660c02cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e25586cb30b6506 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:34.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.275+0000 7f6618ee6640 1 -- 172.21.15.151:0/2445760467 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c02db20 con 0x7f6614158f10 2023-10-18T11:09:34.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.275+0000 7f6618ee6640 1 -- 172.21.15.151:0/2445760467 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c02dc80 con 0x7f6614158f10 2023-10-18T11:09:34.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.275+0000 7f6618ee6640 1 -- 172.21.15.151:0/2445760467 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c00a2e0 con 0x7f6614158f10 2023-10-18T11:09:34.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.275+0000 7f661aeea640 1 -- 172.21.15.151:0/2445760467 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6614158f10 msgr2=0x7f6614159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:34.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.275+0000 7f661aeea640 1 --2- 172.21.15.151:0/2445760467 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6614158f10 0x7f6614159380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f661414fb20 tx=0x7f660c02cf80 comp rx=0 tx=0).stop 2023-10-18T11:09:34.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.275+0000 7f661aeea640 1 -- 172.21.15.151:0/2445760467 shutdown_connections 2023-10-18T11:09:34.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.275+0000 7f661aeea640 1 --2- 172.21.15.151:0/2445760467 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6614158f10 0x7f6614159380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:34.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.275+0000 7f661aeea640 1 -- 172.21.15.151:0/2445760467 >> 172.21.15.151:0/2445760467 conn(0x7f66140ca330 msgr2=0x7f66140ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:34.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.276+0000 7f661aeea640 1 -- 172.21.15.151:0/2445760467 shutdown_connections 2023-10-18T11:09:34.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.276+0000 7f661aeea640 1 -- 172.21.15.151:0/2445760467 wait complete. 2023-10-18T11:09:34.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.277+0000 7f661aeea640 1 Processor -- start 2023-10-18T11:09:34.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.277+0000 7f661aeea640 1 -- start start 2023-10-18T11:09:34.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.278+0000 7f661aeea640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66140c51e0 0x7f66140c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:34.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.278+0000 7f661aeea640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f661414f600 0x7f66141ef030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:34.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.278+0000 7f661aeea640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614158f10 0x7f6614153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:34.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.278+0000 7f661aeea640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66141eec10 con 0x7f661414f600 2023-10-18T11:09:34.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.278+0000 7f661aeea640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6614153410 con 0x7f6614158f10 2023-10-18T11:09:34.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.278+0000 7f661aeea640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6614155ab0 con 0x7f66140c51e0 2023-10-18T11:09:34.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.279+0000 7f66196e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f661414f600 0x7f66141ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:34.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.279+0000 7f661a6e9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614158f10 0x7f6614153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:34.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.279+0000 7f6619ee8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66140c51e0 0x7f66140c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:34.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.279+0000 7f66196e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f661414f600 0x7f66141ef030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41214/0 (socket says 172.21.15.151:41214) 2023-10-18T11:09:34.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.279+0000 7f66196e7640 1 -- 172.21.15.151:0/313055868 learned_addr learned my addr 172.21.15.151:0/313055868 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:34.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.283+0000 7f6619ee8640 1 -- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614158f10 msgr2=0x7f6614153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:34.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.283+0000 7f6619ee8640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614158f10 0x7f6614153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:34.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.283+0000 7f6619ee8640 1 -- 172.21.15.151:0/313055868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f661414f600 msgr2=0x7f66141ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:34.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.283+0000 7f6619ee8640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f661414f600 0x7f66141ef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:34.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.283+0000 7f6619ee8640 1 -- 172.21.15.151:0/313055868 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c00ab80 con 0x7f66140c51e0 2023-10-18T11:09:34.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.285+0000 7f6619ee8640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66140c51e0 0x7f66140c9970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f661000c410 tx=0x7f661000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:34.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.289+0000 7f660a7fc640 1 -- 172.21.15.151:0/313055868 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100074e0 con 0x7f66140c51e0 2023-10-18T11:09:34.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.289+0000 7f660a7fc640 1 -- 172.21.15.151:0/313055868 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610007640 con 0x7f66140c51e0 2023-10-18T11:09:34.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.289+0000 7f660a7fc640 1 -- 172.21.15.151:0/313055868 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610004a20 con 0x7f66140c51e0 2023-10-18T11:09:34.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.289+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661414ce20 con 0x7f66140c51e0 2023-10-18T11:09:34.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.289+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66141567a0 con 0x7f66140c51e0 2023-10-18T11:09:34.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.290+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66141eed50 con 0x7f66140c51e0 2023-10-18T11:09:34.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.308+0000 7f660a7fc640 1 -- 172.21.15.151:0/313055868 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6610004b80 con 0x7f66140c51e0 2023-10-18T11:09:34.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.309+0000 7f660a7fc640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f65f806aec0 0x7f65f806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:34.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.309+0000 7f66196e7640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f65f806aec0 0x7f65f806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:34.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.310+0000 7f660a7fc640 1 -- 172.21.15.151:0/313055868 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66100588b0 con 0x7f66140c51e0 2023-10-18T11:09:34.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.310+0000 7f66196e7640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f65f806aec0 0x7f65f806d380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66140c12c0 tx=0x7f6604009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:34.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.557+0000 7f660a7fc640 1 -- 172.21.15.151:0/313055868 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6610054bf0 con 0x7f66140c51e0 2023-10-18T11:09:34.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:34.772+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f66140c3210 con 0x7f66140c51e0 2023-10-18T11:09:35.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.939+0000 7f660a7fc640 1 -- 172.21.15.151:0/313055868 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6610058210 con 0x7f66140c51e0 2023-10-18T11:09:35.942 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_metadata' created 2023-10-18T11:09:35.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f65f806aec0 msgr2=0x7f65f806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:35.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f65f806aec0 0x7f65f806d380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66140c12c0 tx=0x7f6604009040 comp rx=0 tx=0).stop 2023-10-18T11:09:35.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66140c51e0 msgr2=0x7f66140c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:35.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66140c51e0 0x7f66140c9970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f661000c410 tx=0x7f661000c8d0 comp rx=0 tx=0).stop 2023-10-18T11:09:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 shutdown_connections 2023-10-18T11:09:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f65f806aec0 0x7f65f806d380 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6614158f10 0x7f6614153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f661414f600 0x7f66141ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 --2- 172.21.15.151:0/313055868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66140c51e0 0x7f66140c9970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.943+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 >> 172.21.15.151:0/313055868 conn(0x7f66140ca330 msgr2=0x7f66140ca710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.944+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 shutdown_connections 2023-10-18T11:09:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:35.944+0000 7f661aeea640 1 -- 172.21.15.151:0/313055868 wait complete. 2023-10-18T11:09:35.965 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-18T11:09:36.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.176+0000 7fc50c861640 1 Processor -- start 2023-10-18T11:09:36.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.177+0000 7fc50c861640 1 -- start start 2023-10-18T11:09:36.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.178+0000 7fc50c861640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc5080c52d0 0x7fc50815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:36.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.178+0000 7fc50c861640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5080c5780 con 0x7fc508150d10 2023-10-18T11:09:36.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.178+0000 7fc50c861640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc508156f80 con 0x7fc5080c4e60 2023-10-18T11:09:36.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.178+0000 7fc50c861640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc508157260 con 0x7fc5080c52d0 2023-10-18T11:09:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.179+0000 7fc506d9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc5080c52d0 0x7fc50815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.179+0000 7fc50659c640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fc508150d10 0x7fc5080c18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:40206/0 (socket says 172.21.15.151:40206) 2023-10-18T11:09:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.179+0000 7fc4fffff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fc5080c4e60 0x7fc5080c63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:55552/0 (socket says 172.21.15.151:55552) 2023-10-18T11:09:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.179+0000 7fc50659c640 1 -- 172.21.15.151:0/3669047700 learned_addr learned my addr 172.21.15.151:0/3669047700 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:36.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.182+0000 7fc505d9b640 1 -- 172.21.15.151:0/3669047700 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745176264 0 0) 0x7fc5080c5780 con 0x7fc508150d10 2023-10-18T11:09:36.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.182+0000 7fc505d9b640 1 -- 172.21.15.151:0/3669047700 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f4003520 con 0x7fc508150d10 2023-10-18T11:09:36.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.184+0000 7fc506d9d640 1 -- 172.21.15.151:0/3669047700 >> v1:172.21.15.169:6789/0 conn(0x7fc5080c4e60 legacy=0x7fc5080c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:36.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.184+0000 7fc506d9d640 1 -- 172.21.15.151:0/3669047700 >> v1:172.21.15.151:6789/0 conn(0x7fc508150d10 legacy=0x7fc5080c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:36.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.184+0000 7fc506d9d640 1 -- 172.21.15.151:0/3669047700 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508157540 con 0x7fc5080c52d0 2023-10-18T11:09:36.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.187+0000 7fc506d9d640 1 --2- 172.21.15.151:0/3669047700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c52d0 0x7fc50815a4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc500009dc0 tx=0x7fc50002bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcf4a2af8dfa8a03 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:36.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.191+0000 7fc505d9b640 1 -- 172.21.15.151:0/3669047700 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50002ccd0 con 0x7fc5080c52d0 2023-10-18T11:09:36.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.191+0000 7fc505d9b640 1 -- 172.21.15.151:0/3669047700 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50002ce30 con 0x7fc5080c52d0 2023-10-18T11:09:36.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.191+0000 7fc505d9b640 1 -- 172.21.15.151:0/3669047700 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500034660 con 0x7fc5080c52d0 2023-10-18T11:09:36.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.191+0000 7fc50c861640 1 -- 172.21.15.151:0/3669047700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c52d0 msgr2=0x7fc50815a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:36.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.191+0000 7fc50c861640 1 --2- 172.21.15.151:0/3669047700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c52d0 0x7fc50815a4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc500009dc0 tx=0x7fc50002bf20 comp rx=0 tx=0).stop 2023-10-18T11:09:36.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.192+0000 7fc50c861640 1 -- 172.21.15.151:0/3669047700 shutdown_connections 2023-10-18T11:09:36.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.192+0000 7fc50c861640 1 --2- 172.21.15.151:0/3669047700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c52d0 0x7fc50815a4d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:36.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.192+0000 7fc50c861640 1 -- 172.21.15.151:0/3669047700 >> 172.21.15.151:0/3669047700 conn(0x7fc508069f70 msgr2=0x7fc50806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:36.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.192+0000 7fc50c861640 1 -- 172.21.15.151:0/3669047700 shutdown_connections 2023-10-18T11:09:36.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.192+0000 7fc50c861640 1 -- 172.21.15.151:0/3669047700 wait complete. 2023-10-18T11:09:36.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.194+0000 7fc50c861640 1 Processor -- start 2023-10-18T11:09:36.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.194+0000 7fc50c861640 1 -- start start 2023-10-18T11:09:36.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.195+0000 7fc50c861640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c4e60 0x7fc5081ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:36.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.195+0000 7fc50c861640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5080c52d0 0x7fc50814f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:36.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.195+0000 7fc50c861640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc508150d10 0x7fc508140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:36.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.195+0000 7fc50c861640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50814fe00 con 0x7fc5080c52d0 2023-10-18T11:09:36.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.195+0000 7fc50c861640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50814f8a0 con 0x7fc5080c4e60 2023-10-18T11:09:36.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.195+0000 7fc50c861640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50814e690 con 0x7fc508150d10 2023-10-18T11:09:36.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.195+0000 7fc50659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c4e60 0x7fc5081ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:36.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.196+0000 7fc506d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc508150d10 0x7fc508140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:36.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.196+0000 7fc50659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c4e60 0x7fc5081ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:43202/0 (socket says 172.21.15.151:43202) 2023-10-18T11:09:36.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.196+0000 7fc50659c640 1 -- 172.21.15.151:0/3092766757 learned_addr learned my addr 172.21.15.151:0/3092766757 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:36.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.199+0000 7fc50659c640 1 -- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc508150d10 msgr2=0x7fc508140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:36.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.199+0000 7fc50659c640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc508150d10 0x7fc508140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:36.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.199+0000 7fc50659c640 1 -- 172.21.15.151:0/3092766757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5080c52d0 msgr2=0x7fc50814f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:36.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.199+0000 7fc50659c640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5080c52d0 0x7fc50814f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:36.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.199+0000 7fc50659c640 1 -- 172.21.15.151:0/3092766757 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500009a70 con 0x7fc5080c4e60 2023-10-18T11:09:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.202+0000 7fc50659c640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c4e60 0x7fc5081ed610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800c410 tx=0x7fc4f800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:36.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.205+0000 7fc4feffd640 1 -- 172.21.15.151:0/3092766757 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8005ce0 con 0x7fc5080c4e60 2023-10-18T11:09:36.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.205+0000 7fc4feffd640 1 -- 172.21.15.151:0/3092766757 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f8005e40 con 0x7fc5080c4e60 2023-10-18T11:09:36.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.205+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc508140c70 con 0x7fc5080c4e60 2023-10-18T11:09:36.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.206+0000 7fc4feffd640 1 -- 172.21.15.151:0/3092766757 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80072f0 con 0x7fc5080c4e60 2023-10-18T11:09:36.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.206+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50814e930 con 0x7fc5080c4e60 2023-10-18T11:09:36.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.207+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50814e4f0 con 0x7fc5080c4e60 2023-10-18T11:09:36.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.226+0000 7fc4feffd640 1 -- 172.21.15.151:0/3092766757 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4f8007510 con 0x7fc5080c4e60 2023-10-18T11:09:36.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.227+0000 7fc4feffd640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc4e806aec0 0x7fc4e806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:36.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.228+0000 7fc4feffd640 1 -- 172.21.15.151:0/3092766757 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc4f8088e00 con 0x7fc5080c4e60 2023-10-18T11:09:36.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.228+0000 7fc4fffff640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc4e806aec0 0x7fc4e806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:36.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.229+0000 7fc4fffff640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc4e806aec0 0x7fc4e806d380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc5080cab20 tx=0x7fc4f00079c0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:36.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.468+0000 7fc4feffd640 1 -- 172.21.15.151:0/3092766757 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4f8054150 con 0x7fc5080c4e60 2023-10-18T11:09:36.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:36.699+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fc50814e4f0 con 0x7fc5080c4e60 2023-10-18T11:09:37.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.968+0000 7fc4feffd640 1 -- 172.21.15.151:0/3092766757 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7fc50814e4f0 con 0x7fc5080c4e60 2023-10-18T11:09:37.972 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_data' created 2023-10-18T11:09:37.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.977+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc4e806aec0 msgr2=0x7fc4e806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:37.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.977+0000 7fc50c861640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc4e806aec0 0x7fc4e806d380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc5080cab20 tx=0x7fc4f00079c0 comp rx=0 tx=0).stop 2023-10-18T11:09:37.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.977+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c4e60 msgr2=0x7fc5081ed610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:37.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.977+0000 7fc50c861640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c4e60 0x7fc5081ed610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800c410 tx=0x7fc4f800c8d0 comp rx=0 tx=0).stop 2023-10-18T11:09:37.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.979+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 shutdown_connections 2023-10-18T11:09:37.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.979+0000 7fc50c861640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc508150d10 0x7fc508140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:37.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.979+0000 7fc50c861640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5080c52d0 0x7fc50814f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:37.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.979+0000 7fc50c861640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc4e806aec0 0x7fc4e806d380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:37.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.979+0000 7fc50c861640 1 --2- 172.21.15.151:0/3092766757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5080c4e60 0x7fc5081ed610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:37.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.979+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 >> 172.21.15.151:0/3092766757 conn(0x7fc508069f70 msgr2=0x7fc5080c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:37.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.980+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 shutdown_connections 2023-10-18T11:09:37.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:37.980+0000 7fc50c861640 1 -- 172.21.15.151:0/3092766757 wait complete. 2023-10-18T11:09:38.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-18T11:09:38.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.201+0000 7fd34e1d0640 1 Processor -- start 2023-10-18T11:09:38.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.201+0000 7fd34e1d0640 1 -- start start 2023-10-18T11:09:38.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.202+0000 7fd34e1d0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3481565b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:38.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.202+0000 7fd34e1d0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd3480c5f70 0x7fd3480c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:38.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.202+0000 7fd34e1d0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd348156af0 0x7fd3480c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:38.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.202+0000 7fd34e1d0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd348156190 con 0x7fd348156af0 2023-10-18T11:09:38.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.202+0000 7fd34e1d0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3481593c0 con 0x7fd3480c5f70 2023-10-18T11:09:38.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.202+0000 7fd34e1d0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd348155dd0 con 0x7fd3481501d0 2023-10-18T11:09:38.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.203+0000 7fd346ffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd3480c5f70 0x7fd3480c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:38.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.203+0000 7fd3477fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3481565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:38.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.203+0000 7fd3477fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3481565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:59230/0 (socket says 172.21.15.151:59230) 2023-10-18T11:09:38.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.203+0000 7fd3477fe640 1 -- 172.21.15.151:0/1304238004 learned_addr learned my addr 172.21.15.151:0/1304238004 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:38.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.205+0000 7fd346ffd640 1 -- 172.21.15.151:0/1304238004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 msgr2=0x7fd3481565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:38.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.205+0000 7fd346ffd640 1 --2- 172.21.15.151:0/1304238004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3481565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:38.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.205+0000 7fd346ffd640 1 -- 172.21.15.151:0/1304238004 >> v2:172.21.15.151:3300/0 conn(0x7fd348156af0 msgr2=0x7fd3480c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:38.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.205+0000 7fd346ffd640 1 --2- 172.21.15.151:0/1304238004 >> v2:172.21.15.151:3300/0 conn(0x7fd348156af0 0x7fd3480c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:38.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.206+0000 7fd346ffd640 1 -- 172.21.15.151:0/1304238004 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480c7250 con 0x7fd3480c5f70 2023-10-18T11:09:38.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.208+0000 7fd346ffd640 1 --2- 172.21.15.151:0/1304238004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3480c5f70 0x7fd3480c4700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd348071f20 tx=0x7fd33c02b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=148853643214df44 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:38.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.211+0000 7fd3467fc640 1 -- 172.21.15.151:0/1304238004 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c030710 con 0x7fd3480c5f70 2023-10-18T11:09:38.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.211+0000 7fd3467fc640 1 -- 172.21.15.151:0/1304238004 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c02e050 con 0x7fd3480c5f70 2023-10-18T11:09:38.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.211+0000 7fd3467fc640 1 -- 172.21.15.151:0/1304238004 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c030a90 con 0x7fd3480c5f70 2023-10-18T11:09:38.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.212+0000 7fd34e1d0640 1 -- 172.21.15.151:0/1304238004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3480c5f70 msgr2=0x7fd3480c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:38.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.212+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/1304238004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3480c5f70 0x7fd3480c4700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd348071f20 tx=0x7fd33c02b740 comp rx=0 tx=0).stop 2023-10-18T11:09:38.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.212+0000 7fd34e1d0640 1 -- 172.21.15.151:0/1304238004 shutdown_connections 2023-10-18T11:09:38.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.212+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/1304238004 >> v2:172.21.15.151:3300/0 conn(0x7fd348156af0 0x7fd3480c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:38.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.212+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/1304238004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3480c5f70 0x7fd3480c4700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:38.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.212+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/1304238004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3481565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:38.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.212+0000 7fd34e1d0640 1 -- 172.21.15.151:0/1304238004 >> 172.21.15.151:0/1304238004 conn(0x7fd34806b080 msgr2=0x7fd34806b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:38.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.212+0000 7fd34e1d0640 1 -- 172.21.15.151:0/1304238004 shutdown_connections 2023-10-18T11:09:38.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.212+0000 7fd34e1d0640 1 -- 172.21.15.151:0/1304238004 wait complete. 2023-10-18T11:09:38.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.214+0000 7fd34e1d0640 1 Processor -- start 2023-10-18T11:09:38.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.214+0000 7fd34e1d0640 1 -- start start 2023-10-18T11:09:38.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.215+0000 7fd34e1d0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3480c5f70 0x7fd348154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:38.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.215+0000 7fd34e1d0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3480c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:38.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.215+0000 7fd34e1d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd348156af0 0x7fd348156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:38.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.215+0000 7fd34e1d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3481edbc0 con 0x7fd348156af0 2023-10-18T11:09:38.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.215+0000 7fd34e1d0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd348152150 con 0x7fd3480c5f70 2023-10-18T11:09:38.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.215+0000 7fd34e1d0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd348155490 con 0x7fd3481501d0 2023-10-18T11:09:38.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.215+0000 7fd346ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3480c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:38.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.216+0000 7fd3477fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3480c5f70 0x7fd348154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:38.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.216+0000 7fd346ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3480c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:59236/0 (socket says 172.21.15.151:59236) 2023-10-18T11:09:38.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.216+0000 7fd346ffd640 1 -- 172.21.15.151:0/4122671452 learned_addr learned my addr 172.21.15.151:0/4122671452 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:38.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.219+0000 7fd346ffd640 1 -- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3480c5f70 msgr2=0x7fd348154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:38.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.219+0000 7fd346ffd640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3480c5f70 0x7fd348154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:38.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.219+0000 7fd346ffd640 1 -- 172.21.15.151:0/4122671452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd348156af0 msgr2=0x7fd348156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:38.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.219+0000 7fd346ffd640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd348156af0 0x7fd348156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:38.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.219+0000 7fd346ffd640 1 -- 172.21.15.151:0/4122671452 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c009400 con 0x7fd3481501d0 2023-10-18T11:09:38.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.221+0000 7fd346ffd640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3480c4890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009890 tx=0x7fd33c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:38.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.225+0000 7fd32ffff640 1 -- 172.21.15.151:0/4122671452 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c03c940 con 0x7fd3481501d0 2023-10-18T11:09:38.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.225+0000 7fd32ffff640 1 -- 172.21.15.151:0/4122671452 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c03caa0 con 0x7fd3481501d0 2023-10-18T11:09:38.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.225+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd348152b70 con 0x7fd3481501d0 2023-10-18T11:09:38.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.225+0000 7fd32ffff640 1 -- 172.21.15.151:0/4122671452 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c03ce30 con 0x7fd3481501d0 2023-10-18T11:09:38.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.225+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd348155a00 con 0x7fd3481501d0 2023-10-18T11:09:38.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.227+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3481edd00 con 0x7fd3481501d0 2023-10-18T11:09:38.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.246+0000 7fd32ffff640 1 -- 172.21.15.151:0/4122671452 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd33c039040 con 0x7fd3481501d0 2023-10-18T11:09:38.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.247+0000 7fd32ffff640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33406aec0 0x7fd33406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:38.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.247+0000 7fd3477fe640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33406aec0 0x7fd33406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:38.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.248+0000 7fd3477fe640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33406aec0 0x7fd33406d380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd338009bd0 tx=0x7fd338009240 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.472+0000 7fd32ffff640 1 -- 172.21.15.151:0/4122671452 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd33c07a320 con 0x7fd3481501d0 2023-10-18T11:09:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.482+0000 7fd32ffff640 1 -- 172.21.15.151:0/4122671452 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd33c076660 con 0x7fd3481501d0 2023-10-18T11:09:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:38.726+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd3481edd00 con 0x7fd3481501d0 2023-10-18T11:09:39.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.983+0000 7fd32ffff640 1 -- 172.21.15.151:0/4122671452 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd3481edd00 con 0x7fd3481501d0 2023-10-18T11:09:39.986 INFO:teuthology.orchestra.run.smithi151.stderr:new fs with metadata pool 2 and data pool 3 2023-10-18T11:09:39.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33406aec0 msgr2=0x7fd33406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:39.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33406aec0 0x7fd33406d380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd338009bd0 tx=0x7fd338009240 comp rx=0 tx=0).stop 2023-10-18T11:09:39.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 msgr2=0x7fd3480c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:39.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3480c4890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009890 tx=0x7fd33c0046c0 comp rx=0 tx=0).stop 2023-10-18T11:09:39.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 shutdown_connections 2023-10-18T11:09:39.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd348156af0 0x7fd348156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:39.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3481501d0 0x7fd3480c4890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:39.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33406aec0 0x7fd33406d380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:39.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 --2- 172.21.15.151:0/4122671452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3480c5f70 0x7fd348154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:39.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 >> 172.21.15.151:0/4122671452 conn(0x7fd34806b080 msgr2=0x7fd34806b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:39.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 shutdown_connections 2023-10-18T11:09:39.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:39.986+0000 7fd34e1d0640 1 -- 172.21.15.151:0/4122671452 wait complete. 2023-10-18T11:09:40.009 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-18T11:09:40.010 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-18T11:09:40.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.220+0000 7fc044d75640 1 Processor -- start 2023-10-18T11:09:40.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.220+0000 7fc044d75640 1 -- start start 2023-10-18T11:09:40.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.221+0000 7fc044d75640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0401531f0 0x7fc040159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.221+0000 7fc044d75640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc0400c5d40 0x7fc0400cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.221+0000 7fc044d75640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0400cb280 0x7fc0400c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.221+0000 7fc044d75640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400c89e0 con 0x7fc0401531f0 2023-10-18T11:09:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.221+0000 7fc044d75640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc040159db0 con 0x7fc0400c5d40 2023-10-18T11:09:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.221+0000 7fc044d75640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04006a720 con 0x7fc0400cb280 2023-10-18T11:09:40.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.222+0000 7fc03ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0400cb280 0x7fc0400c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:40.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.222+0000 7fc037fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc0400c5d40 0x7fc0400cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.222+0000 7fc03ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0400cb280 0x7fc0400c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:59252/0 (socket says 172.21.15.151:59252) 2023-10-18T11:09:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.222+0000 7fc03ffff640 1 -- 172.21.15.151:0/797878111 learned_addr learned my addr 172.21.15.151:0/797878111 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.224+0000 7fc037fff640 1 -- 172.21.15.151:0/797878111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0400cb280 msgr2=0x7fc0400c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.224+0000 7fc037fff640 1 --2- 172.21.15.151:0/797878111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0400cb280 0x7fc0400c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.224+0000 7fc037fff640 1 -- 172.21.15.151:0/797878111 >> v2:172.21.15.151:3300/0 conn(0x7fc0401531f0 msgr2=0x7fc040159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.224+0000 7fc037fff640 1 --2- 172.21.15.151:0/797878111 >> v2:172.21.15.151:3300/0 conn(0x7fc0401531f0 0x7fc040159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.224+0000 7fc037fff640 1 -- 172.21.15.151:0/797878111 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0401535d0 con 0x7fc0400c5d40 2023-10-18T11:09:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.227+0000 7fc037fff640 1 --2- 172.21.15.151:0/797878111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400c5d40 0x7fc0400cad40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0400caaf0 tx=0x7fc02802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe68f08ebd728d6f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.231+0000 7fc03effd640 1 -- 172.21.15.151:0/797878111 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02802e070 con 0x7fc0400c5d40 2023-10-18T11:09:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.231+0000 7fc03effd640 1 -- 172.21.15.151:0/797878111 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0280315a0 con 0x7fc0400c5d40 2023-10-18T11:09:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.231+0000 7fc03effd640 1 -- 172.21.15.151:0/797878111 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028031930 con 0x7fc0400c5d40 2023-10-18T11:09:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.232+0000 7fc044d75640 1 -- 172.21.15.151:0/797878111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400c5d40 msgr2=0x7fc0400cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.232+0000 7fc044d75640 1 --2- 172.21.15.151:0/797878111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400c5d40 0x7fc0400cad40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0400caaf0 tx=0x7fc02802b840 comp rx=0 tx=0).stop 2023-10-18T11:09:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.232+0000 7fc044d75640 1 -- 172.21.15.151:0/797878111 shutdown_connections 2023-10-18T11:09:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.232+0000 7fc044d75640 1 --2- 172.21.15.151:0/797878111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0400cb280 0x7fc0400c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.232+0000 7fc044d75640 1 --2- 172.21.15.151:0/797878111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400c5d40 0x7fc0400cad40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.232+0000 7fc044d75640 1 --2- 172.21.15.151:0/797878111 >> v2:172.21.15.151:3300/0 conn(0x7fc0401531f0 0x7fc040159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.232+0000 7fc044d75640 1 -- 172.21.15.151:0/797878111 >> 172.21.15.151:0/797878111 conn(0x7fc0400659d0 msgr2=0x7fc040065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.232+0000 7fc044d75640 1 -- 172.21.15.151:0/797878111 shutdown_connections 2023-10-18T11:09:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.232+0000 7fc044d75640 1 -- 172.21.15.151:0/797878111 wait complete. 2023-10-18T11:09:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.234+0000 7fc044d75640 1 Processor -- start 2023-10-18T11:09:40.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.234+0000 7fc044d75640 1 -- start start 2023-10-18T11:09:40.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.235+0000 7fc044d75640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0400c5d40 0x7fc0400cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:40.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.235+0000 7fc044d75640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400cb280 0x7fc0400cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:40.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.235+0000 7fc044d75640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0401531f0 0x7fc04014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:40.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.235+0000 7fc044d75640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400ce230 con 0x7fc0400c5d40 2023-10-18T11:09:40.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.235+0000 7fc044d75640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400ccf70 con 0x7fc0400cb280 2023-10-18T11:09:40.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.235+0000 7fc044d75640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401eeda0 con 0x7fc0401531f0 2023-10-18T11:09:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.236+0000 7fc03ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0401531f0 0x7fc04014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.236+0000 7fc037fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400cb280 0x7fc0400cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.236+0000 7fc037fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400cb280 0x7fc0400cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:41976/0 (socket says 172.21.15.151:41976) 2023-10-18T11:09:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.236+0000 7fc037fff640 1 -- 172.21.15.151:0/3127472503 learned_addr learned my addr 172.21.15.151:0/3127472503 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:40.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.240+0000 7fc03ffff640 1 -- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400cb280 msgr2=0x7fc0400cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:40.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.240+0000 7fc03ffff640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400cb280 0x7fc0400cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:40.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.240+0000 7fc03ffff640 1 -- 172.21.15.151:0/3127472503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0400c5d40 msgr2=0x7fc0400cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:40.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.240+0000 7fc03ffff640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0400c5d40 0x7fc0400cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:40.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.240+0000 7fc03ffff640 1 -- 172.21.15.151:0/3127472503 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028009400 con 0x7fc0401531f0 2023-10-18T11:09:40.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.240+0000 7fc037fff640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400cb280 0x7fc0400cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:09:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.242+0000 7fc03ffff640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0401531f0 0x7fc04014adb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc03800efc0 tx=0x7fc03800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:40.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.246+0000 7fc03cff9640 1 -- 172.21.15.151:0/3127472503 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800cd20 con 0x7fc0401531f0 2023-10-18T11:09:40.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.246+0000 7fc03cff9640 1 -- 172.21.15.151:0/3127472503 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800f040 con 0x7fc0401531f0 2023-10-18T11:09:40.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.246+0000 7fc03cff9640 1 -- 172.21.15.151:0/3127472503 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038003bd0 con 0x7fc0401531f0 2023-10-18T11:09:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.246+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0400cd210 con 0x7fc0401531f0 2023-10-18T11:09:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.246+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc040156d40 con 0x7fc0401531f0 2023-10-18T11:09:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.247+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04004e160 con 0x7fc0401531f0 2023-10-18T11:09:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.265+0000 7fc03cff9640 1 -- 172.21.15.151:0/3127472503 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc038003d30 con 0x7fc0401531f0 2023-10-18T11:09:40.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.266+0000 7fc03cff9640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc02006aec0 0x7fc02006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:40.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.266+0000 7fc03f7fe640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc02006aec0 0x7fc02006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:40.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.267+0000 7fc03f7fe640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc02006aec0 0x7fc02006d380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc030009710 tx=0x7fc030006c90 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:40.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.267+0000 7fc03cff9640 1 -- 172.21.15.151:0/3127472503 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc038059e70 con 0x7fc0401531f0 2023-10-18T11:09:40.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.580+0000 7fc03cff9640 1 -- 172.21.15.151:0/3127472503 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc038055ab0 con 0x7fc0401531f0 2023-10-18T11:09:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:40.852+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fc0400cb960 con 0x7fc0401531f0 2023-10-18T11:09:41.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.943+0000 7fc03cff9640 1 -- 172.21.15.151:0/3127472503 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc0380590d0 con 0x7fc0401531f0 2023-10-18T11:09:41.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.947+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc02006aec0 msgr2=0x7fc02006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:41.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.947+0000 7fc044d75640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc02006aec0 0x7fc02006d380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc030009710 tx=0x7fc030006c90 comp rx=0 tx=0).stop 2023-10-18T11:09:41.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0401531f0 msgr2=0x7fc04014adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0401531f0 0x7fc04014adb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc03800efc0 tx=0x7fc03800c490 comp rx=0 tx=0).stop 2023-10-18T11:09:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 shutdown_connections 2023-10-18T11:09:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0401531f0 0x7fc04014adb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc02006aec0 0x7fc02006d380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0400cb280 0x7fc0400cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 --2- 172.21.15.151:0/3127472503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0400c5d40 0x7fc0400cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 >> 172.21.15.151:0/3127472503 conn(0x7fc0400659d0 msgr2=0x7fc0400c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 shutdown_connections 2023-10-18T11:09:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:41.948+0000 7fc044d75640 1 -- 172.21.15.151:0/3127472503 wait complete. 2023-10-18T11:09:41.979 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-18T11:09:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.184+0000 7f0a83a90640 1 Processor -- start 2023-10-18T11:09:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.184+0000 7f0a83a90640 1 -- start start 2023-10-18T11:09:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.185+0000 7f0a83a90640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0a7c14fc40 0x7f0a7c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.185+0000 7f0a83a90640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 0x7f0a7c0c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.185+0000 7f0a83a90640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7c1561b0 con 0x7f0a7c0c6750 2023-10-18T11:09:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.185+0000 7f0a83a90640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7c0c3860 con 0x7f0a7c14fc40 2023-10-18T11:09:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.185+0000 7f0a83a90640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0c5570 con 0x7f0a7c155c70 2023-10-18T11:09:42.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.186+0000 7f0a8102b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 0x7f0a7c0c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:42.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.186+0000 7f0a8182c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0a7c14fc40 0x7f0a7c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:42.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.186+0000 7f0a8202d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f0a7c0c6750 0x7f0a7c159260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:53766/0 (socket says 172.21.15.151:53766) 2023-10-18T11:09:42.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.186+0000 7f0a8202d640 1 -- 172.21.15.151:0/4248981993 learned_addr learned my addr 172.21.15.151:0/4248981993 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.189+0000 7f0a8082a640 1 -- 172.21.15.151:0/4248981993 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947630820 0 0) 0x7f0a7c1561b0 con 0x7f0a7c0c6750 2023-10-18T11:09:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.189+0000 7f0a8082a640 1 -- 172.21.15.151:0/4248981993 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a68003520 con 0x7f0a7c0c6750 2023-10-18T11:09:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.189+0000 7f0a8102b640 1 -- 172.21.15.151:0/4248981993 >> v2:172.21.15.151:3300/0 conn(0x7f0a7c14fc40 msgr2=0x7f0a7c0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.189+0000 7f0a8102b640 1 --2- 172.21.15.151:0/4248981993 >> v2:172.21.15.151:3300/0 conn(0x7f0a7c14fc40 0x7f0a7c0c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:42.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.189+0000 7f0a8102b640 1 -- 172.21.15.151:0/4248981993 >> v1:172.21.15.169:6789/0 conn(0x7f0a7c0c6750 legacy=0x7f0a7c159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:42.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.189+0000 7f0a8102b640 1 -- 172.21.15.151:0/4248981993 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c156450 con 0x7f0a7c155c70 2023-10-18T11:09:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.191+0000 7f0a8102b640 1 --2- 172.21.15.151:0/4248981993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 0x7f0a7c0c1890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0097a0 tx=0x7f0a6c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=514bf06fdbfe2a5d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.195+0000 7f0a8082a640 1 -- 172.21.15.151:0/4248981993 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c030610 con 0x7f0a7c155c70 2023-10-18T11:09:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.195+0000 7f0a8082a640 1 -- 172.21.15.151:0/4248981993 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c030770 con 0x7f0a7c155c70 2023-10-18T11:09:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.195+0000 7f0a8082a640 1 -- 172.21.15.151:0/4248981993 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c030b00 con 0x7f0a7c155c70 2023-10-18T11:09:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.195+0000 7f0a83a90640 1 -- 172.21.15.151:0/4248981993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 msgr2=0x7f0a7c0c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.195+0000 7f0a83a90640 1 --2- 172.21.15.151:0/4248981993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 0x7f0a7c0c1890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0097a0 tx=0x7f0a6c02b960 comp rx=0 tx=0).stop 2023-10-18T11:09:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.196+0000 7f0a83a90640 1 -- 172.21.15.151:0/4248981993 shutdown_connections 2023-10-18T11:09:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.196+0000 7f0a83a90640 1 --2- 172.21.15.151:0/4248981993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 0x7f0a7c0c1890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.196+0000 7f0a83a90640 1 --2- 172.21.15.151:0/4248981993 >> v2:172.21.15.151:3300/0 conn(0x7f0a7c14fc40 0x7f0a7c0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.196+0000 7f0a83a90640 1 -- 172.21.15.151:0/4248981993 >> 172.21.15.151:0/4248981993 conn(0x7f0a7c06d880 msgr2=0x7f0a7c06dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.196+0000 7f0a83a90640 1 -- 172.21.15.151:0/4248981993 shutdown_connections 2023-10-18T11:09:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.196+0000 7f0a83a90640 1 -- 172.21.15.151:0/4248981993 wait complete. 2023-10-18T11:09:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.198+0000 7f0a83a90640 1 Processor -- start 2023-10-18T11:09:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.198+0000 7f0a83a90640 1 -- start start 2023-10-18T11:09:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.199+0000 7f0a83a90640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a7c0c6750 0x7f0a7c1ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.199+0000 7f0a83a90640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a7c14fc40 0x7f0a7c14ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.199+0000 7f0a83a90640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 0x7f0a7c158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.199+0000 7f0a83a90640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c158300 con 0x7f0a7c0c6750 2023-10-18T11:09:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.199+0000 7f0a83a90640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c157c00 con 0x7f0a7c14fc40 2023-10-18T11:09:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.199+0000 7f0a83a90640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c156e30 con 0x7f0a7c155c70 2023-10-18T11:09:42.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.199+0000 7f0a8102b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a7c14fc40 0x7f0a7c14ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:42.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.199+0000 7f0a8202d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 0x7f0a7c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:42.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.200+0000 7f0a8102b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a7c14fc40 0x7f0a7c14ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:41982/0 (socket says 172.21.15.151:41982) 2023-10-18T11:09:42.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.200+0000 7f0a8102b640 1 -- 172.21.15.151:0/3651553582 learned_addr learned my addr 172.21.15.151:0/3651553582 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.203+0000 7f0a8102b640 1 -- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 msgr2=0x7f0a7c158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.203+0000 7f0a8102b640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 0x7f0a7c158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.203+0000 7f0a8102b640 1 -- 172.21.15.151:0/3651553582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a7c0c6750 msgr2=0x7f0a7c1ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.203+0000 7f0a8102b640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a7c0c6750 0x7f0a7c1ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.203+0000 7f0a8102b640 1 -- 172.21.15.151:0/3651553582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c009400 con 0x7f0a7c14fc40 2023-10-18T11:09:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.205+0000 7f0a8102b640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a7c14fc40 0x7f0a7c14ebf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c02bf70 tx=0x7f0a6c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.207+0000 7f0a727fc640 1 -- 172.21.15.151:0/3651553582 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c03e070 con 0x7f0a7c14fc40 2023-10-18T11:09:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.207+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c1ef850 con 0x7f0a7c14fc40 2023-10-18T11:09:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.207+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c157060 con 0x7f0a7c14fc40 2023-10-18T11:09:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.208+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7c1580d0 con 0x7f0a7c14fc40 2023-10-18T11:09:42.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.209+0000 7f0a727fc640 1 -- 172.21.15.151:0/3651553582 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c005990 con 0x7f0a7c14fc40 2023-10-18T11:09:42.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.209+0000 7f0a727fc640 1 -- 172.21.15.151:0/3651553582 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c005d00 con 0x7f0a7c14fc40 2023-10-18T11:09:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.464+0000 7f0a727fc640 1 -- 172.21.15.151:0/3651553582 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0a6c0397a0 con 0x7f0a7c14fc40 2023-10-18T11:09:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.467+0000 7f0a727fc640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f0a6006ae70 0x7f0a6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.467+0000 7f0a727fc640 1 -- 172.21.15.151:0/3651553582 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0a6c0ab240 con 0x7f0a7c14fc40 2023-10-18T11:09:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.467+0000 7f0a8182c640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f0a6006ae70 0x7f0a6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.468+0000 7f0a8182c640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f0a6006ae70 0x7f0a6006d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a78006a90 tx=0x7f0a78006a20 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.473+0000 7f0a727fc640 1 -- 172.21.15.151:0/3651553582 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a6c0762b0 con 0x7f0a7c14fc40 2023-10-18T11:09:42.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:42.678+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0a7c1ef850 con 0x7f0a7c14fc40 2023-10-18T11:09:45.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.013+0000 7f0a727fc640 1 -- 172.21.15.151:0/3651553582 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7f0a7c1ef850 con 0x7f0a7c14fc40 2023-10-18T11:09:45.016 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_data_ec' created 2023-10-18T11:09:45.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f0a6006ae70 msgr2=0x7f0a6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:45.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f0a6006ae70 0x7f0a6006d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a78006a90 tx=0x7f0a78006a20 comp rx=0 tx=0).stop 2023-10-18T11:09:45.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a7c14fc40 msgr2=0x7f0a7c14ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:45.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a7c14fc40 0x7f0a7c14ebf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c02bf70 tx=0x7f0a6c0046c0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 shutdown_connections 2023-10-18T11:09:45.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7c155c70 0x7f0a7c158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f0a6006ae70 0x7f0a6006d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a7c14fc40 0x7f0a7c14ebf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 --2- 172.21.15.151:0/3651553582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a7c0c6750 0x7f0a7c1ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.016+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 >> 172.21.15.151:0/3651553582 conn(0x7f0a7c06d880 msgr2=0x7f0a7c0c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:45.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.017+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 shutdown_connections 2023-10-18T11:09:45.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.017+0000 7f0a83a90640 1 -- 172.21.15.151:0/3651553582 wait complete. 2023-10-18T11:09:45.040 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-18T11:09:45.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.246+0000 7fedebbe2640 1 Processor -- start 2023-10-18T11:09:45.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.246+0000 7fedebbe2640 1 -- start start 2023-10-18T11:09:45.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.248+0000 7fedebbe2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fede414ffd0 0x7fede4156880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:45.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.248+0000 7fedebbe2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fede40c4d40 0x7fede40c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:45.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.248+0000 7fedebbe2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede41503b0 con 0x7fede40c19e0 2023-10-18T11:09:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.248+0000 7fedebbe2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede40c4070 con 0x7fede414ffd0 2023-10-18T11:09:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.248+0000 7fedebbe2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede4155e70 con 0x7fede40c4d40 2023-10-18T11:09:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.249+0000 7fede917d640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fede40c19e0 0x7fede406fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:39658/0 (socket says 172.21.15.151:39658) 2023-10-18T11:09:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.249+0000 7fede917d640 1 -- 172.21.15.151:0/4099807460 learned_addr learned my addr 172.21.15.151:0/4099807460 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:45.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.252+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741747698 0 0) 0x7fede41503b0 con 0x7fede40c19e0 2023-10-18T11:09:45.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.252+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd0003520 con 0x7fede40c19e0 2023-10-18T11:09:45.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 <== mon.0 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2811059912 0 0) 0x7fedd0003520 con 0x7fede40c19e0 2023-10-18T11:09:45.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fede40c4d40 msgr2=0x7fede40c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 --2- 172.21.15.151:0/4099807460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fede40c4d40 0x7fede40c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 >> v2:172.21.15.169:3300/0 conn(0x7fede414ffd0 msgr2=0x7fede4156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 --2- 172.21.15.151:0/4099807460 >> v2:172.21.15.169:3300/0 conn(0x7fede414ffd0 0x7fede4156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4070390 con 0x7fede40c19e0 2023-10-18T11:09:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 <== mon.0 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7fedd4001670 con 0x7fede40c19e0 2023-10-18T11:09:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 >> v1:172.21.15.151:6789/0 conn(0x7fede40c19e0 legacy=0x7fede406fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 --2- 172.21.15.151:0/4099807460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fedd0003970 0x7fedd0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 --2- 172.21.15.151:0/4099807460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedd00047c0 0x7fedd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 --2- 172.21.15.151:0/4099807460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fede40c4d40 0x7fedd000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40c4070 con 0x7fedd00047c0 2023-10-18T11:09:45.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede4155e70 con 0x7fedd0003970 2023-10-18T11:09:45.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.257+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd00055f0 con 0x7fede40c4d40 2023-10-18T11:09:45.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.262+0000 7fede917d640 1 --2- 172.21.15.151:0/4099807460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedd00047c0 0x7fedd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:45.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.266+0000 7fede917d640 1 -- 172.21.15.151:0/4099807460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fede40c4d40 msgr2=0x7fedd000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:45.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.266+0000 7fede917d640 1 --2- 172.21.15.151:0/4099807460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fede40c4d40 0x7fedd000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.266+0000 7fede917d640 1 -- 172.21.15.151:0/4099807460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fedd0003970 msgr2=0x7fedd0003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:45.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.266+0000 7fede917d640 1 --2- 172.21.15.151:0/4099807460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fedd0003970 0x7fedd0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.266+0000 7fede917d640 1 -- 172.21.15.151:0/4099807460 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0003520 con 0x7fedd00047c0 2023-10-18T11:09:45.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.270+0000 7fede917d640 1 --2- 172.21.15.151:0/4099807460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedd00047c0 0x7fedd0004c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c0e0 tx=0x7fedd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b300133cc85b20 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:45.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.276+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4005ad0 con 0x7fedd00047c0 2023-10-18T11:09:45.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.276+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4005c30 con 0x7fedd00047c0 2023-10-18T11:09:45.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.276+0000 7fede897c640 1 -- 172.21.15.151:0/4099807460 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd402c810 con 0x7fedd00047c0 2023-10-18T11:09:45.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.277+0000 7fedebbe2640 1 -- 172.21.15.151:0/4099807460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedd00047c0 msgr2=0x7fedd0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:45.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.277+0000 7fedebbe2640 1 --2- 172.21.15.151:0/4099807460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedd00047c0 0x7fedd0004c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c0e0 tx=0x7fedd00057f0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.277+0000 7fedea17f640 1 -- 172.21.15.151:0/4099807460 reap_dead start 2023-10-18T11:09:45.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.277+0000 7fedebbe2640 1 -- 172.21.15.151:0/4099807460 shutdown_connections 2023-10-18T11:09:45.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.277+0000 7fedebbe2640 1 -- 172.21.15.151:0/4099807460 >> 172.21.15.151:0/4099807460 conn(0x7fede4069d90 msgr2=0x7fede406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:45.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.277+0000 7fedebbe2640 1 -- 172.21.15.151:0/4099807460 shutdown_connections 2023-10-18T11:09:45.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.278+0000 7fedebbe2640 1 -- 172.21.15.151:0/4099807460 wait complete. 2023-10-18T11:09:45.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.280+0000 7fedebbe2640 1 Processor -- start 2023-10-18T11:09:45.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.280+0000 7fedebbe2640 1 -- start start 2023-10-18T11:09:45.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.281+0000 7fedebbe2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fedd00047c0 0x7fede406d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:45.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.281+0000 7fedebbe2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fede406dbf0 0x7fede41470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:45.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.281+0000 7fedebbe2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fede41475f0 0x7fede4152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:45.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.281+0000 7fedebbe2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede41eaff0 con 0x7fede41475f0 2023-10-18T11:09:45.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.281+0000 7fedebbe2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede41ead10 con 0x7fede406dbf0 2023-10-18T11:09:45.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.281+0000 7fedebbe2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede4147a70 con 0x7fedd00047c0 2023-10-18T11:09:45.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.282+0000 7fede997e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fedd00047c0 0x7fede406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:45.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.282+0000 7fedea17f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fede41475f0 0x7fede4152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:45.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.282+0000 7fede917d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fede406dbf0 0x7fede41470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:45.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.282+0000 7fede997e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fedd00047c0 0x7fede406d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:59308/0 (socket says 172.21.15.151:59308) 2023-10-18T11:09:45.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.282+0000 7fede997e640 1 -- 172.21.15.151:0/3138898562 learned_addr learned my addr 172.21.15.151:0/3138898562 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:45.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.286+0000 7fede917d640 1 -- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fedd00047c0 msgr2=0x7fede406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:45.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.286+0000 7fede917d640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fedd00047c0 0x7fede406d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.286+0000 7fede917d640 1 -- 172.21.15.151:0/3138898562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fede41475f0 msgr2=0x7fede4152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:45.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.286+0000 7fede917d640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fede41475f0 0x7fede4152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:45.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.286+0000 7fede917d640 1 -- 172.21.15.151:0/3138898562 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede41ea100 con 0x7fede406dbf0 2023-10-18T11:09:45.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.289+0000 7fede917d640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fede406dbf0 0x7fede41470b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fedd0005540 tx=0x7fede40c29d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:45.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.292+0000 7fedda7fc640 1 -- 172.21.15.151:0/3138898562 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd402cb60 con 0x7fede406dbf0 2023-10-18T11:09:45.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.292+0000 7fedda7fc640 1 -- 172.21.15.151:0/3138898562 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd402ccc0 con 0x7fede406dbf0 2023-10-18T11:09:45.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.292+0000 7fedda7fc640 1 -- 172.21.15.151:0/3138898562 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40072b0 con 0x7fede406dbf0 2023-10-18T11:09:45.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.292+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede41ea3e0 con 0x7fede406dbf0 2023-10-18T11:09:45.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.293+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede41ea9a0 con 0x7fede406dbf0 2023-10-18T11:09:45.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.294+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede404e160 con 0x7fede406dbf0 2023-10-18T11:09:45.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.314+0000 7fedda7fc640 1 -- 172.21.15.151:0/3138898562 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fedd4032070 con 0x7fede406dbf0 2023-10-18T11:09:45.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.315+0000 7fedda7fc640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fedc806aec0 0x7fedc806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:45.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.315+0000 7fedda7fc640 1 -- 172.21.15.151:0/3138898562 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fedd40ab280 con 0x7fede406dbf0 2023-10-18T11:09:45.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.316+0000 7fede997e640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fedc806aec0 0x7fedc806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:45.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.316+0000 7fede997e640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fedc806aec0 0x7fedc806d380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fede0009ab0 tx=0x7fede0009210 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:45.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.557+0000 7fedda7fc640 1 -- 172.21.15.151:0/3138898562 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedd4076280 con 0x7fede406dbf0 2023-10-18T11:09:45.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:45.757+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fede404e160 con 0x7fede406dbf0 2023-10-18T11:09:46.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.018+0000 7fedda7fc640 1 -- 172.21.15.151:0/3138898562 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fedd40798a0 con 0x7fede406dbf0 2023-10-18T11:09:46.021 INFO:teuthology.orchestra.run.smithi151.stderr:set pool 4 allow_ec_overwrites to true 2023-10-18T11:09:46.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fedc806aec0 msgr2=0x7fedc806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:46.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fedc806aec0 0x7fedc806d380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fede0009ab0 tx=0x7fede0009210 comp rx=0 tx=0).stop 2023-10-18T11:09:46.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fede406dbf0 msgr2=0x7fede41470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:46.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fede406dbf0 0x7fede41470b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fedd0005540 tx=0x7fede40c29d0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 shutdown_connections 2023-10-18T11:09:46.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fede41475f0 0x7fede4152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fedc806aec0 0x7fedc806d380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fede406dbf0 0x7fede41470b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 --2- 172.21.15.151:0/3138898562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fedd00047c0 0x7fede406d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.021+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 >> 172.21.15.151:0/3138898562 conn(0x7fede4069d90 msgr2=0x7fede406fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:46.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.022+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 shutdown_connections 2023-10-18T11:09:46.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.022+0000 7fedebbe2640 1 -- 172.21.15.151:0/3138898562 wait complete. 2023-10-18T11:09:46.046 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-18T11:09:46.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.254+0000 7f5424739640 1 Processor -- start 2023-10-18T11:09:46.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.254+0000 7f5424739640 1 -- start start 2023-10-18T11:09:46.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.255+0000 7f5424739640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c153640 0x7f541c0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:46.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.255+0000 7f5424739640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f541c0c4a90 0x7f541c0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:46.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.255+0000 7f5424739640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0c9010 con 0x7f541c0c99a0 2023-10-18T11:09:46.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.255+0000 7f5424739640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c0c71e0 con 0x7f541c0c4a90 2023-10-18T11:09:46.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.255+0000 7f5424739640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0c5a10 con 0x7f541c153640 2023-10-18T11:09:46.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.256+0000 7f54224d5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c153640 0x7f541c0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:46.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.256+0000 7f5422cd6640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f541c0c99a0 0x7f541c0c5e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:53770/0 (socket says 172.21.15.151:53770) 2023-10-18T11:09:46.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.256+0000 7f5422cd6640 1 -- 172.21.15.151:0/2710395153 learned_addr learned my addr 172.21.15.151:0/2710395153 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:46.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.259+0000 7f54224d5640 1 -- 172.21.15.151:0/2710395153 >> v2:172.21.15.151:3300/0 conn(0x7f541c0c4a90 msgr2=0x7f541c0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:46.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.259+0000 7f54224d5640 1 --2- 172.21.15.151:0/2710395153 >> v2:172.21.15.151:3300/0 conn(0x7f541c0c4a90 0x7f541c0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.259+0000 7f54224d5640 1 -- 172.21.15.151:0/2710395153 >> v1:172.21.15.169:6789/0 conn(0x7f541c0c99a0 legacy=0x7f541c0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:46.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.259+0000 7f54224d5640 1 -- 172.21.15.151:0/2710395153 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c159370 con 0x7f541c153640 2023-10-18T11:09:46.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.261+0000 7f54224d5640 1 --2- 172.21.15.151:0/2710395153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c153640 0x7f541c0c8ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54180097a0 tx=0x7f541802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc0d0501a55d854 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:46.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.264+0000 7f54214d3640 1 -- 172.21.15.151:0/2710395153 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418030610 con 0x7f541c153640 2023-10-18T11:09:46.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.264+0000 7f54214d3640 1 -- 172.21.15.151:0/2710395153 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5418030770 con 0x7f541c153640 2023-10-18T11:09:46.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.264+0000 7f54214d3640 1 -- 172.21.15.151:0/2710395153 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418030b00 con 0x7f541c153640 2023-10-18T11:09:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.265+0000 7f5424739640 1 -- 172.21.15.151:0/2710395153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c153640 msgr2=0x7f541c0c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.265+0000 7f5424739640 1 --2- 172.21.15.151:0/2710395153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c153640 0x7f541c0c8ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54180097a0 tx=0x7f541802b960 comp rx=0 tx=0).stop 2023-10-18T11:09:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.265+0000 7f5424739640 1 -- 172.21.15.151:0/2710395153 shutdown_connections 2023-10-18T11:09:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.265+0000 7f5424739640 1 --2- 172.21.15.151:0/2710395153 >> v2:172.21.15.151:3300/0 conn(0x7f541c0c4a90 0x7f541c0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.265+0000 7f5424739640 1 --2- 172.21.15.151:0/2710395153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c153640 0x7f541c0c8ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.265+0000 7f5424739640 1 -- 172.21.15.151:0/2710395153 >> 172.21.15.151:0/2710395153 conn(0x7f541c0cb320 msgr2=0x7f541c0c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:46.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.265+0000 7f5424739640 1 -- 172.21.15.151:0/2710395153 shutdown_connections 2023-10-18T11:09:46.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.265+0000 7f5424739640 1 -- 172.21.15.151:0/2710395153 wait complete. 2023-10-18T11:09:46.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.267+0000 7f5424739640 1 Processor -- start 2023-10-18T11:09:46.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.267+0000 7f5424739640 1 -- start start 2023-10-18T11:09:46.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.268+0000 7f5424739640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c0c4a90 0x7f541c1e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:46.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.268+0000 7f5424739640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f541c0c99a0 0x7f541c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:46.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.268+0000 7f5424739640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f541c153640 0x7f541c0adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:46.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.268+0000 7f5424739640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0af620 con 0x7f541c0c99a0 2023-10-18T11:09:46.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.268+0000 7f5424739640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c1e2d30 con 0x7f541c153640 2023-10-18T11:09:46.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.268+0000 7f5424739640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0c1560 con 0x7f541c0c4a90 2023-10-18T11:09:46.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.269+0000 7f54224d5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c0c4a90 0x7f541c1e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:46.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.269+0000 7f5422cd6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f541c153640 0x7f541c0adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:46.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.269+0000 7f54224d5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c0c4a90 0x7f541c1e1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:59328/0 (socket says 172.21.15.151:59328) 2023-10-18T11:09:46.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.269+0000 7f54224d5640 1 -- 172.21.15.151:0/745629378 learned_addr learned my addr 172.21.15.151:0/745629378 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:46.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.273+0000 7f54224d5640 1 -- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f541c153640 msgr2=0x7f541c0adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:46.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.273+0000 7f54224d5640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f541c153640 0x7f541c0adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.273+0000 7f54224d5640 1 -- 172.21.15.151:0/745629378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f541c0c99a0 msgr2=0x7f541c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:46.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.273+0000 7f54224d5640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f541c0c99a0 0x7f541c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:46.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.273+0000 7f54224d5640 1 -- 172.21.15.151:0/745629378 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418009400 con 0x7f541c0c4a90 2023-10-18T11:09:46.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.275+0000 7f54224d5640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c0c4a90 0x7f541c1e1a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54180098c0 tx=0x7f54180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:46.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.278+0000 7f5412ffd640 1 -- 172.21.15.151:0/745629378 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541803f070 con 0x7f541c0c4a90 2023-10-18T11:09:46.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.278+0000 7f5412ffd640 1 -- 172.21.15.151:0/745629378 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541803aa60 con 0x7f541c0c4a90 2023-10-18T11:09:46.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.278+0000 7f5412ffd640 1 -- 172.21.15.151:0/745629378 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541803ae30 con 0x7f541c0c4a90 2023-10-18T11:09:46.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.278+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c0af920 con 0x7f541c0c4a90 2023-10-18T11:09:46.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.279+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c0ac860 con 0x7f541c0c4a90 2023-10-18T11:09:46.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.280+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541c152800 con 0x7f541c0c4a90 2023-10-18T11:09:46.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.298+0000 7f5412ffd640 1 -- 172.21.15.151:0/745629378 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f54180433f0 con 0x7f541c0c4a90 2023-10-18T11:09:46.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.299+0000 7f5412ffd640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f540006aef0 0x7f540006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.300+0000 7f5421cd4640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f540006aef0 0x7f540006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.300+0000 7f5421cd4640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f540006aef0 0x7f540006d3b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f541c1e32f0 tx=0x7f540c006c90 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:46.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.547+0000 7f5412ffd640 1 -- 172.21.15.151:0/745629378 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f541807a450 con 0x7f541c0c4a90 2023-10-18T11:09:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.571+0000 7f5412ffd640 1 -- 172.21.15.151:0/745629378 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5418076790 con 0x7f541c0c4a90 2023-10-18T11:09:46.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:46.794+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f541c04e160 con 0x7f541c0c4a90 2023-10-18T11:09:47.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.633+0000 7f5412ffd640 1 -- 172.21.15.151:0/745629378 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f54180490b0 con 0x7f541c0c4a90 2023-10-18T11:09:47.636 INFO:teuthology.orchestra.run.smithi151.stderr:added data pool 4 to fsmap 2023-10-18T11:09:47.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f540006aef0 msgr2=0x7f540006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:47.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f540006aef0 0x7f540006d3b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f541c1e32f0 tx=0x7f540c006c90 comp rx=0 tx=0).stop 2023-10-18T11:09:47.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c0c4a90 msgr2=0x7f541c1e1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c0c4a90 0x7f541c1e1a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54180098c0 tx=0x7f54180046c0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 shutdown_connections 2023-10-18T11:09:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f540006aef0 0x7f540006d3b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f541c153640 0x7f541c0adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f541c0c99a0 0x7f541c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 --2- 172.21.15.151:0/745629378 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f541c0c4a90 0x7f541c1e1a40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.638+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 >> 172.21.15.151:0/745629378 conn(0x7f541c0cb320 msgr2=0x7f541c06b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:47.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.639+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 shutdown_connections 2023-10-18T11:09:47.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.639+0000 7f5424739640 1 -- 172.21.15.151:0/745629378 wait complete. 2023-10-18T11:09:47.662 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:09:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.883+0000 7fe7406e7640 1 Processor -- start 2023-10-18T11:09:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.883+0000 7fe7406e7640 1 -- start start 2023-10-18T11:09:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.884+0000 7fe7406e7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe73806d760 0x7fe738159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.884+0000 7fe7406e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe73806db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.884+0000 7fe7406e7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73815d3e0 con 0x7fe7380c5440 2023-10-18T11:09:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.884+0000 7fe7406e7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73806e080 con 0x7fe73806d760 2023-10-18T11:09:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.884+0000 7fe7406e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7380c4fd0 con 0x7fe738072060 2023-10-18T11:09:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.885+0000 7fe73ec84640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fe7380c5440 0x7fe73806ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:41852/0 (socket says 172.21.15.151:41852) 2023-10-18T11:09:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.885+0000 7fe73ec84640 1 -- 172.21.15.151:0/9661771 learned_addr learned my addr 172.21.15.151:0/9661771 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.885+0000 7fe73e483640 1 --2- 172.21.15.151:0/9661771 >> v2:172.21.15.151:3300/0 conn(0x7fe73806d760 0x7fe738159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:47.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.885+0000 7fe73dc82640 1 --2- 172.21.15.151:0/9661771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe73806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:47.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.888+0000 7fe73d481640 1 -- 172.21.15.151:0/9661771 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698882813 0 0) 0x7fe73815d3e0 con 0x7fe7380c5440 2023-10-18T11:09:47.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.888+0000 7fe73d481640 1 -- 172.21.15.151:0/9661771 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe724003520 con 0x7fe7380c5440 2023-10-18T11:09:47.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.888+0000 7fe73dc82640 1 -- 172.21.15.151:0/9661771 >> v2:172.21.15.151:3300/0 conn(0x7fe73806d760 msgr2=0x7fe738159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:47.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.888+0000 7fe73dc82640 1 --2- 172.21.15.151:0/9661771 >> v2:172.21.15.151:3300/0 conn(0x7fe73806d760 0x7fe738159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.888+0000 7fe73dc82640 1 -- 172.21.15.151:0/9661771 >> v1:172.21.15.169:6789/0 conn(0x7fe7380c5440 legacy=0x7fe73806ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:47.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.888+0000 7fe73dc82640 1 -- 172.21.15.151:0/9661771 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73815c4f0 con 0x7fe738072060 2023-10-18T11:09:47.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.890+0000 7fe73dc82640 1 --2- 172.21.15.151:0/9661771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe73806db40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe7280097a0 tx=0x7fe72802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f275bc6b5577446a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.894+0000 7fe73d481640 1 -- 172.21.15.151:0/9661771 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728030800 con 0x7fe738072060 2023-10-18T11:09:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.894+0000 7fe73d481640 1 -- 172.21.15.151:0/9661771 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe728030960 con 0x7fe738072060 2023-10-18T11:09:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.894+0000 7fe73d481640 1 -- 172.21.15.151:0/9661771 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728030cf0 con 0x7fe738072060 2023-10-18T11:09:47.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.894+0000 7fe7406e7640 1 -- 172.21.15.151:0/9661771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 msgr2=0x7fe73806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:47.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.894+0000 7fe7406e7640 1 --2- 172.21.15.151:0/9661771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe73806db40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe7280097a0 tx=0x7fe72802b940 comp rx=0 tx=0).stop 2023-10-18T11:09:47.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.895+0000 7fe7406e7640 1 -- 172.21.15.151:0/9661771 shutdown_connections 2023-10-18T11:09:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.895+0000 7fe7406e7640 1 --2- 172.21.15.151:0/9661771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe73806db40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.895+0000 7fe7406e7640 1 --2- 172.21.15.151:0/9661771 >> v2:172.21.15.151:3300/0 conn(0x7fe73806d760 0x7fe738159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.895+0000 7fe7406e7640 1 -- 172.21.15.151:0/9661771 >> 172.21.15.151:0/9661771 conn(0x7fe7380c6f10 msgr2=0x7fe7380c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.895+0000 7fe7406e7640 1 -- 172.21.15.151:0/9661771 shutdown_connections 2023-10-18T11:09:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.895+0000 7fe7406e7640 1 -- 172.21.15.151:0/9661771 wait complete. 2023-10-18T11:09:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.896+0000 7fe7406e7640 1 Processor -- start 2023-10-18T11:09:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.897+0000 7fe7406e7640 1 -- start start 2023-10-18T11:09:47.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.897+0000 7fe7406e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe73806d760 0x7fe7381e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.897+0000 7fe7406e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe738150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.897+0000 7fe7406e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7380c5440 0x7fe73815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.897+0000 7fe7406e7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7381e62c0 con 0x7fe7380c5440 2023-10-18T11:09:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.897+0000 7fe7406e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7381e64e0 con 0x7fe73806d760 2023-10-18T11:09:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.897+0000 7fe7406e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe738158b20 con 0x7fe738072060 2023-10-18T11:09:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.898+0000 7fe73dc82640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe738150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.898+0000 7fe73e483640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe73806d760 0x7fe7381e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.898+0000 7fe73ec84640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7380c5440 0x7fe73815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.898+0000 7fe73dc82640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe738150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:44230/0 (socket says 172.21.15.151:44230) 2023-10-18T11:09:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.898+0000 7fe73dc82640 1 -- 172.21.15.151:0/2101623145 learned_addr learned my addr 172.21.15.151:0/2101623145 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:47.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.902+0000 7fe73dc82640 1 -- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe73806d760 msgr2=0x7fe7381e5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:47.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.902+0000 7fe73dc82640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe73806d760 0x7fe7381e5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.902+0000 7fe73dc82640 1 -- 172.21.15.151:0/2101623145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7380c5440 msgr2=0x7fe73815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:47.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.902+0000 7fe73dc82640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7380c5440 0x7fe73815a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:47.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.902+0000 7fe73dc82640 1 -- 172.21.15.151:0/2101623145 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728009400 con 0x7fe738072060 2023-10-18T11:09:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.904+0000 7fe73dc82640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe738150c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe728009890 tx=0x7fe7280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:47.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.908+0000 7fe72effd640 1 -- 172.21.15.151:0/2101623145 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72803e070 con 0x7fe738072060 2023-10-18T11:09:47.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.908+0000 7fe72effd640 1 -- 172.21.15.151:0/2101623145 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe728006e10 con 0x7fe738072060 2023-10-18T11:09:47.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.908+0000 7fe72effd640 1 -- 172.21.15.151:0/2101623145 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728039c60 con 0x7fe738072060 2023-10-18T11:09:47.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.908+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe738158fb0 con 0x7fe738072060 2023-10-18T11:09:47.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.909+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7381581f0 con 0x7fe738072060 2023-10-18T11:09:47.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.910+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73806dc20 con 0x7fe738072060 2023-10-18T11:09:47.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.929+0000 7fe72effd640 1 -- 172.21.15.151:0/2101623145 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe728055430 con 0x7fe738072060 2023-10-18T11:09:47.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.930+0000 7fe72effd640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe71c06aef0 0x7fe71c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:47.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.931+0000 7fe73e483640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe71c06aef0 0x7fe71c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:47.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:47.931+0000 7fe73e483640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe71c06aef0 0x7fe71c06d3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe734009aa0 tx=0x7fe734009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:48.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.158+0000 7fe72effd640 1 -- 172.21.15.151:0/2101623145 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe72807b200 con 0x7fe738072060 2023-10-18T11:09:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.168+0000 7fe72effd640 1 -- 172.21.15.151:0/2101623145 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe728077540 con 0x7fe738072060 2023-10-18T11:09:48.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.403+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7380c5f80 con 0x7fe738072060 2023-10-18T11:09:48.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.424+0000 7fe72effd640 1 -- 172.21.15.151:0/2101623145 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6495 (secure 0 0 0) 0x7fe728034020 con 0x7fe738072060 2023-10-18T11:09:48.427 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:48.427 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2025487091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2025487091},{"type":"v1","addr":"172.21.15.169:6835","nonce":2025487091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/872383111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":872383111},{"type":"v1","addr":"172.21.15.169:6837","nonce":872383111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/520473080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":520473080},{"type":"v1","addr":"172.21.15.169:6839","nonce":520473080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2666139932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2666139932},{"type":"v1","addr":"172.21.15.151:6835","nonce":2666139932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/251484638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":251484638},{"type":"v1","addr":"172.21.15.151:6833","nonce":251484638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T11:09:38.819021+0000","modified":"2023-10-18T11:09:46.849684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6837/909327926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":909327926},{"type":"v1","addr":"172.21.15.151:6837","nonce":909327926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-18T11:09:48.428 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 7 2023-10-18T11:09:48.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.426+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe71c06aef0 msgr2=0x7fe71c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:48.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.426+0000 7fe7406e7640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe71c06aef0 0x7fe71c06d3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe734009aa0 tx=0x7fe734009190 comp rx=0 tx=0).stop 2023-10-18T11:09:48.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.426+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 msgr2=0x7fe738150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:48.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.426+0000 7fe7406e7640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe738150c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe728009890 tx=0x7fe7280046c0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.426+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 shutdown_connections 2023-10-18T11:09:48.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.427+0000 7fe7406e7640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7380c5440 0x7fe73815a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.427+0000 7fe7406e7640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe738072060 0x7fe738150c50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.427+0000 7fe7406e7640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe71c06aef0 0x7fe71c06d3b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.427+0000 7fe7406e7640 1 --2- 172.21.15.151:0/2101623145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe73806d760 0x7fe7381e5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.427+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 >> 172.21.15.151:0/2101623145 conn(0x7fe7380c6f10 msgr2=0x7fe7380ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:48.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.427+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 shutdown_connections 2023-10-18T11:09:48.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.427+0000 7fe7406e7640 1 -- 172.21.15.151:0/2101623145 wait complete. 2023-10-18T11:09:48.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:48.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.651+0000 7f002516c640 1 Processor -- start 2023-10-18T11:09:48.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.651+0000 7f002516c640 1 -- start start 2023-10-18T11:09:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.652+0000 7f002516c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f002015cd70 0x7f002006ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.652+0000 7f002516c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f00200c5fb0 0x7f0020163940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.652+0000 7f002516c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002006ba10 con 0x7f002006a970 2023-10-18T11:09:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.652+0000 7f002516c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002006bfd0 con 0x7f002015cd70 2023-10-18T11:09:48.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.652+0000 7f002516c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00200caa90 con 0x7f00200c5fb0 2023-10-18T11:09:48.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.653+0000 7f001f59e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f00200c5fb0 0x7f0020163940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:48.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.653+0000 7f001f59e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f00200c5fb0 0x7f0020163940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58512/0 (socket says 172.21.15.151:58512) 2023-10-18T11:09:48.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.653+0000 7f001f59e640 1 -- 172.21.15.151:0/379152047 learned_addr learned my addr 172.21.15.151:0/379152047 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:48.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.656+0000 7f001f59e640 1 -- 172.21.15.151:0/379152047 >> v2:172.21.15.151:3300/0 conn(0x7f002015cd70 msgr2=0x7f002006ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:48.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.656+0000 7f001f59e640 1 --2- 172.21.15.151:0/379152047 >> v2:172.21.15.151:3300/0 conn(0x7f002015cd70 0x7f002006ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.656+0000 7f001f59e640 1 -- 172.21.15.151:0/379152047 >> v1:172.21.15.169:6789/0 conn(0x7f002006a970 legacy=0x7f002015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:48.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.656+0000 7f001f59e640 1 -- 172.21.15.151:0/379152047 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002006bcf0 con 0x7f00200c5fb0 2023-10-18T11:09:48.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.660+0000 7f001f59e640 1 --2- 172.21.15.151:0/379152047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00200c5fb0 0x7f0020163940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f002006b820 tx=0x7f001802bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f883b86b3d96726 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:48.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.663+0000 7f001e59c640 1 -- 172.21.15.151:0/379152047 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001802cb20 con 0x7f00200c5fb0 2023-10-18T11:09:48.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.663+0000 7f001e59c640 1 -- 172.21.15.151:0/379152047 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001802cc80 con 0x7f00200c5fb0 2023-10-18T11:09:48.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.663+0000 7f001e59c640 1 -- 172.21.15.151:0/379152047 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180343f0 con 0x7f00200c5fb0 2023-10-18T11:09:48.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.664+0000 7f002516c640 1 -- 172.21.15.151:0/379152047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00200c5fb0 msgr2=0x7f0020163940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:48.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.664+0000 7f002516c640 1 --2- 172.21.15.151:0/379152047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00200c5fb0 0x7f0020163940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f002006b820 tx=0x7f001802bf80 comp rx=0 tx=0).stop 2023-10-18T11:09:48.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.664+0000 7f002516c640 1 -- 172.21.15.151:0/379152047 shutdown_connections 2023-10-18T11:09:48.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.664+0000 7f002516c640 1 --2- 172.21.15.151:0/379152047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00200c5fb0 0x7f0020163940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.664+0000 7f002516c640 1 --2- 172.21.15.151:0/379152047 >> v2:172.21.15.151:3300/0 conn(0x7f002015cd70 0x7f002006ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.664+0000 7f002516c640 1 -- 172.21.15.151:0/379152047 >> 172.21.15.151:0/379152047 conn(0x7f00200ce890 msgr2=0x7f00200ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:48.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.664+0000 7f002516c640 1 -- 172.21.15.151:0/379152047 shutdown_connections 2023-10-18T11:09:48.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.665+0000 7f002516c640 1 -- 172.21.15.151:0/379152047 wait complete. 2023-10-18T11:09:48.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.667+0000 7f002516c640 1 Processor -- start 2023-10-18T11:09:48.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.667+0000 7f002516c640 1 -- start start 2023-10-18T11:09:48.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.669+0000 7f002516c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f002006a970 0x7f0020158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:48.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.669+0000 7f002516c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00200c5fb0 0x7f00201f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:48.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.669+0000 7f002516c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f002015cd70 0x7f00201f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:48.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.669+0000 7f002516c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00201f0cc0 con 0x7f00200c5fb0 2023-10-18T11:09:48.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.669+0000 7f002516c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00201e4cc0 con 0x7f002015cd70 2023-10-18T11:09:48.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.669+0000 7f002516c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00201e4f40 con 0x7f002006a970 2023-10-18T11:09:48.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.669+0000 7f001f59e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f002015cd70 0x7f00201f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:48.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.670+0000 7f001f59e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f002015cd70 0x7f00201f1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58526/0 (socket says 172.21.15.151:58526) 2023-10-18T11:09:48.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.670+0000 7f001f59e640 1 -- 172.21.15.151:0/168122543 learned_addr learned my addr 172.21.15.151:0/168122543 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:48.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.671+0000 7f0017fff640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00200c5fb0 0x7f00201f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:48.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.673+0000 7f001f59e640 1 -- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f002006a970 msgr2=0x7f0020158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:48.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.673+0000 7f001f59e640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f002006a970 0x7f0020158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.673+0000 7f001f59e640 1 -- 172.21.15.151:0/168122543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00200c5fb0 msgr2=0x7f00201f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:48.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.673+0000 7f001f59e640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00200c5fb0 0x7f00201f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:48.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.673+0000 7f001f59e640 1 -- 172.21.15.151:0/168122543 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018009b30 con 0x7f002015cd70 2023-10-18T11:09:48.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.675+0000 7f001f59e640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f002015cd70 0x7f00201f1690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0018009f40 tx=0x7f0018004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:48.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.679+0000 7f00177fe640 1 -- 172.21.15.151:0/168122543 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018007e70 con 0x7f002015cd70 2023-10-18T11:09:48.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.679+0000 7f00177fe640 1 -- 172.21.15.151:0/168122543 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0018009510 con 0x7f002015cd70 2023-10-18T11:09:48.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.679+0000 7f00177fe640 1 -- 172.21.15.151:0/168122543 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001803e690 con 0x7f002015cd70 2023-10-18T11:09:48.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.679+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00201e5220 con 0x7f002015cd70 2023-10-18T11:09:48.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.679+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00201f0950 con 0x7f002015cd70 2023-10-18T11:09:48.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.680+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002015d3b0 con 0x7f002015cd70 2023-10-18T11:09:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.699+0000 7f00177fe640 1 -- 172.21.15.151:0/168122543 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f001803e7f0 con 0x7f002015cd70 2023-10-18T11:09:48.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.700+0000 7f00177fe640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f000006aef0 0x7f000006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:48.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.701+0000 7f001ed9d640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f000006aef0 0x7f000006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.702+0000 7f001ed9d640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f000006aef0 0x7f000006d3b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0010000f60 tx=0x7f00100079b0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.702+0000 7f00177fe640 1 -- 172.21.15.151:0/168122543 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f001807bb70 con 0x7f002015cd70 2023-10-18T11:09:48.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:48.943+0000 7f00177fe640 1 -- 172.21.15.151:0/168122543 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00180777b0 con 0x7f002015cd70 2023-10-18T11:09:49.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.142+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00200ca2f0 con 0x7f002015cd70 2023-10-18T11:09:49.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.190+0000 7f00177fe640 1 -- 172.21.15.151:0/168122543 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f0018043090 con 0x7f002015cd70 2023-10-18T11:09:49.192 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:49.193 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":29,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:46.835355+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:09:49.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f000006aef0 msgr2=0x7f000006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:49.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f000006aef0 0x7f000006d3b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0010000f60 tx=0x7f00100079b0 comp rx=0 tx=0).stop 2023-10-18T11:09:49.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f002015cd70 msgr2=0x7f00201f1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:49.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f002015cd70 0x7f00201f1690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0018009f40 tx=0x7f0018004a40 comp rx=0 tx=0).stop 2023-10-18T11:09:49.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 shutdown_connections 2023-10-18T11:09:49.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f000006aef0 0x7f000006d3b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:49.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f002015cd70 0x7f00201f1690 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00200c5fb0 0x7f00201f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 --2- 172.21.15.151:0/168122543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f002006a970 0x7f0020158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 >> 172.21.15.151:0/168122543 conn(0x7f00200ce890 msgr2=0x7f0020151cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 shutdown_connections 2023-10-18T11:09:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.193+0000 7f002516c640 1 -- 172.21.15.151:0/168122543 wait complete. 2023-10-18T11:09:49.213 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.417+0000 7fa5530d7640 1 Processor -- start 2023-10-18T11:09:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.417+0000 7fa5530d7640 1 -- start start 2023-10-18T11:09:49.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.418+0000 7fa5530d7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa54c150ec0 0x7fa54c157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:49.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.418+0000 7fa5530d7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c0c6820 con 0x7fa54c0c57a0 2023-10-18T11:09:49.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.418+0000 7fa5530d7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c0c6b00 con 0x7fa54c0c5080 2023-10-18T11:09:49.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.418+0000 7fa5530d7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54c0c3b00 con 0x7fa54c150ec0 2023-10-18T11:09:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.419+0000 7fa550e73640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa54c150ec0 0x7fa54c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.419+0000 7fa54bfff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa54c0c57a0 0x7fa54c06d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:59616/0 (socket says 172.21.15.151:59616) 2023-10-18T11:09:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.419+0000 7fa54bfff640 1 -- 172.21.15.151:0/3092872664 learned_addr learned my addr 172.21.15.151:0/3092872664 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:49.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.422+0000 7fa550e73640 1 -- 172.21.15.151:0/3092872664 >> v1:172.21.15.169:6789/0 conn(0x7fa54c0c5080 legacy=0x7fa54c15a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:49.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.422+0000 7fa550e73640 1 -- 172.21.15.151:0/3092872664 >> v1:172.21.15.151:6789/0 conn(0x7fa54c0c57a0 legacy=0x7fa54c06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.422+0000 7fa550e73640 1 -- 172.21.15.151:0/3092872664 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0c1ab0 con 0x7fa54c150ec0 2023-10-18T11:09:49.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.426+0000 7fa550e73640 1 --2- 172.21.15.151:0/3092872664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 0x7fa54c157790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5340097a0 tx=0x7fa53402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=910f9d45ec00a893 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.430+0000 7fa54b7fe640 1 -- 172.21.15.151:0/3092872664 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534030610 con 0x7fa54c150ec0 2023-10-18T11:09:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.430+0000 7fa54b7fe640 1 -- 172.21.15.151:0/3092872664 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa534030770 con 0x7fa54c150ec0 2023-10-18T11:09:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.430+0000 7fa54b7fe640 1 -- 172.21.15.151:0/3092872664 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534030b00 con 0x7fa54c150ec0 2023-10-18T11:09:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.431+0000 7fa5530d7640 1 -- 172.21.15.151:0/3092872664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 msgr2=0x7fa54c157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:49.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.431+0000 7fa5530d7640 1 --2- 172.21.15.151:0/3092872664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 0x7fa54c157790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5340097a0 tx=0x7fa53402b960 comp rx=0 tx=0).stop 2023-10-18T11:09:49.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.431+0000 7fa5530d7640 1 -- 172.21.15.151:0/3092872664 shutdown_connections 2023-10-18T11:09:49.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.431+0000 7fa5530d7640 1 --2- 172.21.15.151:0/3092872664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 0x7fa54c157790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:49.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.431+0000 7fa5530d7640 1 -- 172.21.15.151:0/3092872664 >> 172.21.15.151:0/3092872664 conn(0x7fa54c0c6f10 msgr2=0x7fa54c0c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:49.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.431+0000 7fa5530d7640 1 -- 172.21.15.151:0/3092872664 shutdown_connections 2023-10-18T11:09:49.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.431+0000 7fa5530d7640 1 -- 172.21.15.151:0/3092872664 wait complete. 2023-10-18T11:09:49.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.433+0000 7fa5530d7640 1 Processor -- start 2023-10-18T11:09:49.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.433+0000 7fa5530d7640 1 -- start start 2023-10-18T11:09:49.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.434+0000 7fa5530d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0c5080 0x7fa54c14b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:49.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.434+0000 7fa5530d7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa54c0c57a0 0x7fa54c0c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:49.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.434+0000 7fa5530d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 0x7fa54c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.434+0000 7fa5530d7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c14c6b0 con 0x7fa54c0c5080 2023-10-18T11:09:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.434+0000 7fa5530d7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0c9400 con 0x7fa54c150ec0 2023-10-18T11:09:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.434+0000 7fa5530d7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c1e54a0 con 0x7fa54c0c57a0 2023-10-18T11:09:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.435+0000 7fa550e73640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0c5080 0x7fa54c14b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.435+0000 7fa551674640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 0x7fa54c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.435+0000 7fa54bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa54c0c57a0 0x7fa54c0c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.435+0000 7fa550e73640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0c5080 0x7fa54c14b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48794/0 (socket says 172.21.15.151:48794) 2023-10-18T11:09:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.435+0000 7fa550e73640 1 -- 172.21.15.151:0/3747548313 learned_addr learned my addr 172.21.15.151:0/3747548313 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:49.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.439+0000 7fa551674640 1 -- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa54c0c57a0 msgr2=0x7fa54c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:49.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.439+0000 7fa551674640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa54c0c57a0 0x7fa54c0c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:49.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.439+0000 7fa551674640 1 -- 172.21.15.151:0/3747548313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0c5080 msgr2=0x7fa54c14b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:49.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.439+0000 7fa551674640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0c5080 0x7fa54c14b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:49.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.439+0000 7fa551674640 1 -- 172.21.15.151:0/3747548313 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534009400 con 0x7fa54c150ec0 2023-10-18T11:09:49.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.441+0000 7fa551674640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 0x7fa54c0c8ec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa54400c340 tx=0x7fa54400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.445+0000 7fa5497fa640 1 -- 172.21.15.151:0/3747548313 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5440052d0 con 0x7fa54c150ec0 2023-10-18T11:09:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.445+0000 7fa5497fa640 1 -- 172.21.15.151:0/3747548313 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa544005430 con 0x7fa54c150ec0 2023-10-18T11:09:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.445+0000 7fa5497fa640 1 -- 172.21.15.151:0/3747548313 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544003830 con 0x7fa54c150ec0 2023-10-18T11:09:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.445+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c0ca200 con 0x7fa54c150ec0 2023-10-18T11:09:49.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.445+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c1e4ee0 con 0x7fa54c150ec0 2023-10-18T11:09:49.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.446+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c14b1f0 con 0x7fa54c150ec0 2023-10-18T11:09:49.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.699+0000 7fa5497fa640 1 -- 172.21.15.151:0/3747548313 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa544003990 con 0x7fa54c150ec0 2023-10-18T11:09:49.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.701+0000 7fa5497fa640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa52c06aef0 0x7fa52c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:49.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.701+0000 7fa5497fa640 1 -- 172.21.15.151:0/3747548313 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5440890c0 con 0x7fa54c150ec0 2023-10-18T11:09:49.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.701+0000 7fa550e73640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa52c06aef0 0x7fa52c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:49.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.702+0000 7fa550e73640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa52c06aef0 0x7fa52c06d3b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa53402b9a0 tx=0x7fa53403b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:49.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.711+0000 7fa5497fa640 1 -- 172.21.15.151:0/3747548313 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5440540d0 con 0x7fa54c150ec0 2023-10-18T11:09:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:49.919+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa54c0c1d60 con 0x7fa54c150ec0 2023-10-18T11:09:50.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.099+0000 7fa5497fa640 1 -- 172.21.15.151:0/3747548313 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18406 (secure 0 0 0) 0x7fa5440576f0 con 0x7fa54c150ec0 2023-10-18T11:09:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:50.103 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":29,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:46.835355+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:09:50.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.102+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa52c06aef0 msgr2=0x7fa52c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:50.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa52c06aef0 0x7fa52c06d3b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa53402b9a0 tx=0x7fa53403b040 comp rx=0 tx=0).stop 2023-10-18T11:09:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 msgr2=0x7fa54c0c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 0x7fa54c0c8ec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa54400c340 tx=0x7fa54400c800 comp rx=0 tx=0).stop 2023-10-18T11:09:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 shutdown_connections 2023-10-18T11:09:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa52c06aef0 0x7fa52c06d3b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa54c150ec0 0x7fa54c0c8ec0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa54c0c57a0 0x7fa54c0c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 --2- 172.21.15.151:0/3747548313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0c5080 0x7fa54c14b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 >> 172.21.15.151:0/3747548313 conn(0x7fa54c0c6f10 msgr2=0x7fa54c0c2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 shutdown_connections 2023-10-18T11:09:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.103+0000 7fa5530d7640 1 -- 172.21.15.151:0/3747548313 wait complete. 2023-10-18T11:09:50.197 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:09:50.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.418+0000 7f599d6e7640 1 Processor -- start 2023-10-18T11:09:50.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.419+0000 7f599d6e7640 1 -- start start 2023-10-18T11:09:50.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.420+0000 7f599d6e7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f59981535c0 0x7f59980c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:50.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.420+0000 7f599d6e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f599815cbe0 0x7f599815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:50.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.420+0000 7f599d6e7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599815a180 con 0x7f59980c6c90 2023-10-18T11:09:50.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.420+0000 7f599d6e7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59981539a0 con 0x7f59981535c0 2023-10-18T11:09:50.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.420+0000 7f599d6e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599815d590 con 0x7f599815cbe0 2023-10-18T11:09:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.421+0000 7f59977fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f599815cbe0 0x7f599815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.421+0000 7f5996ffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f59981535c0 0x7f59980c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.422+0000 7f59977fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f599815cbe0 0x7f599815d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:44260/0 (socket says 172.21.15.151:44260) 2023-10-18T11:09:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.422+0000 7f5996ffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f59981535c0 0x7f59980c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58554/0 (socket says 172.21.15.151:58554) 2023-10-18T11:09:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.422+0000 7f59977fe640 1 -- 172.21.15.151:0/2082530768 learned_addr learned my addr 172.21.15.151:0/2082530768 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:50.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.424+0000 7f59977fe640 1 -- 172.21.15.151:0/2082530768 >> v2:172.21.15.169:3300/0 conn(0x7f59981535c0 msgr2=0x7f59980c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:50.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.424+0000 7f59977fe640 1 --2- 172.21.15.151:0/2082530768 >> v2:172.21.15.169:3300/0 conn(0x7f59981535c0 0x7f59980c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:50.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.424+0000 7f59977fe640 1 -- 172.21.15.151:0/2082530768 >> v1:172.21.15.169:6789/0 conn(0x7f59980c6c90 legacy=0x7f59980c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:50.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.424+0000 7f59977fe640 1 -- 172.21.15.151:0/2082530768 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5998159320 con 0x7f599815cbe0 2023-10-18T11:09:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.426+0000 7f59977fe640 1 --2- 172.21.15.151:0/2082530768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f599815cbe0 0x7f599815d050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59900098a0 tx=0x7f599002ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0e21983d46db561 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:50.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.430+0000 7f5995ffb640 1 -- 172.21.15.151:0/2082530768 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599002f830 con 0x7f599815cbe0 2023-10-18T11:09:50.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.430+0000 7f5995ffb640 1 -- 172.21.15.151:0/2082530768 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599002f990 con 0x7f599815cbe0 2023-10-18T11:09:50.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.430+0000 7f5995ffb640 1 -- 172.21.15.151:0/2082530768 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599002fd20 con 0x7f599815cbe0 2023-10-18T11:09:50.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.431+0000 7f599d6e7640 1 -- 172.21.15.151:0/2082530768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f599815cbe0 msgr2=0x7f599815d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:50.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.431+0000 7f599d6e7640 1 --2- 172.21.15.151:0/2082530768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f599815cbe0 0x7f599815d050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59900098a0 tx=0x7f599002ba10 comp rx=0 tx=0).stop 2023-10-18T11:09:50.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.431+0000 7f599d6e7640 1 -- 172.21.15.151:0/2082530768 shutdown_connections 2023-10-18T11:09:50.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.431+0000 7f599d6e7640 1 --2- 172.21.15.151:0/2082530768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f599815cbe0 0x7f599815d050 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:50.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.431+0000 7f599d6e7640 1 --2- 172.21.15.151:0/2082530768 >> v2:172.21.15.169:3300/0 conn(0x7f59981535c0 0x7f59980c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:50.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.431+0000 7f599d6e7640 1 -- 172.21.15.151:0/2082530768 >> 172.21.15.151:0/2082530768 conn(0x7f5998069f70 msgr2=0x7f599806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:50.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.431+0000 7f599d6e7640 1 -- 172.21.15.151:0/2082530768 shutdown_connections 2023-10-18T11:09:50.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.431+0000 7f599d6e7640 1 -- 172.21.15.151:0/2082530768 wait complete. 2023-10-18T11:09:50.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.433+0000 7f599d6e7640 1 Processor -- start 2023-10-18T11:09:50.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.434+0000 7f599d6e7640 1 -- start start 2023-10-18T11:09:50.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.435+0000 7f599d6e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59980c6c90 0x7f59980bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:50.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.435+0000 7f599d6e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59981535c0 0x7f59980bc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:50.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.435+0000 7f599d6e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f599815cbe0 0x7f5998144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:50.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.435+0000 7f599d6e7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599815c590 con 0x7f599815cbe0 2023-10-18T11:09:50.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.435+0000 7f599d6e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599814d2f0 con 0x7f59980c6c90 2023-10-18T11:09:50.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.435+0000 7f599d6e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599814d050 con 0x7f59981535c0 2023-10-18T11:09:50.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.435+0000 7f5996ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59980c6c90 0x7f59980bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:50.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.435+0000 7f59967fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59981535c0 0x7f59980bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:50.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.436+0000 7f59977fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f599815cbe0 0x7f5998144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:50.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.436+0000 7f5996ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59980c6c90 0x7f59980bd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58564/0 (socket says 172.21.15.151:58564) 2023-10-18T11:09:50.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.436+0000 7f5996ffd640 1 -- 172.21.15.151:0/911605409 learned_addr learned my addr 172.21.15.151:0/911605409 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:50.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.439+0000 7f5996ffd640 1 -- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59981535c0 msgr2=0x7f59980bc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:50.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.439+0000 7f5996ffd640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59981535c0 0x7f59980bc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:50.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.439+0000 7f5996ffd640 1 -- 172.21.15.151:0/911605409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f599815cbe0 msgr2=0x7f5998144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:50.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.439+0000 7f5996ffd640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f599815cbe0 0x7f5998144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:50.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.439+0000 7f5996ffd640 1 -- 172.21.15.151:0/911605409 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900094d0 con 0x7f59980c6c90 2023-10-18T11:09:50.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.441+0000 7f5996ffd640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59980c6c90 0x7f59980bd5c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f598800efc0 tx=0x7f598800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.445+0000 7f598f7fe640 1 -- 172.21.15.151:0/911605409 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988014480 con 0x7f59980c6c90 2023-10-18T11:09:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.445+0000 7f598f7fe640 1 -- 172.21.15.151:0/911605409 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598800f040 con 0x7f59980c6c90 2023-10-18T11:09:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.445+0000 7f598f7fe640 1 -- 172.21.15.151:0/911605409 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988014800 con 0x7f59980c6c90 2023-10-18T11:09:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.446+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59981e64f0 con 0x7f59980c6c90 2023-10-18T11:09:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.446+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599815bf40 con 0x7f59980c6c90 2023-10-18T11:09:50.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.447+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599804e1d0 con 0x7f59980c6c90 2023-10-18T11:09:50.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.466+0000 7f598f7fe640 1 -- 172.21.15.151:0/911605409 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5988014960 con 0x7f59980c6c90 2023-10-18T11:09:50.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.467+0000 7f598f7fe640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f597806aec0 0x7f597806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:50.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.467+0000 7f59967fc640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f597806aec0 0x7f597806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:50.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.468+0000 7f59967fc640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f597806aec0 0x7f597806d380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5998067080 tx=0x7f5980009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:50.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.702+0000 7f598f7fe640 1 -- 172.21.15.151:0/911605409 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59880596f0 con 0x7f59980c6c90 2023-10-18T11:09:50.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.713+0000 7f598f7fe640 1 -- 172.21.15.151:0/911605409 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5988055a30 con 0x7f59980c6c90 2023-10-18T11:09:50.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:50.950+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5998159b90 con 0x7f59980c6c90 2023-10-18T11:09:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.075+0000 7f598f7fe640 1 -- 172.21.15.151:0/911605409 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6495 (secure 0 0 0) 0x7f5988059050 con 0x7f59980c6c90 2023-10-18T11:09:51.078 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:51.078 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2025487091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2025487091},{"type":"v1","addr":"172.21.15.169:6835","nonce":2025487091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/872383111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":872383111},{"type":"v1","addr":"172.21.15.169:6837","nonce":872383111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/520473080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":520473080},{"type":"v1","addr":"172.21.15.169:6839","nonce":520473080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2666139932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2666139932},{"type":"v1","addr":"172.21.15.151:6835","nonce":2666139932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/251484638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":251484638},{"type":"v1","addr":"172.21.15.151:6833","nonce":251484638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T11:09:38.819021+0000","modified":"2023-10-18T11:09:46.849684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6837/909327926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":909327926},{"type":"v1","addr":"172.21.15.151:6837","nonce":909327926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-18T11:09:51.079 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 7 2023-10-18T11:09:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f597806aec0 msgr2=0x7f597806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f597806aec0 0x7f597806d380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5998067080 tx=0x7f5980009040 comp rx=0 tx=0).stop 2023-10-18T11:09:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59980c6c90 msgr2=0x7f59980bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59980c6c90 0x7f59980bd5c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f598800efc0 tx=0x7f598800c490 comp rx=0 tx=0).stop 2023-10-18T11:09:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 shutdown_connections 2023-10-18T11:09:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f599815cbe0 0x7f5998144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59981535c0 0x7f59980bc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f597806aec0 0x7f597806d380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 --2- 172.21.15.151:0/911605409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59980c6c90 0x7f59980bd5c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 >> 172.21.15.151:0/911605409 conn(0x7f5998069f70 msgr2=0x7f599806e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:51.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 shutdown_connections 2023-10-18T11:09:51.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.079+0000 7f599d6e7640 1 -- 172.21.15.151:0/911605409 wait complete. 2023-10-18T11:09:51.103 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.313+0000 7fa58bfff640 1 Processor -- start 2023-10-18T11:09:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.313+0000 7fa58bfff640 1 -- start start 2023-10-18T11:09:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.314+0000 7fa58bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa58c06faf0 0x7fa58c0c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.314+0000 7fa58bfff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c0c7470 con 0x7fa58c06a240 2023-10-18T11:09:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.315+0000 7fa58bfff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c0c5670 con 0x7fa58c06a620 2023-10-18T11:09:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.315+0000 7fa58bfff640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58c0705f0 con 0x7fa58c06faf0 2023-10-18T11:09:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.315+0000 7fa58affd640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa58c06a240 0x7fa58c150bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:59622/0 (socket says 172.21.15.151:59622) 2023-10-18T11:09:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.315+0000 7fa58affd640 1 -- 172.21.15.151:0/3210951863 learned_addr learned my addr 172.21.15.151:0/3210951863 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.315+0000 7fa583fff640 1 --2- 172.21.15.151:0/3210951863 >> v2:172.21.15.169:3300/0 conn(0x7fa58c06faf0 0x7fa58c0c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:51.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.318+0000 7fa583fff640 1 -- 172.21.15.151:0/3210951863 >> v1:172.21.15.169:6789/0 conn(0x7fa58c06a620 legacy=0x7fa58c161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:51.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.318+0000 7fa583fff640 1 -- 172.21.15.151:0/3210951863 >> v1:172.21.15.151:6789/0 conn(0x7fa58c06a240 legacy=0x7fa58c150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:51.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.318+0000 7fa583fff640 1 -- 172.21.15.151:0/3210951863 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0c4dd0 con 0x7fa58c06faf0 2023-10-18T11:09:51.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.318+0000 7fa58a7fc640 1 -- 172.21.15.151:0/3210951863 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609589038 0 0) 0x7fa58c0c7470 con 0x7fa58c06a240 2023-10-18T11:09:51.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.323+0000 7fa583fff640 1 --2- 172.21.15.151:0/3210951863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06faf0 0x7fa58c0c7900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5740097d0 tx=0x7fa57402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de48fcee9a8ade96 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.326+0000 7fa58a7fc640 1 -- 172.21.15.151:0/3210951863 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574030610 con 0x7fa58c06faf0 2023-10-18T11:09:51.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.326+0000 7fa58a7fc640 1 -- 172.21.15.151:0/3210951863 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574030770 con 0x7fa58c06faf0 2023-10-18T11:09:51.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.326+0000 7fa58a7fc640 1 -- 172.21.15.151:0/3210951863 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574030b00 con 0x7fa58c06faf0 2023-10-18T11:09:51.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.327+0000 7fa58bfff640 1 -- 172.21.15.151:0/3210951863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06faf0 msgr2=0x7fa58c0c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:51.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.327+0000 7fa58bfff640 1 --2- 172.21.15.151:0/3210951863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06faf0 0x7fa58c0c7900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5740097d0 tx=0x7fa57402b960 comp rx=0 tx=0).stop 2023-10-18T11:09:51.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.327+0000 7fa58bfff640 1 -- 172.21.15.151:0/3210951863 shutdown_connections 2023-10-18T11:09:51.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.327+0000 7fa58bfff640 1 --2- 172.21.15.151:0/3210951863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06faf0 0x7fa58c0c7900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.327+0000 7fa58bfff640 1 -- 172.21.15.151:0/3210951863 >> 172.21.15.151:0/3210951863 conn(0x7fa58c0659d0 msgr2=0x7fa58c065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.327+0000 7fa58bfff640 1 -- 172.21.15.151:0/3210951863 shutdown_connections 2023-10-18T11:09:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.327+0000 7fa58bfff640 1 -- 172.21.15.151:0/3210951863 wait complete. 2023-10-18T11:09:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.329+0000 7fa58bfff640 1 Processor -- start 2023-10-18T11:09:51.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.329+0000 7fa58bfff640 1 -- start start 2023-10-18T11:09:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.330+0000 7fa58bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06a240 0x7fa58c155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.330+0000 7fa58bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa58c06a620 0x7fa58c155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.331+0000 7fa58bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa58c06faf0 0x7fa58c14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.331+0000 7fa58bfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c156b50 con 0x7fa58c06a620 2023-10-18T11:09:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.331+0000 7fa58bfff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0c2a40 con 0x7fa58c06a240 2023-10-18T11:09:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.331+0000 7fa58bfff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0c2760 con 0x7fa58c06faf0 2023-10-18T11:09:51.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.331+0000 7fa583fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa58c06a620 0x7fa58c155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:51.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.331+0000 7fa58affd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06a240 0x7fa58c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:51.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.331+0000 7fa58b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa58c06faf0 0x7fa58c14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:51.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.332+0000 7fa58affd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06a240 0x7fa58c155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58568/0 (socket says 172.21.15.151:58568) 2023-10-18T11:09:51.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.332+0000 7fa58affd640 1 -- 172.21.15.151:0/4235773850 learned_addr learned my addr 172.21.15.151:0/4235773850 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:51.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.335+0000 7fa58b7fe640 1 -- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06a240 msgr2=0x7fa58c155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:51.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.335+0000 7fa58b7fe640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06a240 0x7fa58c155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.335+0000 7fa58b7fe640 1 -- 172.21.15.151:0/4235773850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa58c06a620 msgr2=0x7fa58c155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:51.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.335+0000 7fa58b7fe640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa58c06a620 0x7fa58c155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.335+0000 7fa58b7fe640 1 -- 172.21.15.151:0/4235773850 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574009400 con 0x7fa58c06faf0 2023-10-18T11:09:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.337+0000 7fa58b7fe640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa58c06faf0 0x7fa58c14daf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa58400c6c0 tx=0x7fa58400cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:51.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.341+0000 7fa5837fe640 1 -- 172.21.15.151:0/4235773850 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584003b70 con 0x7fa58c06faf0 2023-10-18T11:09:51.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.341+0000 7fa5837fe640 1 -- 172.21.15.151:0/4235773850 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa584003cd0 con 0x7fa58c06faf0 2023-10-18T11:09:51.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.341+0000 7fa5837fe640 1 -- 172.21.15.151:0/4235773850 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840052f0 con 0x7fa58c06faf0 2023-10-18T11:09:51.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.341+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58c1f20d0 con 0x7fa58c06faf0 2023-10-18T11:09:51.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.341+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c14f590 con 0x7fa58c06faf0 2023-10-18T11:09:51.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.342+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c155450 con 0x7fa58c06faf0 2023-10-18T11:09:51.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.361+0000 7fa5837fe640 1 -- 172.21.15.151:0/4235773850 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa584005450 con 0x7fa58c06faf0 2023-10-18T11:09:51.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.363+0000 7fa5837fe640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa56c06aec0 0x7fa56c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:51.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.363+0000 7fa5837fe640 1 -- 172.21.15.151:0/4235773850 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa584089f20 con 0x7fa58c06faf0 2023-10-18T11:09:51.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.363+0000 7fa58affd640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa56c06aec0 0x7fa56c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:51.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.364+0000 7fa58affd640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa56c06aec0 0x7fa56c06d380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa57c000f60 tx=0x7fa57c007e10 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:51.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.594+0000 7fa5837fe640 1 -- 172.21.15.151:0/4235773850 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa584054ce0 con 0x7fa58c06faf0 2023-10-18T11:09:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.795+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa58c155450 con 0x7fa58c06faf0 2023-10-18T11:09:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.848+0000 7fa5837fe640 1 -- 172.21.15.151:0/4235773850 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18406 (secure 0 0 0) 0x7fa58c155450 con 0x7fa58c06faf0 2023-10-18T11:09:51.851 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:51.851 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":29,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:46.835355+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:09:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa56c06aec0 msgr2=0x7fa56c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa56c06aec0 0x7fa56c06d380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa57c000f60 tx=0x7fa57c007e10 comp rx=0 tx=0).stop 2023-10-18T11:09:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa58c06faf0 msgr2=0x7fa58c14daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa58c06faf0 0x7fa58c14daf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa58400c6c0 tx=0x7fa58400cb80 comp rx=0 tx=0).stop 2023-10-18T11:09:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 shutdown_connections 2023-10-18T11:09:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa58c06faf0 0x7fa58c14daf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa58c06a620 0x7fa58c155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa56c06aec0 0x7fa56c06d380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 --2- 172.21.15.151:0/4235773850 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa58c06a240 0x7fa58c155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:51.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.851+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 >> 172.21.15.151:0/4235773850 conn(0x7fa58c0659d0 msgr2=0x7fa58c150980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:51.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.852+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 shutdown_connections 2023-10-18T11:09:51.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:51.852+0000 7fa58bfff640 1 -- 172.21.15.151:0/4235773850 wait complete. 2023-10-18T11:09:52.478 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18T11:09:38.819021+0000', 'modified': '2023-10-18T11:09:46.849684+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.151:6837/909327926', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 909327926}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 909327926}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-18T11:09:52.478 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-18T11:09:52.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-10-18T11:09:52.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.693+0000 7fb5fcabb640 1 Processor -- start 2023-10-18T11:09:52.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.693+0000 7fb5fcabb640 1 -- start start 2023-10-18T11:09:52.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.695+0000 7fb5fcabb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb5f81510a0 0x7fb5f80c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.695+0000 7fb5fcabb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f80c4e60 0x7fb5f80c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.695+0000 7fb5fcabb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f806d430 con 0x7fb5f8157770 2023-10-18T11:09:52.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.695+0000 7fb5fcabb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f8151480 con 0x7fb5f81510a0 2023-10-18T11:09:52.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.695+0000 7fb5fcabb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80c27d0 con 0x7fb5f80c4e60 2023-10-18T11:09:52.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.695+0000 7fb5f6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f80c4e60 0x7fb5f80c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.695+0000 7fb5f659c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb5f81510a0 0x7fb5f80c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.696+0000 7fb5f6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f80c4e60 0x7fb5f80c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:44290/0 (socket says 172.21.15.151:44290) 2023-10-18T11:09:52.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.696+0000 7fb5f6d9d640 1 -- 172.21.15.151:0/208402059 learned_addr learned my addr 172.21.15.151:0/208402059 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:52.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.696+0000 7fb5f659c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb5f81510a0 0x7fb5f80c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58574/0 (socket says 172.21.15.151:58574) 2023-10-18T11:09:52.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.698+0000 7fb5f6d9d640 1 -- 172.21.15.151:0/208402059 >> v2:172.21.15.169:3300/0 conn(0x7fb5f81510a0 msgr2=0x7fb5f80c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:52.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.698+0000 7fb5f6d9d640 1 --2- 172.21.15.151:0/208402059 >> v2:172.21.15.169:3300/0 conn(0x7fb5f81510a0 0x7fb5f80c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.698+0000 7fb5f6d9d640 1 -- 172.21.15.151:0/208402059 >> v1:172.21.15.169:6789/0 conn(0x7fb5f8157770 legacy=0x7fb5f806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:52.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.699+0000 7fb5f6d9d640 1 -- 172.21.15.151:0/208402059 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80c2a90 con 0x7fb5f80c4e60 2023-10-18T11:09:52.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.701+0000 7fb5f6d9d640 1 --2- 172.21.15.151:0/208402059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f80c4e60 0x7fb5f80c5290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009e50 tx=0x7fb5f002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b2edfbbd838a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.705+0000 7fb5f559a640 1 -- 172.21.15.151:0/208402059 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f002cb00 con 0x7fb5f80c4e60 2023-10-18T11:09:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.705+0000 7fb5f559a640 1 -- 172.21.15.151:0/208402059 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f002cc60 con 0x7fb5f80c4e60 2023-10-18T11:09:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.705+0000 7fb5f559a640 1 -- 172.21.15.151:0/208402059 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00343f0 con 0x7fb5f80c4e60 2023-10-18T11:09:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.706+0000 7fb5fcabb640 1 -- 172.21.15.151:0/208402059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f80c4e60 msgr2=0x7fb5f80c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.706+0000 7fb5fcabb640 1 --2- 172.21.15.151:0/208402059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f80c4e60 0x7fb5f80c5290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009e50 tx=0x7fb5f002bf60 comp rx=0 tx=0).stop 2023-10-18T11:09:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.706+0000 7fb5fcabb640 1 -- 172.21.15.151:0/208402059 shutdown_connections 2023-10-18T11:09:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.706+0000 7fb5fcabb640 1 --2- 172.21.15.151:0/208402059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f80c4e60 0x7fb5f80c5290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.706+0000 7fb5fcabb640 1 --2- 172.21.15.151:0/208402059 >> v2:172.21.15.169:3300/0 conn(0x7fb5f81510a0 0x7fb5f80c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.706+0000 7fb5fcabb640 1 -- 172.21.15.151:0/208402059 >> 172.21.15.151:0/208402059 conn(0x7fb5f8069f70 msgr2=0x7fb5f806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:52.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.706+0000 7fb5fcabb640 1 -- 172.21.15.151:0/208402059 shutdown_connections 2023-10-18T11:09:52.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.706+0000 7fb5fcabb640 1 -- 172.21.15.151:0/208402059 wait complete. 2023-10-18T11:09:52.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.708+0000 7fb5fcabb640 1 Processor -- start 2023-10-18T11:09:52.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.709+0000 7fb5fcabb640 1 -- start start 2023-10-18T11:09:52.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.710+0000 7fb5fcabb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5f80c4e60 0x7fb5f814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.710+0000 7fb5fcabb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f81510a0 0x7fb5f8070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.710+0000 7fb5fcabb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f8157770 0x7fb5f8159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.710+0000 7fb5fcabb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f814f010 con 0x7fb5f81510a0 2023-10-18T11:09:52.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.710+0000 7fb5fcabb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f814ea50 con 0x7fb5f80c4e60 2023-10-18T11:09:52.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.710+0000 7fb5fcabb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f814ed30 con 0x7fb5f8157770 2023-10-18T11:09:52.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.711+0000 7fb5f6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f8157770 0x7fb5f8159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.711+0000 7fb5f5d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f81510a0 0x7fb5f8070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.711+0000 7fb5f659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5f80c4e60 0x7fb5f814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.711+0000 7fb5f6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f8157770 0x7fb5f8159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:44306/0 (socket says 172.21.15.151:44306) 2023-10-18T11:09:52.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.711+0000 7fb5f6d9d640 1 -- 172.21.15.151:0/2440304702 learned_addr learned my addr 172.21.15.151:0/2440304702 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:52.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.714+0000 7fb5f6d9d640 1 -- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5f80c4e60 msgr2=0x7fb5f814ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:52.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.714+0000 7fb5f6d9d640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5f80c4e60 0x7fb5f814ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.714+0000 7fb5f6d9d640 1 -- 172.21.15.151:0/2440304702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f81510a0 msgr2=0x7fb5f8070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:52.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.714+0000 7fb5f6d9d640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f81510a0 0x7fb5f8070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.714+0000 7fb5f6d9d640 1 -- 172.21.15.151:0/2440304702 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0009b30 con 0x7fb5f8157770 2023-10-18T11:09:52.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.719+0000 7fb5f6d9d640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f8157770 0x7fb5f8159eb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0036040 tx=0x7fb5f0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:52.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.722+0000 7fb5e6ffd640 1 -- 172.21.15.151:0/2440304702 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f003e450 con 0x7fb5f8157770 2023-10-18T11:09:52.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.723+0000 7fb5e6ffd640 1 -- 172.21.15.151:0/2440304702 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f003e5d0 con 0x7fb5f8157770 2023-10-18T11:09:52.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.723+0000 7fb5e6ffd640 1 -- 172.21.15.151:0/2440304702 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f003e980 con 0x7fb5f8157770 2023-10-18T11:09:52.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.723+0000 7fb5fcabb640 1 -- 172.21.15.151:0/2440304702 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f81593d0 con 0x7fb5f8157770 2023-10-18T11:09:52.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.723+0000 7fb5fcabb640 1 -- 172.21.15.151:0/2440304702 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f8159990 con 0x7fb5f8157770 2023-10-18T11:09:52.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.727+0000 7fb5ff649740 1 Processor -- start 2023-10-18T11:09:52.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.727+0000 7fb5ff649740 1 -- start start 2023-10-18T11:09:52.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.728+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b50550980 0x560b50550d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.728+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b505512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.728+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b5054f3e0 0x560b505901e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.728+0000 7fb5ff649740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b5046b7a0 con 0x560b50550980 2023-10-18T11:09:52.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.728+0000 7fb5ff649740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b504bd740 con 0x560b5059a800 2023-10-18T11:09:52.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.728+0000 7fb5ff649740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b504bae30 con 0x560b5054f3e0 2023-10-18T11:09:52.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.728+0000 7fb5f5d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b50550980 0x560b50550d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.728+0000 7fb5f659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b505512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.729+0000 7fb5f5d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b50550980 0x560b50550d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48836/0 (socket says 172.21.15.151:48836) 2023-10-18T11:09:52.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.729+0000 7fb5f5d9b640 1 -- 172.21.15.151:0/3607756402 learned_addr learned my addr 172.21.15.151:0/3607756402 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:52.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.731+0000 7fb5f659c640 1 -- 172.21.15.151:0/3607756402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b5054f3e0 msgr2=0x560b505901e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:52.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.731+0000 7fb5f659c640 1 --2- 172.21.15.151:0/3607756402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b5054f3e0 0x560b505901e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.731+0000 7fb5f659c640 1 -- 172.21.15.151:0/3607756402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b50550980 msgr2=0x560b50550d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:52.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.731+0000 7fb5f659c640 1 --2- 172.21.15.151:0/3607756402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b50550980 0x560b50550d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.731+0000 7fb5f659c640 1 -- 172.21.15.151:0/3607756402 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b5047a910 con 0x560b5059a800 2023-10-18T11:09:52.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.733+0000 7fb5f659c640 1 --2- 172.21.15.151:0/3607756402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b505512a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8006a80 tx=0x7fb5e800d5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced2a7fd94deac6a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:52.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.737+0000 7fb5d7fff640 1 -- 172.21.15.151:0/3607756402 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8012040 con 0x560b5059a800 2023-10-18T11:09:52.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.737+0000 7fb5d7fff640 1 -- 172.21.15.151:0/3607756402 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8013040 con 0x560b5059a800 2023-10-18T11:09:52.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.737+0000 7fb5d7fff640 1 -- 172.21.15.151:0/3607756402 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8004430 con 0x560b5059a800 2023-10-18T11:09:52.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.738+0000 7fb5ff649740 1 -- 172.21.15.151:0/3607756402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 msgr2=0x560b505512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:52.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.738+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3607756402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b505512a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8006a80 tx=0x7fb5e800d5a0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.738+0000 7fb5ff649740 1 -- 172.21.15.151:0/3607756402 shutdown_connections 2023-10-18T11:09:52.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.738+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3607756402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b5054f3e0 0x560b505901e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.738+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3607756402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b505512a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.738+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3607756402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b50550980 0x560b50550d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.738+0000 7fb5ff649740 1 -- 172.21.15.151:0/3607756402 >> 172.21.15.151:0/3607756402 conn(0x560b5054d0f0 msgr2=0x560b5054fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:52.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.739+0000 7fb5ff649740 1 -- 172.21.15.151:0/3607756402 shutdown_connections 2023-10-18T11:09:52.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.739+0000 7fb5ff649740 1 -- 172.21.15.151:0/3607756402 wait complete. 2023-10-18T11:09:52.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.739+0000 7fb5ff649740 1 -- start start 2023-10-18T11:09:52.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.740+0000 7fb5ff649740 1 Processor -- start 2023-10-18T11:09:52.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.741+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 0x560b50591d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.741+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5059af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.741+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b50575f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.741+0000 7fb5ff649740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b504b6720 con 0x560b5058e6f0 2023-10-18T11:09:52.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.741+0000 7fb5ff649740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b50454970 con 0x560b5059a800 2023-10-18T11:09:52.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.741+0000 7fb5ff649740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b50454610 con 0x560b50550980 2023-10-18T11:09:52.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.741+0000 7fb5ff649740 10 client.0 _ll_register_callbacks cb 0x560b504769d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:09:52.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.742+0000 7fb5f5d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b50575f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.742+0000 7fb5f659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5059af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.742+0000 7fb5f659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5059af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58620/0 (socket says 172.21.15.151:58620) 2023-10-18T11:09:52.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.742+0000 7fb5f659c640 1 -- 172.21.15.151:0/4200326214 learned_addr learned my addr 172.21.15.151:0/4200326214 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:52.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.745+0000 7fb5e6ffd640 1 -- 172.21.15.151:0/2440304702 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb5f003eae0 con 0x7fb5f8157770 2023-10-18T11:09:52.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.745+0000 7fb5f659c640 1 -- 172.21.15.151:0/4200326214 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 msgr2=0x560b50591d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:52.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.745+0000 7fb5f659c640 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 0x560b50591d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.745+0000 7fb5f659c640 1 -- 172.21.15.151:0/4200326214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 msgr2=0x560b50575f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:52.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.745+0000 7fb5f659c640 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b50575f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:52.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.745+0000 7fb5f659c640 1 -- 172.21.15.151:0/4200326214 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e800dc60 con 0x560b5059a800 2023-10-18T11:09:52.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.746+0000 7fb5e6ffd640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb5d806ae30 0x7fb5d806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.746+0000 7fb5f5d9b640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb5d806ae30 0x7fb5d806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.747+0000 7fb5f5d9b640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb5d806ae30 0x7fb5d806d2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec004a60 tx=0x7fb5ec009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:52.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.748+0000 7fb5f659c640 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5059af10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8015b50 tx=0x7fb5e8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9afd8b120b76d3ba server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:52.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.748+0000 7fb5d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2023-10-18T11:09:52.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.748+0000 7fb5e6ffd640 1 -- 172.21.15.151:0/2440304702 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5f007af00 con 0x7fb5f8157770 2023-10-18T11:09:52.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.752+0000 7fb5d57fa640 1 -- 172.21.15.151:0/4200326214 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8012070 con 0x560b5059a800 2023-10-18T11:09:52.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.752+0000 7fb5d57fa640 1 -- 172.21.15.151:0/4200326214 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5e802dde0 con 0x560b5059a800 2023-10-18T11:09:52.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.752+0000 7fb5ff649740 1 -- 172.21.15.151:0/4200326214 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b504dd160 con 0x560b5059a800 2023-10-18T11:09:52.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.754+0000 7fb5d57fa640 1 -- 172.21.15.151:0/4200326214 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5e8003a20 con 0x560b5059a800 2023-10-18T11:09:52.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.754+0000 7fb5ff649740 10 client.4396 fetch_fsmap learned FSMap version 7 2023-10-18T11:09:52.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.754+0000 7fb5ff649740 1 -- 172.21.15.151:0/4200326214 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x560b504b4da0 con 0x560b5059a800 2023-10-18T11:09:52.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.766+0000 7fb5d57fa640 1 -- 172.21.15.151:0/4200326214 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560b504dd160 con 0x560b5059a800 2023-10-18T11:09:52.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.766+0000 7fb5d57fa640 1 -- 172.21.15.151:0/4200326214 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fb5e8003b80 con 0x560b5059a800 2023-10-18T11:09:52.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.766+0000 7fb5ff649740 10 client.4396 fetch_fsmap finished waiting for FSMap version 7 2023-10-18T11:09:52.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.766+0000 7fb5ff649740 10 client.4396 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-18T11:09:52.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.766+0000 7fb5ff649740 20 client.4396 populate_metadata read hostname 'smithi151' 2023-10-18T11:09:52.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.766+0000 7fb5ff649740 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x560b505a5080 0x560b505a5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:52.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.766+0000 7fb5ff649740 4 client.4396 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T11:09:52.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.766+0000 7fb5ff649740 1 -- 172.21.15.151:0/4200326214 --> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b50488cc0 con 0x560b505a5080 2023-10-18T11:09:52.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.778+0000 7fb5f5d9b640 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x560b505a5080 0x560b505a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:52.930 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.927+0000 7fb5f5d9b640 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x560b505a5080 0x560b505a5460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdc37b9962c51d4e server_cookie=c973348aaf336ea9 in_seq=0 out_seq=0 2023-10-18T11:09:52.930 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:52.927+0000 7fb5d57fa640 10 client.4396 ms_handle_connect on v2:172.21.15.151:6836/909327926 2023-10-18T11:09:53.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.165+0000 7fb5d57fa640 1 -- 172.21.15.151:0/4200326214 <== mds.0 v2:172.21.15.151:6836/909327926 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560b50488cc0 con 0x560b505a5080 2023-10-18T11:09:53.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.166+0000 7fb5d57fa640 10 client.4396 handle_command_reply: tid=0 2023-10-18T11:09:53.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.166+0000 7fb5ff649740 1 client.4396 shutdown 2023-10-18T11:09:53.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 -- 172.21.15.151:0/4200326214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 msgr2=0x560b5059af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5059af10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8015b50 tx=0x7fb5e8004730 comp rx=0 tx=0).stop 2023-10-18T11:09:53.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 -- 172.21.15.151:0/4200326214 shutdown_connections 2023-10-18T11:09:53.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x560b505a5080 0x560b505a5460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b50575f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5059af10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 --2- 172.21.15.151:0/4200326214 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 0x560b50591d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5d57fa640 0 client.4396 ms_handle_reset on v2:172.21.15.151:6836/909327926 2023-10-18T11:09:53.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 -- 172.21.15.151:0/4200326214 >> 172.21.15.151:0/4200326214 conn(0x560b5054f3e0 msgr2=0x560b50549e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:53.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 -- 172.21.15.151:0/4200326214 shutdown_connections 2023-10-18T11:09:53.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.167+0000 7fb5ff649740 1 -- 172.21.15.151:0/4200326214 wait complete. 2023-10-18T11:09:53.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.168+0000 7fb5ff649740 20 client.4396 trim_cache size 0 max 16384 2023-10-18T11:09:53.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.217+0000 7fb5ff649740 1 Processor -- start 2023-10-18T11:09:53.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.218+0000 7fb5ff649740 1 -- start start 2023-10-18T11:09:53.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.219+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 0x560b505954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.219+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.219+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5054f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.220+0000 7fb5ff649740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b5021af20 con 0x560b5058e6f0 2023-10-18T11:09:53.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.220+0000 7fb5ff649740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b505abe30 con 0x560b5059a800 2023-10-18T11:09:53.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.220+0000 7fb5ff649740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b5058fc70 con 0x560b50550980 2023-10-18T11:09:53.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.220+0000 7fb5f659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 0x560b505954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.220+0000 7fb5f6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5054f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.221+0000 7fb5f659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 0x560b505954a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:44322/0 (socket says 172.21.15.151:44322) 2023-10-18T11:09:53.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.221+0000 7fb5f659c640 1 -- 172.21.15.151:0/400398804 learned_addr learned my addr 172.21.15.151:0/400398804 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:53.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.221+0000 7fb5f5d9b640 1 --2- 172.21.15.151:0/400398804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.224+0000 7fb5f659c640 1 -- 172.21.15.151:0/400398804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 msgr2=0x560b5054f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:53.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.224+0000 7fb5f659c640 1 --2- 172.21.15.151:0/400398804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5054f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.224+0000 7fb5f659c640 1 -- 172.21.15.151:0/400398804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 msgr2=0x560b5054a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:53.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.224+0000 7fb5f659c640 1 --2- 172.21.15.151:0/400398804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.224+0000 7fb5f659c640 1 -- 172.21.15.151:0/400398804 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b50453b80 con 0x560b50550980 2023-10-18T11:09:53.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.226+0000 7fb5f659c640 1 --2- 172.21.15.151:0/400398804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 0x560b505954a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800d660 tx=0x7fb5e8025040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcf5baffddbbdd04 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:53.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.229+0000 7fb5e4ff9640 1 -- 172.21.15.151:0/400398804 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8015e80 con 0x560b50550980 2023-10-18T11:09:53.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.230+0000 7fb5e4ff9640 1 -- 172.21.15.151:0/400398804 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8015b80 con 0x560b50550980 2023-10-18T11:09:53.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.230+0000 7fb5e4ff9640 1 -- 172.21.15.151:0/400398804 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8003820 con 0x560b50550980 2023-10-18T11:09:53.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.231+0000 7fb5ff649740 1 -- 172.21.15.151:0/400398804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 msgr2=0x560b505954a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.231+0000 7fb5ff649740 1 --2- 172.21.15.151:0/400398804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 0x560b505954a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800d660 tx=0x7fb5e8025040 comp rx=0 tx=0).stop 2023-10-18T11:09:53.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.231+0000 7fb5ff649740 1 -- 172.21.15.151:0/400398804 shutdown_connections 2023-10-18T11:09:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.231+0000 7fb5ff649740 1 --2- 172.21.15.151:0/400398804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b5059a800 0x560b5054f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.231+0000 7fb5ff649740 1 --2- 172.21.15.151:0/400398804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.231+0000 7fb5ff649740 1 --2- 172.21.15.151:0/400398804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b50550980 0x560b505954a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.231+0000 7fb5ff649740 1 -- 172.21.15.151:0/400398804 >> 172.21.15.151:0/400398804 conn(0x560b5054f3e0 msgr2=0x560b5054e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.231+0000 7fb5ff649740 1 -- 172.21.15.151:0/400398804 shutdown_connections 2023-10-18T11:09:53.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.231+0000 7fb5ff649740 1 -- 172.21.15.151:0/400398804 wait complete. 2023-10-18T11:09:53.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.232+0000 7fb5ff649740 1 -- start start 2023-10-18T11:09:53.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.232+0000 7fb5ff649740 1 Processor -- start 2023-10-18T11:09:53.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.234+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b50550980 0x560b505fb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.234+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.234+0000 7fb5ff649740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b5059a800 0x560b5054fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.234+0000 7fb5ff649740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b505a0b00 con 0x560b5058e6f0 2023-10-18T11:09:53.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.234+0000 7fb5ff649740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b505fe320 con 0x560b50550980 2023-10-18T11:09:53.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.234+0000 7fb5ff649740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b5058f130 con 0x560b5059a800 2023-10-18T11:09:53.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.234+0000 7fb5ff649740 10 client.0 _ll_register_callbacks cb 0x7fb5ec004a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:09:53.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.234+0000 7fb5f5d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.235+0000 7fb5f6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b5059a800 0x560b5054fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.235+0000 7fb5f659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b50550980 0x560b505fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.235+0000 7fb5f5d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48848/0 (socket says 172.21.15.151:48848) 2023-10-18T11:09:53.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.235+0000 7fb5f5d9b640 1 -- 172.21.15.151:0/3226547076 learned_addr learned my addr 172.21.15.151:0/3226547076 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:53.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.239+0000 7fb5f5d9b640 1 -- 172.21.15.151:0/3226547076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b5059a800 msgr2=0x560b5054fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:53.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.239+0000 7fb5f5d9b640 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b5059a800 0x560b5054fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.239+0000 7fb5f5d9b640 1 -- 172.21.15.151:0/3226547076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b50550980 msgr2=0x560b505fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:53.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.239+0000 7fb5f5d9b640 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b50550980 0x560b505fb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.239+0000 7fb5f5d9b640 1 -- 172.21.15.151:0/3226547076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b504b4da0 con 0x560b5058e6f0 2023-10-18T11:09:53.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.242+0000 7fb5f5d9b640 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054f8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec016010 tx=0x7fb5ec007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2a0178e2e71f95 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:53.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.242+0000 7fb5d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-10-18T11:09:53.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.247+0000 7fb5d57fa640 1 -- 172.21.15.151:0/3226547076 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0069d0 con 0x560b5058e6f0 2023-10-18T11:09:53.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.247+0000 7fb5d57fa640 1 -- 172.21.15.151:0/3226547076 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5ec006b30 con 0x560b5058e6f0 2023-10-18T11:09:53.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.247+0000 7fb5ff649740 1 -- 172.21.15.151:0/3226547076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb5e8013040 con 0x560b5058e6f0 2023-10-18T11:09:53.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.250+0000 7fb5d57fa640 1 -- 172.21.15.151:0/3226547076 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5ec006cf0 con 0x560b5058e6f0 2023-10-18T11:09:53.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.250+0000 7fb5ff649740 10 client.4305 fetch_fsmap learned FSMap version 7 2023-10-18T11:09:53.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.250+0000 7fb5ff649740 1 -- 172.21.15.151:0/3226547076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x560b50479170 con 0x560b5058e6f0 2023-10-18T11:09:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.258+0000 7fb5d57fa640 1 -- 172.21.15.151:0/3226547076 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8013040 con 0x560b5058e6f0 2023-10-18T11:09:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.259+0000 7fb5d57fa640 1 -- 172.21.15.151:0/3226547076 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fb5ec034d20 con 0x560b5058e6f0 2023-10-18T11:09:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.259+0000 7fb5ff649740 10 client.4305 fetch_fsmap finished waiting for FSMap version 7 2023-10-18T11:09:53.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.259+0000 7fb5ff649740 10 client.4305 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-18T11:09:53.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.259+0000 7fb5ff649740 20 client.4305 populate_metadata read hostname 'smithi151' 2023-10-18T11:09:53.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.259+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x560b5054ae80 0x560b5054b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.259+0000 7fb5ff649740 4 client.4305 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T11:09:53.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.259+0000 7fb5ff649740 1 -- 172.21.15.151:0/3226547076 --> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560b504af700 con 0x560b5054ae80 2023-10-18T11:09:53.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.260+0000 7fb5f659c640 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x560b5054ae80 0x560b5054b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.266+0000 7fb5f659c640 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x560b5054ae80 0x560b5054b260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c803e53dcf7219ee server_cookie=24c3f1cce560339f in_seq=0 out_seq=0 2023-10-18T11:09:53.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.266+0000 7fb5d57fa640 10 client.4305 ms_handle_connect on v2:172.21.15.151:6836/909327926 2023-10-18T11:09:53.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.309+0000 7fb5d57fa640 1 -- 172.21.15.151:0/3226547076 <== mds.0 v2:172.21.15.151:6836/909327926 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x560b504af700 con 0x560b5054ae80 2023-10-18T11:09:53.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.309+0000 7fb5d57fa640 10 client.4305 handle_command_reply: tid=0 2023-10-18T11:09:53.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.309+0000 7fb5ff649740 1 client.4305 shutdown 2023-10-18T11:09:53.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5ff649740 1 -- 172.21.15.151:0/3226547076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 msgr2=0x560b5054f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054f8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec016010 tx=0x7fb5ec007e30 comp rx=0 tx=0).stop 2023-10-18T11:09:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5ff649740 1 -- 172.21.15.151:0/3226547076 shutdown_connections 2023-10-18T11:09:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x560b5054ae80 0x560b5054b260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560b5059a800 0x560b5054fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560b5058e6f0 0x560b5054f8f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5d57fa640 0 client.4305 ms_handle_reset on v2:172.21.15.151:6836/909327926 2023-10-18T11:09:53.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5ff649740 1 --2- 172.21.15.151:0/3226547076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b50550980 0x560b505fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5ff649740 1 -- 172.21.15.151:0/3226547076 >> 172.21.15.151:0/3226547076 conn(0x560b5054f3e0 msgr2=0x560b5054e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:53.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.310+0000 7fb5ff649740 1 -- 172.21.15.151:0/3226547076 shutdown_connections 2023-10-18T11:09:53.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.311+0000 7fb5ff649740 1 -- 172.21.15.151:0/3226547076 wait complete. 2023-10-18T11:09:53.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.311+0000 7fb5ff649740 20 client.4305 trim_cache size 0 max 16384 2023-10-18T11:09:53.316 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:09:53.316 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "31f501b1-61b9-452b-813c-bb68ad49056d", 2023-10-18T11:09:53.316 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 0, 2023-10-18T11:09:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4294, 2023-10-18T11:09:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-10-18T11:09:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-10-18T11:09:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-10-18T11:09:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 13.222209521, 2023-10-18T11:09:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 7, 2023-10-18T11:09:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 29, 2023-10-18T11:09:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 29, 2023-10-18T11:09:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 22.836705944999999 2023-10-18T11:09:53.318 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:09:53.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 -- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb5d806ae30 msgr2=0x7fb5d806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb5d806ae30 0x7fb5d806d2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec004a60 tx=0x7fb5ec009040 comp rx=0 tx=0).stop 2023-10-18T11:09:53.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 -- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f8157770 msgr2=0x7fb5f8159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f8157770 0x7fb5f8159eb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0036040 tx=0x7fb5f0004a40 comp rx=0 tx=0).stop 2023-10-18T11:09:53.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 -- 172.21.15.151:0/2440304702 shutdown_connections 2023-10-18T11:09:53.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5f8157770 0x7fb5f8159eb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f81510a0 0x7fb5f8070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb5d806ae30 0x7fb5d806d2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 --2- 172.21.15.151:0/2440304702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5f80c4e60 0x7fb5f814ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.312+0000 7fb5fcabb640 1 -- 172.21.15.151:0/2440304702 >> 172.21.15.151:0/2440304702 conn(0x7fb5f8069f70 msgr2=0x7fb5f80c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:53.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.313+0000 7fb5fcabb640 1 -- 172.21.15.151:0/2440304702 shutdown_connections 2023-10-18T11:09:53.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.313+0000 7fb5fcabb640 1 -- 172.21.15.151:0/2440304702 wait complete. 2023-10-18T11:09:53.338 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-18T11:09:53.339 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-18T11:09:53.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T11:09:53.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.557+0000 7f4932a0d640 1 Processor -- start 2023-10-18T11:09:53.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.557+0000 7f4932a0d640 1 -- start start 2023-10-18T11:09:53.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.559+0000 7f4932a0d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f492c150170 0x7f492c159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.559+0000 7f4932a0d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c0c36a0 con 0x7f492c14fd90 2023-10-18T11:09:53.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.559+0000 7f4932a0d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c0c1aa0 con 0x7f492c070f30 2023-10-18T11:09:53.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.559+0000 7f4932a0d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c070d60 con 0x7f492c150170 2023-10-18T11:09:53.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.560+0000 7f493220c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f492c070f30 0x7f492c1597b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:41898/0 (socket says 172.21.15.151:41898) 2023-10-18T11:09:53.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.560+0000 7f493220c640 1 -- 172.21.15.151:0/2897517390 learned_addr learned my addr 172.21.15.151:0/2897517390 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:53.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.560+0000 7f493120a640 1 --2- 172.21.15.151:0/2897517390 >> v2:172.21.15.151:3300/0 conn(0x7f492c150170 0x7f492c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.562+0000 7f4930a09640 1 -- 172.21.15.151:0/2897517390 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281808243 0 0) 0x7f492c0c1aa0 con 0x7f492c070f30 2023-10-18T11:09:53.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.562+0000 7f4930a09640 1 -- 172.21.15.151:0/2897517390 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4918005730 con 0x7f492c070f30 2023-10-18T11:09:53.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.564+0000 7f493120a640 1 -- 172.21.15.151:0/2897517390 >> v1:172.21.15.169:6789/0 conn(0x7f492c070f30 legacy=0x7f492c1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.564+0000 7f493120a640 1 -- 172.21.15.151:0/2897517390 >> v1:172.21.15.151:6789/0 conn(0x7f492c14fd90 legacy=0x7f492c0c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.564+0000 7f493120a640 1 -- 172.21.15.151:0/2897517390 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0c1d80 con 0x7f492c150170 2023-10-18T11:09:53.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.567+0000 7f493120a640 1 --2- 172.21.15.151:0/2897517390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c150170 0x7f492c159270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f491c0097a0 tx=0x7f491c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6424a187b4f170 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:53.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.575+0000 7f4930a09640 1 -- 172.21.15.151:0/2897517390 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c031830 con 0x7f492c150170 2023-10-18T11:09:53.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.575+0000 7f4930a09640 1 -- 172.21.15.151:0/2897517390 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c031990 con 0x7f492c150170 2023-10-18T11:09:53.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.575+0000 7f4930a09640 1 -- 172.21.15.151:0/2897517390 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c031d20 con 0x7f492c150170 2023-10-18T11:09:53.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.576+0000 7f4932a0d640 1 -- 172.21.15.151:0/2897517390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c150170 msgr2=0x7f492c159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.576+0000 7f4932a0d640 1 --2- 172.21.15.151:0/2897517390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c150170 0x7f492c159270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f491c0097a0 tx=0x7f491c02b8d0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.576+0000 7f4932a0d640 1 -- 172.21.15.151:0/2897517390 shutdown_connections 2023-10-18T11:09:53.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.576+0000 7f4932a0d640 1 --2- 172.21.15.151:0/2897517390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c150170 0x7f492c159270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.576+0000 7f4932a0d640 1 -- 172.21.15.151:0/2897517390 >> 172.21.15.151:0/2897517390 conn(0x7f492c069f70 msgr2=0x7f492c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:53.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.576+0000 7f4932a0d640 1 -- 172.21.15.151:0/2897517390 shutdown_connections 2023-10-18T11:09:53.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.576+0000 7f4932a0d640 1 -- 172.21.15.151:0/2897517390 wait complete. 2023-10-18T11:09:53.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.578+0000 7f4932a0d640 1 Processor -- start 2023-10-18T11:09:53.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.578+0000 7f4932a0d640 1 -- start start 2023-10-18T11:09:53.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.579+0000 7f4932a0d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f492c070f30 0x7f492c149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.579+0000 7f4932a0d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f492c14fd90 0x7f492c1eed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.579+0000 7f4932a0d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c150170 0x7f492c1f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.579+0000 7f4932a0d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0c5300 con 0x7f492c150170 2023-10-18T11:09:53.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.579+0000 7f4932a0d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1dde40 con 0x7f492c070f30 2023-10-18T11:09:53.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.579+0000 7f4932a0d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1ee8b0 con 0x7f492c14fd90 2023-10-18T11:09:53.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.580+0000 7f493120a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f492c14fd90 0x7f492c1eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.580+0000 7f4931a0b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f492c070f30 0x7f492c149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.580+0000 7f493220c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c150170 0x7f492c1f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.580+0000 7f4931a0b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f492c070f30 0x7f492c149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58642/0 (socket says 172.21.15.151:58642) 2023-10-18T11:09:53.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.580+0000 7f4931a0b640 1 -- 172.21.15.151:0/3209732695 learned_addr learned my addr 172.21.15.151:0/3209732695 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:53.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.583+0000 7f493120a640 1 -- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f492c070f30 msgr2=0x7f492c149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.583+0000 7f493120a640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f492c070f30 0x7f492c149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.583+0000 7f493120a640 1 -- 172.21.15.151:0/3209732695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c150170 msgr2=0x7f492c1f1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:53.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.583+0000 7f493120a640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c150170 0x7f492c1f1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:53.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.583+0000 7f493120a640 1 -- 172.21.15.151:0/3209732695 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009400 con 0x7f492c14fd90 2023-10-18T11:09:53.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.588+0000 7f493120a640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f492c14fd90 0x7f492c1eed40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f491c033000 tx=0x7f491c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:53.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.592+0000 7f49227fc640 1 -- 172.21.15.151:0/3209732695 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c03a9e0 con 0x7f492c14fd90 2023-10-18T11:09:53.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.592+0000 7f49227fc640 1 -- 172.21.15.151:0/3209732695 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c03ab60 con 0x7f492c14fd90 2023-10-18T11:09:53.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.592+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c1ee5b0 con 0x7f492c14fd90 2023-10-18T11:09:53.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.592+0000 7f49227fc640 1 -- 172.21.15.151:0/3209732695 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c044400 con 0x7f492c14fd90 2023-10-18T11:09:53.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.592+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c1dc4a0 con 0x7f492c14fd90 2023-10-18T11:09:53.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.593+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c04ea00 con 0x7f492c14fd90 2023-10-18T11:09:53.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.615+0000 7f49227fc640 1 -- 172.21.15.151:0/3209732695 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f491c04d440 con 0x7f492c14fd90 2023-10-18T11:09:53.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.616+0000 7f49227fc640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f491006aef0 0x7f491006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:53.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.616+0000 7f4931a0b640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f491006aef0 0x7f491006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:53.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.617+0000 7f4931a0b640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f491006aef0 0x7f491006d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4928001840 tx=0x7f4928009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:53.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.838+0000 7f49227fc640 1 -- 172.21.15.151:0/3209732695 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f491c07a830 con 0x7f492c14fd90 2023-10-18T11:09:53.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:53.850+0000 7f49227fc640 1 -- 172.21.15.151:0/3209732695 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f491c076b70 con 0x7f492c14fd90 2023-10-18T11:09:54.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.088+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f492c04e160 con 0x7f492c14fd90 2023-10-18T11:09:54.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.162+0000 7f49227fc640 1 -- 172.21.15.151:0/3209732695 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f491c035070 con 0x7f492c14fd90 2023-10-18T11:09:54.165 INFO:teuthology.orchestra.run.smithi151.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-18T11:09:54.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f491006aef0 msgr2=0x7f491006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:54.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f491006aef0 0x7f491006d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4928001840 tx=0x7f4928009040 comp rx=0 tx=0).stop 2023-10-18T11:09:54.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f492c14fd90 msgr2=0x7f492c1eed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:54.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f492c14fd90 0x7f492c1eed40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f491c033000 tx=0x7f491c0046c0 comp rx=0 tx=0).stop 2023-10-18T11:09:54.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 shutdown_connections 2023-10-18T11:09:54.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c150170 0x7f492c1f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:54.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f492c14fd90 0x7f492c1eed40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:54.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f491006aef0 0x7f491006d3b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:54.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 --2- 172.21.15.151:0/3209732695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f492c070f30 0x7f492c149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:54.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.165+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 >> 172.21.15.151:0/3209732695 conn(0x7f492c069f70 msgr2=0x7f492c0c56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:54.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.166+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 shutdown_connections 2023-10-18T11:09:54.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:54.166+0000 7f4932a0d640 1 -- 172.21.15.151:0/3209732695 wait complete. 2023-10-18T11:09:54.191 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-18T11:09:54.191 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T11:09:54.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-10-18T11:09:54.192 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-18T11:09:54.192 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-18T11:09:54.193 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-18T11:09:54.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T11:09:54.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T11:09:54.194 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-18T11:09:54.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:54.194 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-10-18T11:09:54.244 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T11:09:54.244 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T11:09:54.245 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T11:09:54.245 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-18T11:09:54.245 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-18T11:09:54.245 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-18T11:09:54.245 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T11:09:54.246 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-18T11:09:54.246 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-10-18T11:09:54.246 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T11:09:54.246 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-18T11:09:54.246 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-10-18T11:09:54.246 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T11:09:54.247 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-10-18T11:09:54.247 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T11:09:54.247 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-10-18T11:09:54.247 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-18T11:09:54.247 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 41827sec preferred_lft 41827sec 2023-10-18T11:09:54.248 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-10-18T11:09:54.248 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-18T11:09:54.249 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T11:09:54.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:54.250 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:09:54.250 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:09:54.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-10-18T11:09:54.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-10-18T11:09:54.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-10-18T11:09:54.252 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T11:09:54.252 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:09:54.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:54.725 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T11:09:54.806 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-10-18T11:09:54.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:54.810 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-10-18T11:09:54.868 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-10-18T11:09:54.868 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T11:09:54.868 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T11:09:54.869 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-18T11:09:54.869 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T11:09:54.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:54.870 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:09:54.871 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:09:54.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T11:09:54.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T11:09:54.872 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T11:09:54.872 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:09:55.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:55.664 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-18T11:09:55.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:55.725 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-10-18T11:09:55.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:55.779 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:09:55.780 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:09:55.780 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T11:09:55.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-18T11:09:55.781 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:09:55.925 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-18T11:09:55.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:55.926 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:09:55.926 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:09:55.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-18T11:09:55.927 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T11:09:55.927 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-18T11:09:55.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-18T11:09:55.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-18T11:09:55.928 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:09:56.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:56.253 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:09:56.253 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:09:56.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-10-18T11:09:56.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T11:09:56.254 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:09:56.412 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-18T11:09:56.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T11:09:56.413 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-18T11:09:56.460 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-18T11:09:56.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T11:09:56.460 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-18T11:09:56.555 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-18T11:09:56.643 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2023-10-18T11:09:56.696 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2023-10-18T11:09:56.696 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2023-10-18T11:09:56.697 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2023-10-18T11:09:56.697 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2023-10-18T11:09:56.697 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2023-10-18T11:09:56.697 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2023-10-18T11:09:56.697 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2023-10-18T11:09:56.698 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2023-10-18T11:09:56.698 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2023-10-18T11:09:56.698 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2023-10-18T11:09:56.698 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/selinux 2023-10-18T11:09:56.698 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2023-10-18T11:09:56.699 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2023-10-18T11:09:56.699 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2023-10-18T11:09:56.699 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2023-10-18T11:09:56.699 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2023-10-18T11:09:56.699 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2023-10-18T11:09:56.700 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2023-10-18T11:09:56.700 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysctl.service 2023-10-18T11:09:56.700 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-18T11:09:56.700 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-18T11:09:56.700 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/nfs/rpc_pipefs 2023-10-18T11:09:56.701 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2023-10-18T11:09:56.701 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2023-10-18T11:09:56.701 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-0 2023-10-18T11:09:56.701 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-1 2023-10-18T11:09:56.701 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-2 2023-10-18T11:09:56.702 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-3 2023-10-18T11:09:56.702 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2023-10-18T11:09:56.702 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T11:09:56.702 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T11:09:56.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:56.704 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-18T11:09:56.754 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-18T11:09:56.755 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-18T11:09:56.760 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-18T11:09:56.836 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2023-10-18T11:09:56.881 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2023-10-18T11:09:56.881 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2023-10-18T11:09:56.881 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2023-10-18T11:09:56.881 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2023-10-18T11:09:56.882 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2023-10-18T11:09:56.882 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2023-10-18T11:09:56.882 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2023-10-18T11:09:56.882 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2023-10-18T11:09:56.882 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2023-10-18T11:09:56.883 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2023-10-18T11:09:56.883 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/selinux 2023-10-18T11:09:56.883 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2023-10-18T11:09:56.883 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2023-10-18T11:09:56.883 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2023-10-18T11:09:56.884 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2023-10-18T11:09:56.884 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2023-10-18T11:09:56.884 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2023-10-18T11:09:56.884 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2023-10-18T11:09:56.884 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysctl.service 2023-10-18T11:09:56.885 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-18T11:09:56.885 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-18T11:09:56.885 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/nfs/rpc_pipefs 2023-10-18T11:09:56.885 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2023-10-18T11:09:56.885 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2023-10-18T11:09:56.885 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-0 2023-10-18T11:09:56.886 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-1 2023-10-18T11:09:56.886 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-2 2023-10-18T11:09:56.886 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-3 2023-10-18T11:09:56.886 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2023-10-18T11:09:56.887 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T11:09:56.887 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T11:09:56.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:56.888 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-18T11:09:56.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi151.stderr:2023-10-18T11:09:56.970+0000 7fdbd1e3e480 -1 init, newargv = 0x55b940bc4890 newargc=15 2023-10-18T11:09:56.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi151.stderr:ceph-fuse[92524]: starting ceph client 2023-10-18T11:09:57.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi151.stderr:ceph-fuse[92524]: starting fuse 2023-10-18T11:09:58.079 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-18T11:09:58.175 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2023-10-18T11:09:58.234 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2023-10-18T11:09:58.234 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2023-10-18T11:09:58.234 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2023-10-18T11:09:58.234 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2023-10-18T11:09:58.235 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2023-10-18T11:09:58.235 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2023-10-18T11:09:58.235 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2023-10-18T11:09:58.235 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2023-10-18T11:09:58.235 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2023-10-18T11:09:58.236 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2023-10-18T11:09:58.236 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/selinux 2023-10-18T11:09:58.236 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2023-10-18T11:09:58.236 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2023-10-18T11:09:58.236 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2023-10-18T11:09:58.236 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2023-10-18T11:09:58.237 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2023-10-18T11:09:58.237 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2023-10-18T11:09:58.237 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2023-10-18T11:09:58.237 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysctl.service 2023-10-18T11:09:58.237 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-18T11:09:58.237 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-18T11:09:58.238 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/nfs/rpc_pipefs 2023-10-18T11:09:58.238 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2023-10-18T11:09:58.238 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2023-10-18T11:09:58.238 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-0 2023-10-18T11:09:58.239 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-1 2023-10-18T11:09:58.239 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-2 2023-10-18T11:09:58.239 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-3 2023-10-18T11:09:58.239 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2023-10-18T11:09:58.239 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T11:09:58.240 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T11:09:58.240 INFO:teuthology.orchestra.run.smithi151.stdout:/home/ubuntu/cephtest/mnt.admin 2023-10-18T11:09:58.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:58.241 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-18T11:09:58.296 INFO:teuthology.orchestra.run.smithi151.stdout:39 2023-10-18T11:09:58.296 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-10-18T11:09:58.296 DEBUG:teuthology.orchestra.run.smithi151:> sudo stdin-killer -- python3 -c ' 2023-10-18T11:09:58.297 DEBUG:teuthology.orchestra.run.smithi151:> import glob 2023-10-18T11:09:58.297 DEBUG:teuthology.orchestra.run.smithi151:> import re 2023-10-18T11:09:58.297 DEBUG:teuthology.orchestra.run.smithi151:> import os 2023-10-18T11:09:58.298 DEBUG:teuthology.orchestra.run.smithi151:> import subprocess 2023-10-18T11:09:58.298 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-18T11:09:58.299 DEBUG:teuthology.orchestra.run.smithi151:> def _find_admin_socket(client_name): 2023-10-18T11:09:58.299 DEBUG:teuthology.orchestra.run.smithi151:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-18T11:09:58.299 DEBUG:teuthology.orchestra.run.smithi151:> files = glob.glob(asok_path) 2023-10-18T11:09:58.300 DEBUG:teuthology.orchestra.run.smithi151:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-18T11:09:58.300 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-18T11:09:58.300 DEBUG:teuthology.orchestra.run.smithi151:> # Given a non-glob path, it better be there 2023-10-18T11:09:58.301 DEBUG:teuthology.orchestra.run.smithi151:> if "*" not in asok_path: 2023-10-18T11:09:58.301 DEBUG:teuthology.orchestra.run.smithi151:> assert(len(files) == 1) 2023-10-18T11:09:58.301 DEBUG:teuthology.orchestra.run.smithi151:> return files[0] 2023-10-18T11:09:58.302 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-18T11:09:58.302 DEBUG:teuthology.orchestra.run.smithi151:> for f in files: 2023-10-18T11:09:58.302 DEBUG:teuthology.orchestra.run.smithi151:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-18T11:09:58.303 DEBUG:teuthology.orchestra.run.smithi151:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-18T11:09:58.303 DEBUG:teuthology.orchestra.run.smithi151:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-18T11:09:58.303 DEBUG:teuthology.orchestra.run.smithi151:> contents = proc_f.read() 2023-10-18T11:09:58.304 DEBUG:teuthology.orchestra.run.smithi151:> if mountpoint in contents: 2023-10-18T11:09:58.304 DEBUG:teuthology.orchestra.run.smithi151:> return f 2023-10-18T11:09:58.304 DEBUG:teuthology.orchestra.run.smithi151:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-18T11:09:58.305 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-18T11:09:58.305 DEBUG:teuthology.orchestra.run.smithi151:> print(_find_admin_socket("client.admin")) 2023-10-18T11:09:58.305 DEBUG:teuthology.orchestra.run.smithi151:> ' 2023-10-18T11:09:58.485 INFO:teuthology.orchestra.run.smithi151.stdout:/var/run/ceph/ceph-client.admin.92524.asok 2023-10-18T11:09:58.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-18T11:09:58.502 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.92524.asok 2023-10-18T11:09:58.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:58.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.92524.asok status 2023-10-18T11:09:58.737 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:09:58.737 INFO:teuthology.orchestra.run.smithi151.stdout: "metadata": { 2023-10-18T11:09:58.737 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_sha1": "189714d033726ae2ce7d2d105c75781f0aec48f4", 2023-10-18T11:09:58.738 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 18.0.0-6713-g189714d0 (189714d033726ae2ce7d2d105c75781f0aec48f4) reef (dev)", 2023-10-18T11:09:58.738 INFO:teuthology.orchestra.run.smithi151.stdout: "entity_id": "admin", 2023-10-18T11:09:58.738 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": "smithi151", 2023-10-18T11:09:58.738 INFO:teuthology.orchestra.run.smithi151.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-18T11:09:58.739 INFO:teuthology.orchestra.run.smithi151.stdout: "pid": "92524", 2023-10-18T11:09:58.739 INFO:teuthology.orchestra.run.smithi151.stdout: "root": "/" 2023-10-18T11:09:58.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-18T11:09:58.739 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_count": 0, 2023-10-18T11:09:58.739 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_pinned_count": 0, 2023-10-18T11:09:58.740 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4414, 2023-10-18T11:09:58.740 INFO:teuthology.orchestra.run.smithi151.stdout: "inst": { 2023-10-18T11:09:58.740 INFO:teuthology.orchestra.run.smithi151.stdout: "name": { 2023-10-18T11:09:58.740 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "client", 2023-10-18T11:09:58.740 INFO:teuthology.orchestra.run.smithi151.stdout: "num": 4414 2023-10-18T11:09:58.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-18T11:09:58.741 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-18T11:09:58.741 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-18T11:09:58.741 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-10-18T11:09:58.741 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3290879288 2023-10-18T11:09:58.741 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-10-18T11:09:58.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-18T11:09:58.742 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-18T11:09:58.742 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-18T11:09:58.742 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-10-18T11:09:58.742 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3290879288 2023-10-18T11:09:58.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-18T11:09:58.743 INFO:teuthology.orchestra.run.smithi151.stdout: "inst_str": "client.4414 172.21.15.151:0/3290879288", 2023-10-18T11:09:58.743 INFO:teuthology.orchestra.run.smithi151.stdout: "addr_str": "172.21.15.151:0/3290879288", 2023-10-18T11:09:58.743 INFO:teuthology.orchestra.run.smithi151.stdout: "inode_count": 1, 2023-10-18T11:09:58.743 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_epoch": 7, 2023-10-18T11:09:58.744 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch": 29, 2023-10-18T11:09:58.744 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch_barrier": 0, 2023-10-18T11:09:58.744 INFO:teuthology.orchestra.run.smithi151.stdout: "blocklisted": false, 2023-10-18T11:09:58.744 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs" 2023-10-18T11:09:58.744 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:09:58.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:58.752 DEBUG:teuthology.orchestra.run.smithi151:> stat --file-system '--printf=%T 2023-10-18T11:09:58.752 DEBUG:teuthology.orchestra.run.smithi151:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-18T11:09:58.818 INFO:teuthology.orchestra.run.smithi151.stdout:fuseblk 2023-10-18T11:09:58.818 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-18T11:09:58.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:58.819 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-18T11:09:59.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:09:59.033 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-18T11:09:59.543 INFO:teuthology.orchestra.run.smithi151.stdout:# file: . 2023-10-18T11:09:59.543 INFO:teuthology.orchestra.run.smithi151.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-18T11:09:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:09:59.545 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:09:59.545 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T11:09:59.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:09:59.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.813+0000 7f25bf925640 1 Processor -- start 2023-10-18T11:09:59.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.814+0000 7f25bf925640 1 -- start start 2023-10-18T11:09:59.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.815+0000 7f25bf925640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 0x7f25b80705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:59.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.815+0000 7f25bf925640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b8153800 con 0x7f25b815cfe0 2023-10-18T11:09:59.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.815+0000 7f25bf925640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b815d430 con 0x7f25b8070d50 2023-10-18T11:09:59.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.815+0000 7f25bf925640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8071e90 con 0x7f25b8153420 2023-10-18T11:09:59.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.816+0000 7f25bcec0640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f25b8070d50 0x7f25b8071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:37670/0 (socket says 172.21.15.151:37670) 2023-10-18T11:09:59.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.816+0000 7f25bd6c1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 0x7f25b80705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:59.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.816+0000 7f25bcec0640 1 -- 172.21.15.151:0/3966047066 learned_addr learned my addr 172.21.15.151:0/3966047066 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:09:59.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.819+0000 7f25bd6c1640 1 -- 172.21.15.151:0/3966047066 >> v1:172.21.15.169:6789/0 conn(0x7f25b8070d50 legacy=0x7f25b8071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:59.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.819+0000 7f25bd6c1640 1 -- 172.21.15.151:0/3966047066 >> v1:172.21.15.151:6789/0 conn(0x7f25b815cfe0 legacy=0x7f25b80c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:09:59.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.819+0000 7f25bd6c1640 1 -- 172.21.15.151:0/3966047066 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8072130 con 0x7f25b8153420 2023-10-18T11:09:59.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.821+0000 7f25bd6c1640 1 --2- 172.21.15.151:0/3966047066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 0x7f25b80705d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25b40097d0 tx=0x7f25b402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=634491564832b2ed server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:59.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.824+0000 7f25affff640 1 -- 172.21.15.151:0/3966047066 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4031890 con 0x7f25b8153420 2023-10-18T11:09:59.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.825+0000 7f25affff640 1 -- 172.21.15.151:0/3966047066 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b40319f0 con 0x7f25b8153420 2023-10-18T11:09:59.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.825+0000 7f25affff640 1 -- 172.21.15.151:0/3966047066 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4031d80 con 0x7f25b8153420 2023-10-18T11:09:59.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.826+0000 7f25bf925640 1 -- 172.21.15.151:0/3966047066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 msgr2=0x7f25b80705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:59.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.826+0000 7f25bf925640 1 --2- 172.21.15.151:0/3966047066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 0x7f25b80705d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25b40097d0 tx=0x7f25b402b930 comp rx=0 tx=0).stop 2023-10-18T11:09:59.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.826+0000 7f25bf925640 1 -- 172.21.15.151:0/3966047066 shutdown_connections 2023-10-18T11:09:59.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.826+0000 7f25bf925640 1 --2- 172.21.15.151:0/3966047066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 0x7f25b80705d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:59.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.826+0000 7f25bf925640 1 -- 172.21.15.151:0/3966047066 >> 172.21.15.151:0/3966047066 conn(0x7f25b80cae00 msgr2=0x7f25b80cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:09:59.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.827+0000 7f25bf925640 1 -- 172.21.15.151:0/3966047066 shutdown_connections 2023-10-18T11:09:59.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.827+0000 7f25bf925640 1 -- 172.21.15.151:0/3966047066 wait complete. 2023-10-18T11:09:59.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.828+0000 7f25bf925640 1 Processor -- start 2023-10-18T11:09:59.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.829+0000 7f25bf925640 1 -- start start 2023-10-18T11:09:59.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.830+0000 7f25bf925640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b8070d50 0x7f25b814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:59.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.830+0000 7f25bf925640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 0x7f25b80c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:59.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.830+0000 7f25bf925640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25b815cfe0 0x7f25b814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:59.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.830+0000 7f25bf925640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80c2770 con 0x7f25b8070d50 2023-10-18T11:09:59.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.830+0000 7f25bf925640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80c39b0 con 0x7f25b815cfe0 2023-10-18T11:09:59.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.830+0000 7f25bf925640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80c3c70 con 0x7f25b8153420 2023-10-18T11:09:59.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.830+0000 7f25bd6c1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b8070d50 0x7f25b814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:59.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.831+0000 7f25bd6c1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b8070d50 0x7f25b814f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57076/0 (socket says 172.21.15.151:57076) 2023-10-18T11:09:59.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.831+0000 7f25bd6c1640 1 -- 172.21.15.151:0/1266033937 learned_addr learned my addr 172.21.15.151:0/1266033937 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:09:59.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.834+0000 7f25bd6c1640 1 -- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 msgr2=0x7f25b80c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:59.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.834+0000 7f25bd6c1640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 0x7f25b80c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:59.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.834+0000 7f25bd6c1640 1 -- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25b815cfe0 msgr2=0x7f25b814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:09:59.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.834+0000 7f25bd6c1640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25b815cfe0 0x7f25b814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:09:59.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.834+0000 7f25bd6c1640 1 -- 172.21.15.151:0/1266033937 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4009400 con 0x7f25b8070d50 2023-10-18T11:09:59.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.837+0000 7f25bd6c1640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b8070d50 0x7f25b814f530 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25b40097d0 tx=0x7f25b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:59.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.842+0000 7f25adffb640 1 -- 172.21.15.151:0/1266033937 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4031830 con 0x7f25b8070d50 2023-10-18T11:09:59.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.842+0000 7f25adffb640 1 -- 172.21.15.151:0/1266033937 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b40443f0 con 0x7f25b8070d50 2023-10-18T11:09:59.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.842+0000 7f25adffb640 1 -- 172.21.15.151:0/1266033937 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b40447a0 con 0x7f25b8070d50 2023-10-18T11:09:59.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.842+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b80c3f50 con 0x7f25b8070d50 2023-10-18T11:09:59.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.842+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b80c4510 con 0x7f25b8070d50 2023-10-18T11:09:59.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.843+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b80c46a0 con 0x7f25b8070d50 2023-10-18T11:09:59.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.865+0000 7f25adffb640 1 -- 172.21.15.151:0/1266033937 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f25b404d450 con 0x7f25b8070d50 2023-10-18T11:09:59.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.865+0000 7f25adffb640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f259c06aec0 0x7f259c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:09:59.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.866+0000 7f25bcec0640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f259c06aec0 0x7f259c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:09:59.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.866+0000 7f25bcec0640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f259c06aec0 0x7f259c06d380 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25b814d1e0 tx=0x7f25a8007a40 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:09:59.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:09:59.868+0000 7f25adffb640 1 -- 172.21.15.151:0/1266033937 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25b407b740 con 0x7f25b8070d50 2023-10-18T11:10:00.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.230+0000 7f25adffb640 1 -- 172.21.15.151:0/1266033937 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25b4077380 con 0x7f25b8070d50 2023-10-18T11:10:00.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.433+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25b8071130 con 0x7f25b8070d50 2023-10-18T11:10:00.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.532+0000 7f25adffb640 1 -- 172.21.15.151:0/1266033937 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f25b407a9a0 con 0x7f25b8070d50 2023-10-18T11:10:00.535 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:00.535 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":29,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:46.835355+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:00.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f259c06aec0 msgr2=0x7f259c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:00.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f259c06aec0 0x7f259c06d380 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25b814d1e0 tx=0x7f25a8007a40 comp rx=0 tx=0).stop 2023-10-18T11:10:00.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b8070d50 msgr2=0x7f25b814f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:00.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b8070d50 0x7f25b814f530 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f25b40097d0 tx=0x7f25b40046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:00.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 shutdown_connections 2023-10-18T11:10:00.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f259c06aec0 0x7f259c06d380 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:00.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25b815cfe0 0x7f25b814da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:00.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25b8153420 0x7f25b80c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:00.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 --2- 172.21.15.151:0/1266033937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b8070d50 0x7f25b814f530 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:00.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 >> 172.21.15.151:0/1266033937 conn(0x7f25b80cae00 msgr2=0x7f25b80c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:00.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 shutdown_connections 2023-10-18T11:10:00.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.536+0000 7f25bf925640 1 -- 172.21.15.151:0/1266033937 wait complete. 2023-10-18T11:10:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T11:09:16.833723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T11:09:34.803213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T11:09:37.000724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T11:09:43.858153+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T11:10:00.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T11:10:00.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.767+0000 7f83e3495640 1 Processor -- start 2023-10-18T11:10:00.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.767+0000 7f83e3495640 1 -- start start 2023-10-18T11:10:00.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.768+0000 7f83e3495640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83dc15a440 0x7f83dc15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:00.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.768+0000 7f83e3495640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc1512f0 con 0x7f83dc150f10 2023-10-18T11:10:00.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.768+0000 7f83e3495640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc15adb0 con 0x7f83dc06be90 2023-10-18T11:10:00.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.768+0000 7f83e3495640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc06d1d0 con 0x7f83dc15a440 2023-10-18T11:10:00.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.770+0000 7f83e2c94640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83dc15a440 0x7f83dc15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:00.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.770+0000 7f83e2c94640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83dc15a440 0x7f83dc15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57082/0 (socket says 172.21.15.151:57082) 2023-10-18T11:10:00.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.770+0000 7f83e2c94640 1 -- 172.21.15.151:0/2468297560 learned_addr learned my addr 172.21.15.151:0/2468297560 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:00.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.823+0000 7f83e2c94640 1 -- 172.21.15.151:0/2468297560 >> v1:172.21.15.169:6789/0 conn(0x7f83dc06be90 legacy=0x7f83dc0c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:00.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.823+0000 7f83e2c94640 1 -- 172.21.15.151:0/2468297560 >> v1:172.21.15.151:6789/0 conn(0x7f83dc150f10 legacy=0x7f83dc06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:00.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.823+0000 7f83e2c94640 1 -- 172.21.15.151:0/2468297560 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc156f20 con 0x7f83dc15a440 2023-10-18T11:10:00.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.831+0000 7f83e2c94640 1 --2- 172.21.15.151:0/2468297560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83dc15a440 0x7f83dc15a870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009e50 tx=0x7f83d402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2695f637e6f7db server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:00.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.856+0000 7f83e1491640 1 -- 172.21.15.151:0/2468297560 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d402cb90 con 0x7f83dc15a440 2023-10-18T11:10:00.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.856+0000 7f83e1491640 1 -- 172.21.15.151:0/2468297560 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d402ccf0 con 0x7f83dc15a440 2023-10-18T11:10:00.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.856+0000 7f83e1491640 1 -- 172.21.15.151:0/2468297560 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4034610 con 0x7f83dc15a440 2023-10-18T11:10:00.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.857+0000 7f83e3495640 1 -- 172.21.15.151:0/2468297560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83dc15a440 msgr2=0x7f83dc15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:00.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.857+0000 7f83e3495640 1 --2- 172.21.15.151:0/2468297560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83dc15a440 0x7f83dc15a870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009e50 tx=0x7f83d402bff0 comp rx=0 tx=0).stop 2023-10-18T11:10:00.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.858+0000 7f83e3495640 1 -- 172.21.15.151:0/2468297560 shutdown_connections 2023-10-18T11:10:00.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.858+0000 7f83e3495640 1 --2- 172.21.15.151:0/2468297560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83dc15a440 0x7f83dc15a870 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:00.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.858+0000 7f83e3495640 1 -- 172.21.15.151:0/2468297560 >> 172.21.15.151:0/2468297560 conn(0x7f83dc0ca330 msgr2=0x7f83dc0ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:00.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.858+0000 7f83e3495640 1 -- 172.21.15.151:0/2468297560 shutdown_connections 2023-10-18T11:10:00.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.858+0000 7f83e3495640 1 -- 172.21.15.151:0/2468297560 wait complete. 2023-10-18T11:10:00.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.862+0000 7f83e3495640 1 Processor -- start 2023-10-18T11:10:00.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.862+0000 7f83e3495640 1 -- start start 2023-10-18T11:10:00.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.864+0000 7f83e3495640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83dc06be90 0x7f83dc14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:00.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.864+0000 7f83e3495640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83dc150f10 0x7f83dc158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:00.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.864+0000 7f83e3495640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83dc15a440 0x7f83dc158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:00.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.864+0000 7f83e3495640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0c3570 con 0x7f83dc150f10 2023-10-18T11:10:00.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.864+0000 7f83e3495640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0c15a0 con 0x7f83dc15a440 2023-10-18T11:10:00.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.864+0000 7f83e3495640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc157dd0 con 0x7f83dc06be90 2023-10-18T11:10:00.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.864+0000 7f83e2493640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83dc06be90 0x7f83dc14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:00.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.864+0000 7f83e2c94640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83dc15a440 0x7f83dc158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:00.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.865+0000 7f83e2c94640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83dc15a440 0x7f83dc158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:55520/0 (socket says 172.21.15.151:55520) 2023-10-18T11:10:00.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.865+0000 7f83e2c94640 1 -- 172.21.15.151:0/1734688130 learned_addr learned my addr 172.21.15.151:0/1734688130 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:00.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.868+0000 7f83e2c94640 1 -- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83dc06be90 msgr2=0x7f83dc14f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:00.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.868+0000 7f83e2c94640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83dc06be90 0x7f83dc14f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:00.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.868+0000 7f83e2c94640 1 -- 172.21.15.151:0/1734688130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83dc150f10 msgr2=0x7f83dc158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:00.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.868+0000 7f83e2c94640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83dc150f10 0x7f83dc158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:00.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.869+0000 7f83e2c94640 1 -- 172.21.15.151:0/1734688130 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d4009b30 con 0x7f83dc15a440 2023-10-18T11:10:00.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.873+0000 7f83e2c94640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83dc15a440 0x7f83dc158a40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83d4036040 tx=0x7f83d4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:00.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.924+0000 7f83d2ffd640 1 -- 172.21.15.151:0/1734688130 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4009510 con 0x7f83dc15a440 2023-10-18T11:10:00.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.925+0000 7f83d2ffd640 1 -- 172.21.15.151:0/1734688130 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d403e450 con 0x7f83dc15a440 2023-10-18T11:10:00.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.925+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc143560 con 0x7f83dc15a440 2023-10-18T11:10:00.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.925+0000 7f83d2ffd640 1 -- 172.21.15.151:0/1734688130 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d403e800 con 0x7f83dc15a440 2023-10-18T11:10:00.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.925+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc0c3290 con 0x7f83dc15a440 2023-10-18T11:10:00.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:00.927+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc04e160 con 0x7f83dc15a440 2023-10-18T11:10:01.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.185+0000 7f83d2ffd640 1 -- 172.21.15.151:0/1734688130 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f83d403e960 con 0x7f83dc15a440 2023-10-18T11:10:01.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.187+0000 7f83d2ffd640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f83c006aec0 0x7f83c006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:01.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.188+0000 7f83d2ffd640 1 -- 172.21.15.151:0/1734688130 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83d40aca80 con 0x7f83dc15a440 2023-10-18T11:10:01.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.188+0000 7f83e2493640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f83c006aec0 0x7f83c006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:01.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.189+0000 7f83e2493640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f83c006aec0 0x7f83c006d380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83d8000f60 tx=0x7f83d8009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:01.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.197+0000 7f83d2ffd640 1 -- 172.21.15.151:0/1734688130 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f83d40779b0 con 0x7f83dc15a440 2023-10-18T11:10:01.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.415+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83dc06c8a0 con 0x7f83dc15a440 2023-10-18T11:10:01.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.421+0000 7f83d2ffd640 1 -- 172.21.15.151:0/1734688130 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83d402ce60 con 0x7f83dc15a440 2023-10-18T11:10:01.423 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-10-18T11:10:01.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.423+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f83c006aec0 msgr2=0x7f83c006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:01.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.423+0000 7f83e3495640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f83c006aec0 0x7f83c006d380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83d8000f60 tx=0x7f83d8009040 comp rx=0 tx=0).stop 2023-10-18T11:10:01.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.423+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83dc15a440 msgr2=0x7f83dc158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:01.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.423+0000 7f83e3495640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83dc15a440 0x7f83dc158a40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83d4036040 tx=0x7f83d4004a40 comp rx=0 tx=0).stop 2023-10-18T11:10:01.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.424+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 shutdown_connections 2023-10-18T11:10:01.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.424+0000 7f83e3495640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f83c006aec0 0x7f83c006d380 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:01.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.424+0000 7f83e3495640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83dc15a440 0x7f83dc158a40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:01.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.424+0000 7f83e3495640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83dc150f10 0x7f83dc158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:01.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.424+0000 7f83e3495640 1 --2- 172.21.15.151:0/1734688130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83dc06be90 0x7f83dc14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:01.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.424+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 >> 172.21.15.151:0/1734688130 conn(0x7f83dc0ca330 msgr2=0x7f83dc070800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:01.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.424+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 shutdown_connections 2023-10-18T11:10:01.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.424+0000 7f83e3495640 1 -- 172.21.15.151:0/1734688130 wait complete. 2023-10-18T11:10:01.444 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T11:10:01.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.636+0000 7fbd7ac13640 1 Processor -- start 2023-10-18T11:10:01.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.636+0000 7fbd7ac13640 1 -- start start 2023-10-18T11:10:01.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.637+0000 7fbd7ac13640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd74070bc0 0x7fbd7406fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:01.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.637+0000 7fbd7ac13640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd74158820 con 0x7fbd74159550 2023-10-18T11:10:01.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.637+0000 7fbd7ac13640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd741590c0 con 0x7fbd7414f410 2023-10-18T11:10:01.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.637+0000 7fbd7ac13640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740c77d0 con 0x7fbd74070bc0 2023-10-18T11:10:01.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.638+0000 7fbd79c11640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fbd7414f410 0x7fbd740c87a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:37698/0 (socket says 172.21.15.151:37698) 2023-10-18T11:10:01.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.638+0000 7fbd79c11640 1 -- 172.21.15.151:0/1785686807 learned_addr learned my addr 172.21.15.151:0/1785686807 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:01.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.639+0000 7fbd7a412640 1 --2- 172.21.15.151:0/1785686807 >> v2:172.21.15.151:3300/0 conn(0x7fbd74070bc0 0x7fbd7406fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:01.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.640+0000 7fbd78c0f640 1 -- 172.21.15.151:0/1785686807 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336015301 0 0) 0x7fbd741590c0 con 0x7fbd7414f410 2023-10-18T11:10:01.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.640+0000 7fbd78c0f640 1 -- 172.21.15.151:0/1785686807 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd5c003440 con 0x7fbd7414f410 2023-10-18T11:10:01.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.643+0000 7fbd7a412640 1 -- 172.21.15.151:0/1785686807 >> v1:172.21.15.169:6789/0 conn(0x7fbd7414f410 legacy=0x7fbd740c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:01.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.643+0000 7fbd7a412640 1 -- 172.21.15.151:0/1785686807 >> v1:172.21.15.151:6789/0 conn(0x7fbd74159550 legacy=0x7fbd74155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:01.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.643+0000 7fbd7a412640 1 -- 172.21.15.151:0/1785686807 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd74155d50 con 0x7fbd74070bc0 2023-10-18T11:10:01.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.648+0000 7fbd7a412640 1 --2- 172.21.15.151:0/1785686807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 0x7fbd7406fdd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0097a0 tx=0x7fbd6c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a002f581447eab9c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:01.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.655+0000 7fbd78c0f640 1 -- 172.21.15.151:0/1785686807 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c030610 con 0x7fbd74070bc0 2023-10-18T11:10:01.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.656+0000 7fbd78c0f640 1 -- 172.21.15.151:0/1785686807 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c030770 con 0x7fbd74070bc0 2023-10-18T11:10:01.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.656+0000 7fbd78c0f640 1 -- 172.21.15.151:0/1785686807 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c030b00 con 0x7fbd74070bc0 2023-10-18T11:10:01.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.656+0000 7fbd7ac13640 1 -- 172.21.15.151:0/1785686807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 msgr2=0x7fbd7406fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:01.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.656+0000 7fbd7ac13640 1 --2- 172.21.15.151:0/1785686807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 0x7fbd7406fdd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0097a0 tx=0x7fbd6c02b960 comp rx=0 tx=0).stop 2023-10-18T11:10:01.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.657+0000 7fbd7ac13640 1 -- 172.21.15.151:0/1785686807 shutdown_connections 2023-10-18T11:10:01.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.657+0000 7fbd7ac13640 1 --2- 172.21.15.151:0/1785686807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 0x7fbd7406fdd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:01.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.657+0000 7fbd7ac13640 1 -- 172.21.15.151:0/1785686807 >> 172.21.15.151:0/1785686807 conn(0x7fbd7406c860 msgr2=0x7fbd7406cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:01.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.657+0000 7fbd7ac13640 1 -- 172.21.15.151:0/1785686807 shutdown_connections 2023-10-18T11:10:01.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.657+0000 7fbd7ac13640 1 -- 172.21.15.151:0/1785686807 wait complete. 2023-10-18T11:10:01.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.659+0000 7fbd7ac13640 1 Processor -- start 2023-10-18T11:10:01.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.659+0000 7fbd7ac13640 1 -- start start 2023-10-18T11:10:01.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.660+0000 7fbd7ac13640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 0x7fbd74154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:01.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.660+0000 7fbd7ac13640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd7414f410 0x7fbd741563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:01.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.660+0000 7fbd7ac13640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd74159550 0x7fbd74156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:01.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.660+0000 7fbd7ac13640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740c5f60 con 0x7fbd74070bc0 2023-10-18T11:10:01.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.660+0000 7fbd7ac13640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740c67c0 con 0x7fbd74159550 2023-10-18T11:10:01.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.660+0000 7fbd7ac13640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7414bc00 con 0x7fbd7414f410 2023-10-18T11:10:01.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.661+0000 7fbd79c11640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 0x7fbd74154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:01.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.661+0000 7fbd7a412640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd74159550 0x7fbd74156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:01.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.661+0000 7fbd79410640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd7414f410 0x7fbd741563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:01.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.661+0000 7fbd79c11640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 0x7fbd74154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57124/0 (socket says 172.21.15.151:57124) 2023-10-18T11:10:01.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.661+0000 7fbd79c11640 1 -- 172.21.15.151:0/2551871551 learned_addr learned my addr 172.21.15.151:0/2551871551 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:01.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.665+0000 7fbd7a412640 1 -- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd7414f410 msgr2=0x7fbd741563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:01.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.665+0000 7fbd7a412640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd7414f410 0x7fbd741563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:01.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.665+0000 7fbd7a412640 1 -- 172.21.15.151:0/2551871551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 msgr2=0x7fbd74154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:01.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.665+0000 7fbd7a412640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 0x7fbd74154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:01.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.665+0000 7fbd7a412640 1 -- 172.21.15.151:0/2551871551 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c009400 con 0x7fbd74159550 2023-10-18T11:10:01.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.667+0000 7fbd7a412640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd74159550 0x7fbd74156930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c033000 tx=0x7fbd6c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:01.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.671+0000 7fbd727fc640 1 -- 172.21.15.151:0/2551871551 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c03e040 con 0x7fbd74159550 2023-10-18T11:10:01.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.671+0000 7fbd727fc640 1 -- 172.21.15.151:0/2551871551 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c039c50 con 0x7fbd74159550 2023-10-18T11:10:01.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.671+0000 7fbd727fc640 1 -- 172.21.15.151:0/2551871551 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c030e30 con 0x7fbd74159550 2023-10-18T11:10:01.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.671+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7414c130 con 0x7fbd74159550 2023-10-18T11:10:01.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.671+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd740c6170 con 0x7fbd74159550 2023-10-18T11:10:01.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.672+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd740c6970 con 0x7fbd74159550 2023-10-18T11:10:01.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.694+0000 7fbd727fc640 1 -- 172.21.15.151:0/2551871551 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbd6c043440 con 0x7fbd74159550 2023-10-18T11:10:01.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.695+0000 7fbd727fc640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbd6006aec0 0x7fbd6006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:01.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.696+0000 7fbd79c11640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbd6006aec0 0x7fbd6006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:01.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.697+0000 7fbd79c11640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbd6006aec0 0x7fbd6006d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd64001560 tx=0x7fbd64009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:01.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.932+0000 7fbd727fc640 1 -- 172.21.15.151:0/2551871551 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd6c07a920 con 0x7fbd74159550 2023-10-18T11:10:01.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:01.942+0000 7fbd727fc640 1 -- 172.21.15.151:0/2551871551 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd6c076c60 con 0x7fbd74159550 2023-10-18T11:10:02.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.145+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd740c6970 con 0x7fbd74159550 2023-10-18T11:10:02.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.152+0000 7fbd727fc640 1 -- 172.21.15.151:0/2551871551 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd740c6970 con 0x7fbd74159550 2023-10-18T11:10:02.154 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:10:02.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.154+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbd6006aec0 msgr2=0x7fbd6006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:02.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.154+0000 7fbd7ac13640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbd6006aec0 0x7fbd6006d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd64001560 tx=0x7fbd64009040 comp rx=0 tx=0).stop 2023-10-18T11:10:02.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.154+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd74159550 msgr2=0x7fbd74156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:02.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.154+0000 7fbd7ac13640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd74159550 0x7fbd74156930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c033000 tx=0x7fbd6c004730 comp rx=0 tx=0).stop 2023-10-18T11:10:02.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.154+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 shutdown_connections 2023-10-18T11:10:02.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.154+0000 7fbd7ac13640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbd6006aec0 0x7fbd6006d380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.154+0000 7fbd7ac13640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd74159550 0x7fbd74156930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.154+0000 7fbd7ac13640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd7414f410 0x7fbd741563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.154+0000 7fbd7ac13640 1 --2- 172.21.15.151:0/2551871551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd74070bc0 0x7fbd74154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.155+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 >> 172.21.15.151:0/2551871551 conn(0x7fbd7406c860 msgr2=0x7fbd740ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:02.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.155+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 shutdown_connections 2023-10-18T11:10:02.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.155+0000 7fbd7ac13640 1 -- 172.21.15.151:0/2551871551 wait complete. 2023-10-18T11:10:02.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T11:10:02.357 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:10:02.362 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:10:02.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.367+0000 7fcbab73e640 1 Processor -- start 2023-10-18T11:10:02.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.367+0000 7fcbab73e640 1 -- start start 2023-10-18T11:10:02.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.368+0000 7fcbab73e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40cbe20 0x7fcba415d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:02.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.369+0000 7fcbab73e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba4153870 con 0x7fcba40c9650 2023-10-18T11:10:02.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.369+0000 7fcbab73e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba40cc200 con 0x7fcba40b1340 2023-10-18T11:10:02.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.369+0000 7fcbab73e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40b1e30 con 0x7fcba40cbe20 2023-10-18T11:10:02.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.369+0000 7fcba8cd9640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fcba40b1340 0x7fcba40cac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:37710/0 (socket says 172.21.15.151:37710) 2023-10-18T11:10:02.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.369+0000 7fcba8cd9640 1 -- 172.21.15.151:0/3497079601 learned_addr learned my addr 172.21.15.151:0/3497079601 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:02.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.369+0000 7fcba94da640 1 --2- 172.21.15.151:0/3497079601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40cbe20 0x7fcba415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:02.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.372+0000 7fcb9bfff640 1 -- 172.21.15.151:0/3497079601 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920977396 0 0) 0x7fcba40cc200 con 0x7fcba40b1340 2023-10-18T11:10:02.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.372+0000 7fcb9bfff640 1 -- 172.21.15.151:0/3497079601 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb90003520 con 0x7fcba40b1340 2023-10-18T11:10:02.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.373+0000 7fcba94da640 1 -- 172.21.15.151:0/3497079601 >> v1:172.21.15.169:6789/0 conn(0x7fcba40b1340 legacy=0x7fcba40cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:02.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.373+0000 7fcba94da640 1 -- 172.21.15.151:0/3497079601 >> v1:172.21.15.151:6789/0 conn(0x7fcba40c9650 legacy=0x7fcba4163970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:02.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.373+0000 7fcba94da640 1 -- 172.21.15.151:0/3497079601 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba41590d0 con 0x7fcba40cbe20 2023-10-18T11:10:02.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.376+0000 7fcba94da640 1 --2- 172.21.15.151:0/3497079601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40cbe20 0x7fcba415d170 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097d0 tx=0x7fcba002b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6489c4fe0fa29acb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:02.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.380+0000 7fcb9bfff640 1 -- 172.21.15.151:0/3497079601 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0030890 con 0x7fcba40cbe20 2023-10-18T11:10:02.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.380+0000 7fcb9bfff640 1 -- 172.21.15.151:0/3497079601 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba00309f0 con 0x7fcba40cbe20 2023-10-18T11:10:02.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.380+0000 7fcb9bfff640 1 -- 172.21.15.151:0/3497079601 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0030d80 con 0x7fcba40cbe20 2023-10-18T11:10:02.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.381+0000 7fcbab73e640 1 -- 172.21.15.151:0/3497079601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40cbe20 msgr2=0x7fcba415d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:02.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.381+0000 7fcbab73e640 1 --2- 172.21.15.151:0/3497079601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40cbe20 0x7fcba415d170 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097d0 tx=0x7fcba002b9d0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.381+0000 7fcbab73e640 1 -- 172.21.15.151:0/3497079601 shutdown_connections 2023-10-18T11:10:02.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.381+0000 7fcbab73e640 1 --2- 172.21.15.151:0/3497079601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40cbe20 0x7fcba415d170 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.381+0000 7fcbab73e640 1 -- 172.21.15.151:0/3497079601 >> 172.21.15.151:0/3497079601 conn(0x7fcba40659d0 msgr2=0x7fcba4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:02.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.381+0000 7fcbab73e640 1 -- 172.21.15.151:0/3497079601 shutdown_connections 2023-10-18T11:10:02.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.381+0000 7fcbab73e640 1 -- 172.21.15.151:0/3497079601 wait complete. 2023-10-18T11:10:02.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.384+0000 7fcbab73e640 1 Processor -- start 2023-10-18T11:10:02.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.384+0000 7fcbab73e640 1 -- start start 2023-10-18T11:10:02.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.385+0000 7fcbab73e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40b1340 0x7fcba40c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:02.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.385+0000 7fcbab73e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba40c9650 0x7fcba40c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:02.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.385+0000 7fcbab73e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcba40cbe20 0x7fcba41ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:02.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.385+0000 7fcbab73e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40c4570 con 0x7fcba40c9650 2023-10-18T11:10:02.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.385+0000 7fcbab73e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40c4850 con 0x7fcba40cbe20 2023-10-18T11:10:02.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.386+0000 7fcbab73e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40c42d0 con 0x7fcba40b1340 2023-10-18T11:10:02.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.386+0000 7fcba94da640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40b1340 0x7fcba40c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:02.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.386+0000 7fcba9cdb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcba40cbe20 0x7fcba41ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:02.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.386+0000 7fcba8cd9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba40c9650 0x7fcba40c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:02.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.386+0000 7fcba94da640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40b1340 0x7fcba40c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:48360/0 (socket says 172.21.15.151:48360) 2023-10-18T11:10:02.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.386+0000 7fcba94da640 1 -- 172.21.15.151:0/2981710779 learned_addr learned my addr 172.21.15.151:0/2981710779 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:02.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.390+0000 7fcba94da640 1 -- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcba40cbe20 msgr2=0x7fcba41ee9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:02.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.390+0000 7fcba94da640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcba40cbe20 0x7fcba41ee9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.390+0000 7fcba94da640 1 -- 172.21.15.151:0/2981710779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba40c9650 msgr2=0x7fcba40c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:02.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.390+0000 7fcba94da640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba40c9650 0x7fcba40c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.390+0000 7fcba94da640 1 -- 172.21.15.151:0/2981710779 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba0009400 con 0x7fcba40b1340 2023-10-18T11:10:02.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.393+0000 7fcba94da640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40b1340 0x7fcba40c4ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097d0 tx=0x7fcba00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:02.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.396+0000 7fcb99ffb640 1 -- 172.21.15.151:0/2981710779 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba003e070 con 0x7fcba40b1340 2023-10-18T11:10:02.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.397+0000 7fcb99ffb640 1 -- 172.21.15.151:0/2981710779 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0039a10 con 0x7fcba40b1340 2023-10-18T11:10:02.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.397+0000 7fcb99ffb640 1 -- 172.21.15.151:0/2981710779 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0039dc0 con 0x7fcba40b1340 2023-10-18T11:10:02.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.397+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba40c2b60 con 0x7fcba40b1340 2023-10-18T11:10:02.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.397+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba40c2880 con 0x7fcba40b1340 2023-10-18T11:10:02.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.398+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba4159370 con 0x7fcba40b1340 2023-10-18T11:10:02.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.416+0000 7fcb99ffb640 1 -- 172.21.15.151:0/2981710779 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcba00423f0 con 0x7fcba40b1340 2023-10-18T11:10:02.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.417+0000 7fcb99ffb640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcb8806aef0 0x7fcb8806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:02.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.417+0000 7fcba8cd9640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcb8806aef0 0x7fcb8806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:02.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.418+0000 7fcba8cd9640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcb8806aef0 0x7fcb8806d3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcba41ec2f0 tx=0x7fcb94007d30 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:02.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.419+0000 7fcb99ffb640 1 -- 172.21.15.151:0/2981710779 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcba007aca0 con 0x7fcba40b1340 2023-10-18T11:10:02.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.659+0000 7fcb99ffb640 1 -- 172.21.15.151:0/2981710779 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcba0076fe0 con 0x7fcba40b1340 2023-10-18T11:10:02.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.873+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcba4159370 con 0x7fcba40b1340 2023-10-18T11:10:02.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.880+0000 7fcb99ffb640 1 -- 172.21.15.151:0/2981710779 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcba4159370 con 0x7fcba40b1340 2023-10-18T11:10:02.882 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-10-18T11:10:02.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.882+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcb8806aef0 msgr2=0x7fcb8806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:02.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.882+0000 7fcbab73e640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcb8806aef0 0x7fcb8806d3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcba41ec2f0 tx=0x7fcb94007d30 comp rx=0 tx=0).stop 2023-10-18T11:10:02.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.882+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40b1340 msgr2=0x7fcba40c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:02.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.882+0000 7fcbab73e640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40b1340 0x7fcba40c4ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097d0 tx=0x7fcba00046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.883+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 shutdown_connections 2023-10-18T11:10:02.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.883+0000 7fcbab73e640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fcb8806aef0 0x7fcb8806d3b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.883+0000 7fcbab73e640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcba40cbe20 0x7fcba41ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.883+0000 7fcbab73e640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcba40c9650 0x7fcba40c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.883+0000 7fcbab73e640 1 --2- 172.21.15.151:0/2981710779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcba40b1340 0x7fcba40c4ce0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:02.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.883+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 >> 172.21.15.151:0/2981710779 conn(0x7fcba40659d0 msgr2=0x7fcba415ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:02.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.883+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 shutdown_connections 2023-10-18T11:10:02.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:02.883+0000 7fcbab73e640 1 -- 172.21.15.151:0/2981710779 wait complete. 2023-10-18T11:10:02.903 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T11:10:03.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.108+0000 7f2d45a5d640 1 Processor -- start 2023-10-18T11:10:03.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.109+0000 7f2d45a5d640 1 -- start start 2023-10-18T11:10:03.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.110+0000 7f2d45a5d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2d40070790 0x7f2d401566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.110+0000 7f2d45a5d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d400c18e0 con 0x7f2d40070ee0 2023-10-18T11:10:03.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.110+0000 7f2d45a5d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d400c5350 con 0x7f2d4014fe20 2023-10-18T11:10:03.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.110+0000 7f2d45a5d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d400c20f0 con 0x7f2d40070790 2023-10-18T11:10:03.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.111+0000 7f2d3effd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f2d4014fe20 0x7f2d400c57e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:37716/0 (socket says 172.21.15.151:37716) 2023-10-18T11:10:03.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.111+0000 7f2d3effd640 1 -- 172.21.15.151:0/1704578739 learned_addr learned my addr 172.21.15.151:0/1704578739 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:03.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.111+0000 7f2d367fc640 1 --2- 172.21.15.151:0/1704578739 >> v2:172.21.15.169:3300/0 conn(0x7f2d40070790 0x7f2d401566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.114+0000 7f2d3e7fc640 1 -- 172.21.15.151:0/1704578739 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906268816 0 0) 0x7f2d400c18e0 con 0x7f2d40070ee0 2023-10-18T11:10:03.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.114+0000 7f2d3e7fc640 1 -- 172.21.15.151:0/1704578739 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d2c003520 con 0x7f2d40070ee0 2023-10-18T11:10:03.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.115+0000 7f2d367fc640 1 -- 172.21.15.151:0/1704578739 >> v1:172.21.15.169:6789/0 conn(0x7f2d4014fe20 legacy=0x7f2d400c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.115+0000 7f2d367fc640 1 -- 172.21.15.151:0/1704578739 >> v1:172.21.15.151:6789/0 conn(0x7f2d40070ee0 legacy=0x7f2d400718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.115+0000 7f2d367fc640 1 -- 172.21.15.151:0/1704578739 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400c1b30 con 0x7f2d40070790 2023-10-18T11:10:03.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.119+0000 7f2d367fc640 1 --2- 172.21.15.151:0/1704578739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d40070790 0x7f2d401566f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097a0 tx=0x7f2d2802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1dce0a2b0cf7e3a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:03.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.123+0000 7f2d3e7fc640 1 -- 172.21.15.151:0/1704578739 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28030610 con 0x7f2d40070790 2023-10-18T11:10:03.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.123+0000 7f2d3e7fc640 1 -- 172.21.15.151:0/1704578739 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d28030770 con 0x7f2d40070790 2023-10-18T11:10:03.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.123+0000 7f2d3e7fc640 1 -- 172.21.15.151:0/1704578739 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28030b00 con 0x7f2d40070790 2023-10-18T11:10:03.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.124+0000 7f2d45a5d640 1 -- 172.21.15.151:0/1704578739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d40070790 msgr2=0x7f2d401566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.124+0000 7f2d45a5d640 1 --2- 172.21.15.151:0/1704578739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d40070790 0x7f2d401566f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097a0 tx=0x7f2d2802b960 comp rx=0 tx=0).stop 2023-10-18T11:10:03.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.124+0000 7f2d45a5d640 1 -- 172.21.15.151:0/1704578739 shutdown_connections 2023-10-18T11:10:03.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.124+0000 7f2d45a5d640 1 --2- 172.21.15.151:0/1704578739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d40070790 0x7f2d401566f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.124+0000 7f2d45a5d640 1 -- 172.21.15.151:0/1704578739 >> 172.21.15.151:0/1704578739 conn(0x7f2d40069f70 msgr2=0x7f2d4006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:03.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.124+0000 7f2d45a5d640 1 -- 172.21.15.151:0/1704578739 shutdown_connections 2023-10-18T11:10:03.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.125+0000 7f2d45a5d640 1 -- 172.21.15.151:0/1704578739 wait complete. 2023-10-18T11:10:03.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.126+0000 7f2d45a5d640 1 Processor -- start 2023-10-18T11:10:03.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.126+0000 7f2d45a5d640 1 -- start start 2023-10-18T11:10:03.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.127+0000 7f2d45a5d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d40070790 0x7f2d400becf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.127+0000 7f2d45a5d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d40070ee0 0x7f2d400bf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.127+0000 7f2d45a5d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4014fe20 0x7f2d400c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.127+0000 7f2d45a5d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400be8a0 con 0x7f2d40070ee0 2023-10-18T11:10:03.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.127+0000 7f2d45a5d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400c0a20 con 0x7f2d4014fe20 2023-10-18T11:10:03.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.127+0000 7f2d45a5d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400ca0c0 con 0x7f2d40070790 2023-10-18T11:10:03.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.128+0000 7f2d367fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d40070ee0 0x7f2d400bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.128+0000 7f2d3f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4014fe20 0x7f2d400c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.128+0000 7f2d3f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4014fe20 0x7f2d400c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:55558/0 (socket says 172.21.15.151:55558) 2023-10-18T11:10:03.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.128+0000 7f2d3f7fe640 1 -- 172.21.15.151:0/4294239728 learned_addr learned my addr 172.21.15.151:0/4294239728 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:03.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.132+0000 7f2d3f7fe640 1 -- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d40070790 msgr2=0x7f2d400becf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.132+0000 7f2d3f7fe640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d40070790 0x7f2d400becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.132+0000 7f2d3f7fe640 1 -- 172.21.15.151:0/4294239728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d40070ee0 msgr2=0x7f2d400bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.132+0000 7f2d3f7fe640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d40070ee0 0x7f2d400bf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.132+0000 7f2d3f7fe640 1 -- 172.21.15.151:0/4294239728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28009400 con 0x7f2d4014fe20 2023-10-18T11:10:03.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.134+0000 7f2d3f7fe640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4014fe20 0x7f2d400c8890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c430 tx=0x7f2d3800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:03.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.137+0000 7f2d3cff9640 1 -- 172.21.15.151:0/4294239728 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380052d0 con 0x7f2d4014fe20 2023-10-18T11:10:03.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.137+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d400ca3a0 con 0x7f2d4014fe20 2023-10-18T11:10:03.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.137+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d400c0f50 con 0x7f2d4014fe20 2023-10-18T11:10:03.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.138+0000 7f2d3cff9640 1 -- 172.21.15.151:0/4294239728 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38005430 con 0x7f2d4014fe20 2023-10-18T11:10:03.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.138+0000 7f2d3cff9640 1 -- 172.21.15.151:0/4294239728 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380037f0 con 0x7f2d4014fe20 2023-10-18T11:10:03.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.138+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d24005250 con 0x7f2d4014fe20 2023-10-18T11:10:03.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.401+0000 7f2d3cff9640 1 -- 172.21.15.151:0/4294239728 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2d38003950 con 0x7f2d4014fe20 2023-10-18T11:10:03.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.404+0000 7f2d3cff9640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2d2006ae70 0x7f2d2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.404+0000 7f2d3cff9640 1 -- 172.21.15.151:0/4294239728 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2d38089150 con 0x7f2d4014fe20 2023-10-18T11:10:03.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.405+0000 7f2d3effd640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2d2006ae70 0x7f2d2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.406+0000 7f2d3effd640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2d2006ae70 0x7f2d2006d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2d30002070 tx=0x7f2d30001660 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:03.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.417+0000 7f2d3cff9640 1 -- 172.21.15.151:0/4294239728 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d38054130 con 0x7f2d4014fe20 2023-10-18T11:10:03.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.621+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2d24005a80 con 0x7f2d4014fe20 2023-10-18T11:10:03.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.627+0000 7f2d3cff9640 1 -- 172.21.15.151:0/4294239728 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2d38057750 con 0x7f2d4014fe20 2023-10-18T11:10:03.629 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:10:03.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2d2006ae70 msgr2=0x7f2d2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2d2006ae70 0x7f2d2006d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2d30002070 tx=0x7f2d30001660 comp rx=0 tx=0).stop 2023-10-18T11:10:03.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4014fe20 msgr2=0x7f2d400c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4014fe20 0x7f2d400c8890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c430 tx=0x7f2d3800c8f0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 shutdown_connections 2023-10-18T11:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2d2006ae70 0x7f2d2006d330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4014fe20 0x7f2d400c8890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d40070ee0 0x7f2d400bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 --2- 172.21.15.151:0/4294239728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d40070790 0x7f2d400becf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 >> 172.21.15.151:0/4294239728 conn(0x7f2d40069f70 msgr2=0x7f2d400c62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:03.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 shutdown_connections 2023-10-18T11:10:03.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.629+0000 7f2d45a5d640 1 -- 172.21.15.151:0/4294239728 wait complete. 2023-10-18T11:10:03.650 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T11:10:03.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.864+0000 7ffbd65b8640 1 Processor -- start 2023-10-18T11:10:03.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.864+0000 7ffbd65b8640 1 -- start start 2023-10-18T11:10:03.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.866+0000 7ffbd65b8640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffbd006a240 0x7ffbd00c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.866+0000 7ffbd65b8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006faf0 0x7ffbd015a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.866+0000 7ffbd65b8640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd00c7470 con 0x7ffbd006a620 2023-10-18T11:10:03.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.866+0000 7ffbd65b8640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd00c5670 con 0x7ffbd006a240 2023-10-18T11:10:03.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.866+0000 7ffbd65b8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00705f0 con 0x7ffbd006faf0 2023-10-18T11:10:03.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.867+0000 7ffbd4db5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006faf0 0x7ffbd015a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.867+0000 7ffbd4db5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006faf0 0x7ffbd015a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:48374/0 (socket says 172.21.15.151:48374) 2023-10-18T11:10:03.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.867+0000 7ffbd4db5640 1 -- 172.21.15.151:0/1832019128 learned_addr learned my addr 172.21.15.151:0/1832019128 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:03.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.867+0000 7ffbd55b6640 1 --2- 172.21.15.151:0/1832019128 >> v2:172.21.15.151:3300/0 conn(0x7ffbd006a240 0x7ffbd00c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.869+0000 7ffbd4db5640 1 -- 172.21.15.151:0/1832019128 >> v2:172.21.15.151:3300/0 conn(0x7ffbd006a240 msgr2=0x7ffbd00c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:03.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.869+0000 7ffbd4db5640 1 --2- 172.21.15.151:0/1832019128 >> v2:172.21.15.151:3300/0 conn(0x7ffbd006a240 0x7ffbd00c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.869+0000 7ffbd4db5640 1 -- 172.21.15.151:0/1832019128 >> v1:172.21.15.151:6789/0 conn(0x7ffbd006a620 legacy=0x7ffbd0150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.869+0000 7ffbd4db5640 1 -- 172.21.15.151:0/1832019128 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd00c4dd0 con 0x7ffbd006faf0 2023-10-18T11:10:03.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.872+0000 7ffbd4db5640 1 --2- 172.21.15.151:0/1832019128 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006faf0 0x7ffbd015a3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009870 tx=0x7ffbc002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=421072e5838df134 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:03.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.875+0000 7ffbc7fff640 1 -- 172.21.15.151:0/1832019128 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0030840 con 0x7ffbd006faf0 2023-10-18T11:10:03.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.876+0000 7ffbc7fff640 1 -- 172.21.15.151:0/1832019128 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc00309a0 con 0x7ffbd006faf0 2023-10-18T11:10:03.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.876+0000 7ffbc7fff640 1 -- 172.21.15.151:0/1832019128 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0030d30 con 0x7ffbd006faf0 2023-10-18T11:10:03.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.876+0000 7ffbd65b8640 1 -- 172.21.15.151:0/1832019128 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006faf0 msgr2=0x7ffbd015a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.876+0000 7ffbd65b8640 1 --2- 172.21.15.151:0/1832019128 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006faf0 0x7ffbd015a3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009870 tx=0x7ffbc002b980 comp rx=0 tx=0).stop 2023-10-18T11:10:03.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.876+0000 7ffbd65b8640 1 -- 172.21.15.151:0/1832019128 shutdown_connections 2023-10-18T11:10:03.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.876+0000 7ffbd65b8640 1 --2- 172.21.15.151:0/1832019128 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006faf0 0x7ffbd015a3d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.876+0000 7ffbd65b8640 1 --2- 172.21.15.151:0/1832019128 >> v2:172.21.15.151:3300/0 conn(0x7ffbd006a240 0x7ffbd00c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.876+0000 7ffbd65b8640 1 -- 172.21.15.151:0/1832019128 >> 172.21.15.151:0/1832019128 conn(0x7ffbd00659d0 msgr2=0x7ffbd0065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:03.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.877+0000 7ffbd65b8640 1 -- 172.21.15.151:0/1832019128 shutdown_connections 2023-10-18T11:10:03.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.877+0000 7ffbd65b8640 1 -- 172.21.15.151:0/1832019128 wait complete. 2023-10-18T11:10:03.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.878+0000 7ffbd65b8640 1 Processor -- start 2023-10-18T11:10:03.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.878+0000 7ffbd65b8640 1 -- start start 2023-10-18T11:10:03.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.879+0000 7ffbd65b8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbd006a240 0x7ffbd0149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.879+0000 7ffbd65b8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006a620 0x7ffbd0159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.879+0000 7ffbd65b8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbd006faf0 0x7ffbd014a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.879+0000 7ffbd65b8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0154910 con 0x7ffbd006faf0 2023-10-18T11:10:03.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.879+0000 7ffbd65b8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0154420 con 0x7ffbd006a240 2023-10-18T11:10:03.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.879+0000 7ffbd65b8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0149180 con 0x7ffbd006a620 2023-10-18T11:10:03.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.880+0000 7ffbd55b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbd006a240 0x7ffbd0149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.880+0000 7ffbd55b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbd006a240 0x7ffbd0149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:55564/0 (socket says 172.21.15.151:55564) 2023-10-18T11:10:03.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.880+0000 7ffbd55b6640 1 -- 172.21.15.151:0/4131437700 learned_addr learned my addr 172.21.15.151:0/4131437700 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:03.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.881+0000 7ffbd5db7640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbd006faf0 0x7ffbd014a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.881+0000 7ffbd4db5640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006a620 0x7ffbd0159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.884+0000 7ffbd55b6640 1 -- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006a620 msgr2=0x7ffbd0159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.884+0000 7ffbd55b6640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006a620 0x7ffbd0159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.884+0000 7ffbd55b6640 1 -- 172.21.15.151:0/4131437700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbd006faf0 msgr2=0x7ffbd014a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:03.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.884+0000 7ffbd55b6640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbd006faf0 0x7ffbd014a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:03.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.884+0000 7ffbd55b6640 1 -- 172.21.15.151:0/4131437700 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc00094d0 con 0x7ffbd006a240 2023-10-18T11:10:03.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.888+0000 7ffbd55b6640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbd006a240 0x7ffbd0149420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00e9b0 tx=0x7ffbcc00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:03.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.891+0000 7ffbc5ffb640 1 -- 172.21.15.151:0/4131437700 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc009670 con 0x7ffbd006a240 2023-10-18T11:10:03.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.891+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd01ec9f0 con 0x7ffbd006a240 2023-10-18T11:10:03.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.891+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd0154630 con 0x7ffbd006a240 2023-10-18T11:10:03.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.892+0000 7ffbc5ffb640 1 -- 172.21.15.151:0/4131437700 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc00c9a0 con 0x7ffbd006a240 2023-10-18T11:10:03.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.893+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd004e160 con 0x7ffbd006a240 2023-10-18T11:10:03.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.893+0000 7ffbc5ffb640 1 -- 172.21.15.151:0/4131437700 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc00cd10 con 0x7ffbd006a240 2023-10-18T11:10:03.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.916+0000 7ffbc5ffb640 1 -- 172.21.15.151:0/4131437700 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffbcc005990 con 0x7ffbd006a240 2023-10-18T11:10:03.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.917+0000 7ffbc5ffb640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ffbb406aea0 0x7ffbb406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:03.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.918+0000 7ffbd4db5640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ffbb406aea0 0x7ffbb406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:03.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:03.919+0000 7ffbd4db5640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ffbb406aea0 0x7ffbb406d360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0036000 tx=0x7ffbc003b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:04.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.149+0000 7ffbc5ffb640 1 -- 172.21.15.151:0/4131437700 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffbcc058970 con 0x7ffbd006a240 2023-10-18T11:10:04.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.160+0000 7ffbc5ffb640 1 -- 172.21.15.151:0/4131437700 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffbcc054cb0 con 0x7ffbd006a240 2023-10-18T11:10:04.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.380+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffbd014c090 con 0x7ffbd006a240 2023-10-18T11:10:04.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.386+0000 7ffbc5ffb640 1 -- 172.21.15.151:0/4131437700 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffbcc021020 con 0x7ffbd006a240 2023-10-18T11:10:04.387 INFO:teuthology.orchestra.run.smithi151.stderr:listed 0 entries 2023-10-18T11:10:04.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ffbb406aea0 msgr2=0x7ffbb406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:04.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ffbb406aea0 0x7ffbb406d360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0036000 tx=0x7ffbc003b040 comp rx=0 tx=0).stop 2023-10-18T11:10:04.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbd006a240 msgr2=0x7ffbd0149420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:04.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbd006a240 0x7ffbd0149420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00e9b0 tx=0x7ffbcc00ee70 comp rx=0 tx=0).stop 2023-10-18T11:10:04.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 shutdown_connections 2023-10-18T11:10:04.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbd006faf0 0x7ffbd014a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:04.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbd006a620 0x7ffbd0159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:04.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ffbb406aea0 0x7ffbb406d360 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:04.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 --2- 172.21.15.151:0/4131437700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbd006a240 0x7ffbd0149420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:04.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 >> 172.21.15.151:0/4131437700 conn(0x7ffbd00659d0 msgr2=0x7ffbd015a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:04.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 shutdown_connections 2023-10-18T11:10:04.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.388+0000 7ffbd65b8640 1 -- 172.21.15.151:0/4131437700 wait complete. 2023-10-18T11:10:04.411 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:10:04.411 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T11:10:04.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:10:04.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.718+0000 7fb1910d7640 1 Processor -- start 2023-10-18T11:10:04.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.719+0000 7fb1910d7640 1 -- start start 2023-10-18T11:10:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.720+0000 7fb1910d7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb18c15c910 0x7fb18c15cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.720+0000 7fb1910d7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c14feb0 con 0x7fb18c06faf0 2023-10-18T11:10:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.720+0000 7fb1910d7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c15d2e0 con 0x7fb18c14fad0 2023-10-18T11:10:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.720+0000 7fb1910d7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c159ee0 con 0x7fb18c15c910 2023-10-18T11:10:04.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.721+0000 7fb183fff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb18c06faf0 0x7fb18c069fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54170/0 (socket says 172.21.15.151:54170) 2023-10-18T11:10:04.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.721+0000 7fb183fff640 1 -- 172.21.15.151:0/3137169964 learned_addr learned my addr 172.21.15.151:0/3137169964 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:04.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.721+0000 7fb1908d6640 1 --2- 172.21.15.151:0/3137169964 >> v2:172.21.15.169:3300/0 conn(0x7fb18c15c910 0x7fb18c15cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:04.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.723+0000 7fb18b7fe640 1 -- 172.21.15.151:0/3137169964 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047914244 0 0) 0x7fb18c14feb0 con 0x7fb18c06faf0 2023-10-18T11:10:04.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.723+0000 7fb18b7fe640 1 -- 172.21.15.151:0/3137169964 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb178003520 con 0x7fb18c06faf0 2023-10-18T11:10:04.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.725+0000 7fb1908d6640 1 -- 172.21.15.151:0/3137169964 >> v1:172.21.15.169:6789/0 conn(0x7fb18c14fad0 legacy=0x7fb18c070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:04.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.725+0000 7fb1908d6640 1 -- 172.21.15.151:0/3137169964 >> v1:172.21.15.151:6789/0 conn(0x7fb18c06faf0 legacy=0x7fb18c069fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:04.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.725+0000 7fb1908d6640 1 -- 172.21.15.151:0/3137169964 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c1590c0 con 0x7fb18c15c910 2023-10-18T11:10:04.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.728+0000 7fb1908d6640 1 --2- 172.21.15.151:0/3137169964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb18c15c910 0x7fb18c15cda0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb184009d90 tx=0x7fb18402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba1893325ea752a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:04.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.733+0000 7fb18b7fe640 1 -- 172.21.15.151:0/3137169964 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18402cd80 con 0x7fb18c15c910 2023-10-18T11:10:04.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.733+0000 7fb18b7fe640 1 -- 172.21.15.151:0/3137169964 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb184034440 con 0x7fb18c15c910 2023-10-18T11:10:04.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.733+0000 7fb18b7fe640 1 -- 172.21.15.151:0/3137169964 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840347d0 con 0x7fb18c15c910 2023-10-18T11:10:04.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.734+0000 7fb1910d7640 1 -- 172.21.15.151:0/3137169964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb18c15c910 msgr2=0x7fb18c15cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:04.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.734+0000 7fb1910d7640 1 --2- 172.21.15.151:0/3137169964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb18c15c910 0x7fb18c15cda0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb184009d90 tx=0x7fb18402bfd0 comp rx=0 tx=0).stop 2023-10-18T11:10:04.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.734+0000 7fb1910d7640 1 -- 172.21.15.151:0/3137169964 shutdown_connections 2023-10-18T11:10:04.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.734+0000 7fb1910d7640 1 --2- 172.21.15.151:0/3137169964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb18c15c910 0x7fb18c15cda0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:04.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.735+0000 7fb1910d7640 1 -- 172.21.15.151:0/3137169964 >> 172.21.15.151:0/3137169964 conn(0x7fb18c0659d0 msgr2=0x7fb18c065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:04.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.735+0000 7fb1910d7640 1 -- 172.21.15.151:0/3137169964 shutdown_connections 2023-10-18T11:10:04.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.735+0000 7fb1910d7640 1 -- 172.21.15.151:0/3137169964 wait complete. 2023-10-18T11:10:04.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.737+0000 7fb1910d7640 1 Processor -- start 2023-10-18T11:10:04.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.737+0000 7fb1910d7640 1 -- start start 2023-10-18T11:10:04.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.738+0000 7fb1910d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb18c06faf0 0x7fb18c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:04.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.738+0000 7fb1910d7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb18c14fad0 0x7fb18c0c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:04.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.738+0000 7fb1910d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb18c15c910 0x7fb18c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:04.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.738+0000 7fb1910d7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c14a190 con 0x7fb18c06faf0 2023-10-18T11:10:04.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.738+0000 7fb1910d7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0c2730 con 0x7fb18c15c910 2023-10-18T11:10:04.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.738+0000 7fb1910d7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c1f19d0 con 0x7fb18c14fad0 2023-10-18T11:10:04.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.739+0000 7fb183fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb18c14fad0 0x7fb18c0c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:04.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.739+0000 7fb183fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb18c14fad0 0x7fb18c0c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:48394/0 (socket says 172.21.15.151:48394) 2023-10-18T11:10:04.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.739+0000 7fb183fff640 1 -- 172.21.15.151:0/2875728940 learned_addr learned my addr 172.21.15.151:0/2875728940 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:04.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.740+0000 7fb18bfff640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb18c06faf0 0x7fb18c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:04.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.740+0000 7fb1908d6640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb18c15c910 0x7fb18c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:04.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.744+0000 7fb183fff640 1 -- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb18c15c910 msgr2=0x7fb18c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:04.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.744+0000 7fb183fff640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb18c15c910 0x7fb18c15b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:04.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.744+0000 7fb183fff640 1 -- 172.21.15.151:0/2875728940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb18c06faf0 msgr2=0x7fb18c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:04.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.744+0000 7fb183fff640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb18c06faf0 0x7fb18c156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:04.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.744+0000 7fb183fff640 1 -- 172.21.15.151:0/2875728940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184009a70 con 0x7fb18c14fad0 2023-10-18T11:10:04.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.747+0000 7fb183fff640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb18c14fad0 0x7fb18c0c37c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c500 tx=0x7fb17400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:04.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.751+0000 7fb1897fa640 1 -- 172.21.15.151:0/2875728940 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174005ce0 con 0x7fb18c14fad0 2023-10-18T11:10:04.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.751+0000 7fb1897fa640 1 -- 172.21.15.151:0/2875728940 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174005e40 con 0x7fb18c14fad0 2023-10-18T11:10:04.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.751+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c0c2a00 con 0x7fb18c14fad0 2023-10-18T11:10:04.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.751+0000 7fb1897fa640 1 -- 172.21.15.151:0/2875728940 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174007330 con 0x7fb18c14fad0 2023-10-18T11:10:04.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.751+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c0c2fc0 con 0x7fb18c14fad0 2023-10-18T11:10:04.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.753+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c04e160 con 0x7fb18c14fad0 2023-10-18T11:10:04.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.771+0000 7fb1897fa640 1 -- 172.21.15.151:0/2875728940 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb174007550 con 0x7fb18c14fad0 2023-10-18T11:10:04.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.773+0000 7fb1897fa640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb16c06aec0 0x7fb16c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:04.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.773+0000 7fb18bfff640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb16c06aec0 0x7fb16c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:04.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.773+0000 7fb1897fa640 1 -- 172.21.15.151:0/2875728940 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb174057fb0 con 0x7fb18c14fad0 2023-10-18T11:10:04.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:04.774+0000 7fb18bfff640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb16c06aec0 0x7fb16c06d380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000f60 tx=0x7fb17c009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:05.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.018+0000 7fb1897fa640 1 -- 172.21.15.151:0/2875728940 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1740542f0 con 0x7fb18c14fad0 2023-10-18T11:10:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.221+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb18c070230 con 0x7fb18c14fad0 2023-10-18T11:10:05.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.362+0000 7fb1897fa640 1 -- 172.21.15.151:0/2875728940 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18406 (secure 0 0 0) 0x7fb174057910 con 0x7fb18c14fad0 2023-10-18T11:10:05.365 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:05.366 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":29,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:09:46.835355+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:05.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb16c06aec0 msgr2=0x7fb16c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:05.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb16c06aec0 0x7fb16c06d380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000f60 tx=0x7fb17c009040 comp rx=0 tx=0).stop 2023-10-18T11:10:05.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb18c14fad0 msgr2=0x7fb18c0c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:05.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb18c14fad0 0x7fb18c0c37c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c500 tx=0x7fb17400c9c0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 shutdown_connections 2023-10-18T11:10:05.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb16c06aec0 0x7fb16c06d380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb18c15c910 0x7fb18c15b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb18c14fad0 0x7fb18c0c37c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 --2- 172.21.15.151:0/2875728940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb18c06faf0 0x7fb18c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 >> 172.21.15.151:0/2875728940 conn(0x7fb18c0659d0 msgr2=0x7fb18c0c5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:05.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 shutdown_connections 2023-10-18T11:10:05.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.366+0000 7fb1910d7640 1 -- 172.21.15.151:0/2875728940 wait complete. 2023-10-18T11:10:05.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T11:09:16.833723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T11:09:34.803213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T11:09:37.000724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T11:09:43.858153+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T11:10:05.394 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T11:10:05.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.600+0000 7f283ecaf640 1 Processor -- start 2023-10-18T11:10:05.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.600+0000 7f283ecaf640 1 -- start start 2023-10-18T11:10:05.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.601+0000 7f283ecaf640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f28380c19e0 0x7f283806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.601+0000 7f283ecaf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f28380c4d40 0x7f28380c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.601+0000 7f283ecaf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28381503b0 con 0x7f283814ffd0 2023-10-18T11:10:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.601+0000 7f283ecaf640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28380c4070 con 0x7f28380c19e0 2023-10-18T11:10:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.601+0000 7f283ecaf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2838155e70 con 0x7f28380c4d40 2023-10-18T11:10:05.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.602+0000 7f2837fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f28380c19e0 0x7f283806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:05.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.602+0000 7f283d24c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f28380c4d40 0x7f28380c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:05.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.602+0000 7f283ca4b640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f283814ffd0 0x7f2838156880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:37740/0 (socket says 172.21.15.151:37740) 2023-10-18T11:10:05.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.602+0000 7f283ca4b640 1 -- 172.21.15.151:0/3584493222 learned_addr learned my addr 172.21.15.151:0/3584493222 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:05.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.605+0000 7f2837fff640 1 -- 172.21.15.151:0/3584493222 >> v2:172.21.15.169:3300/0 conn(0x7f28380c4d40 msgr2=0x7f28380c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:05.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.605+0000 7f2837fff640 1 --2- 172.21.15.151:0/3584493222 >> v2:172.21.15.169:3300/0 conn(0x7f28380c4d40 0x7f28380c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.605+0000 7f2837fff640 1 -- 172.21.15.151:0/3584493222 >> v1:172.21.15.169:6789/0 conn(0x7f283814ffd0 legacy=0x7f2838156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:05.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.605+0000 7f2837fff640 1 -- 172.21.15.151:0/3584493222 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380c37d0 con 0x7f28380c19e0 2023-10-18T11:10:05.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.608+0000 7f2837fff640 1 --2- 172.21.15.151:0/3584493222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28380c19e0 0x7f283806fc80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2838155fb0 tx=0x7f282402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6309f28537fbd747 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.612+0000 7f28377fe640 1 -- 172.21.15.151:0/3584493222 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824030610 con 0x7f28380c19e0 2023-10-18T11:10:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.612+0000 7f28377fe640 1 -- 172.21.15.151:0/3584493222 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2824030770 con 0x7f28380c19e0 2023-10-18T11:10:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.612+0000 7f28377fe640 1 -- 172.21.15.151:0/3584493222 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824030b00 con 0x7f28380c19e0 2023-10-18T11:10:05.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.613+0000 7f283ecaf640 1 -- 172.21.15.151:0/3584493222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28380c19e0 msgr2=0x7f283806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:05.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.613+0000 7f283ecaf640 1 --2- 172.21.15.151:0/3584493222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28380c19e0 0x7f283806fc80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2838155fb0 tx=0x7f282402b960 comp rx=0 tx=0).stop 2023-10-18T11:10:05.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.613+0000 7f283ecaf640 1 -- 172.21.15.151:0/3584493222 shutdown_connections 2023-10-18T11:10:05.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.613+0000 7f283ecaf640 1 --2- 172.21.15.151:0/3584493222 >> v2:172.21.15.169:3300/0 conn(0x7f28380c4d40 0x7f28380c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.613+0000 7f283ecaf640 1 --2- 172.21.15.151:0/3584493222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28380c19e0 0x7f283806fc80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.613+0000 7f283ecaf640 1 -- 172.21.15.151:0/3584493222 >> 172.21.15.151:0/3584493222 conn(0x7f2838069d90 msgr2=0x7f283806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:05.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.613+0000 7f283ecaf640 1 -- 172.21.15.151:0/3584493222 shutdown_connections 2023-10-18T11:10:05.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.613+0000 7f283ecaf640 1 -- 172.21.15.151:0/3584493222 wait complete. 2023-10-18T11:10:05.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.615+0000 7f283ecaf640 1 Processor -- start 2023-10-18T11:10:05.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.615+0000 7f283ecaf640 1 -- start start 2023-10-18T11:10:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.616+0000 7f283ecaf640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28380c19e0 0x7f28381ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.616+0000 7f283ecaf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28380c4d40 0x7f2838152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.616+0000 7f283ecaf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f283814ffd0 0x7f283814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.616+0000 7f283ecaf640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28381ec9c0 con 0x7f28380c19e0 2023-10-18T11:10:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.616+0000 7f283ecaf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28381ec110 con 0x7f283814ffd0 2023-10-18T11:10:05.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.616+0000 7f283ecaf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28381efbe0 con 0x7f28380c4d40 2023-10-18T11:10:05.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.616+0000 7f283d24c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f283814ffd0 0x7f283814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:05.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.616+0000 7f283ca4b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28380c19e0 0x7f28381ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:05.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.616+0000 7f2837fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28380c4d40 0x7f2838152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:05.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.617+0000 7f283d24c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f283814ffd0 0x7f283814ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:55590/0 (socket says 172.21.15.151:55590) 2023-10-18T11:10:05.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.617+0000 7f283d24c640 1 -- 172.21.15.151:0/2966943728 learned_addr learned my addr 172.21.15.151:0/2966943728 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:05.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.620+0000 7f283d24c640 1 -- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28380c4d40 msgr2=0x7f2838152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:05.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.620+0000 7f283d24c640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28380c4d40 0x7f2838152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.620+0000 7f283d24c640 1 -- 172.21.15.151:0/2966943728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28380c19e0 msgr2=0x7f28381ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:05.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.620+0000 7f283d24c640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28380c19e0 0x7f28381ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:05.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.620+0000 7f283d24c640 1 -- 172.21.15.151:0/2966943728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2824009400 con 0x7f283814ffd0 2023-10-18T11:10:05.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.622+0000 7f283d24c640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f283814ffd0 0x7f283814ae10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f283000efc0 tx=0x7f283000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:05.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.626+0000 7f28357fa640 1 -- 172.21.15.151:0/2966943728 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830009ca0 con 0x7f283814ffd0 2023-10-18T11:10:05.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.626+0000 7f28357fa640 1 -- 172.21.15.151:0/2966943728 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283000f040 con 0x7f283814ffd0 2023-10-18T11:10:05.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.626+0000 7f28357fa640 1 -- 172.21.15.151:0/2966943728 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28300146c0 con 0x7f283814ffd0 2023-10-18T11:10:05.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.626+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2838153310 con 0x7f283814ffd0 2023-10-18T11:10:05.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.626+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28381ec300 con 0x7f283814ffd0 2023-10-18T11:10:05.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.627+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28381ecb00 con 0x7f283814ffd0 2023-10-18T11:10:05.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.876+0000 7f28357fa640 1 -- 172.21.15.151:0/2966943728 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2830014820 con 0x7f283814ffd0 2023-10-18T11:10:05.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.878+0000 7f28357fa640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f281c06aec0 0x7f281c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:05.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.879+0000 7f28357fa640 1 -- 172.21.15.151:0/2966943728 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f283008abd0 con 0x7f283814ffd0 2023-10-18T11:10:05.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.879+0000 7f283ca4b640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f281c06aec0 0x7f281c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:05.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.880+0000 7f283ca4b640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f281c06aec0 0x7f281c06d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f282c005880 tx=0x7f282c009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:05.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:05.890+0000 7f28357fa640 1 -- 172.21.15.151:0/2966943728 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2830055a90 con 0x7f283814ffd0 2023-10-18T11:10:06.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.103+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28381ecb00 con 0x7f283814ffd0 2023-10-18T11:10:06.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.108+0000 7f28357fa640 1 -- 172.21.15.151:0/2966943728 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28381ecb00 con 0x7f283814ffd0 2023-10-18T11:10:06.110 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-10-18T11:10:06.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f281c06aec0 msgr2=0x7f281c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:06.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f281c06aec0 0x7f281c06d380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f282c005880 tx=0x7f282c009040 comp rx=0 tx=0).stop 2023-10-18T11:10:06.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f283814ffd0 msgr2=0x7f283814ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:06.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f283814ffd0 0x7f283814ae10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f283000efc0 tx=0x7f283000c490 comp rx=0 tx=0).stop 2023-10-18T11:10:06.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 shutdown_connections 2023-10-18T11:10:06.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f281c06aec0 0x7f281c06d380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f283814ffd0 0x7f283814ae10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28380c4d40 0x7f2838152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 --2- 172.21.15.151:0/2966943728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28380c19e0 0x7f28381ef6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 >> 172.21.15.151:0/2966943728 conn(0x7f2838069d90 msgr2=0x7f28380c41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:06.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 shutdown_connections 2023-10-18T11:10:06.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.111+0000 7f283ecaf640 1 -- 172.21.15.151:0/2966943728 wait complete. 2023-10-18T11:10:06.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T11:10:06.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.350+0000 7f927b2bb640 1 Processor -- start 2023-10-18T11:10:06.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.350+0000 7f927b2bb640 1 -- start start 2023-10-18T11:10:06.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.352+0000 7f927b2bb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f927414fe20 0x7f92741566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:06.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.352+0000 7f927b2bb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9274070ee0 0x7f92740718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:06.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.352+0000 7f927b2bb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92740c18e0 con 0x7f9274070790 2023-10-18T11:10:06.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.352+0000 7f927b2bb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92740c5350 con 0x7f9274070ee0 2023-10-18T11:10:06.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.352+0000 7f927b2bb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92740c20f0 con 0x7f927414fe20 2023-10-18T11:10:06.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.353+0000 7f9278856640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f9274070790 0x7f92740c57e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:37744/0 (socket says 172.21.15.151:37744) 2023-10-18T11:10:06.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.353+0000 7f9278856640 1 -- 172.21.15.151:0/2275820450 learned_addr learned my addr 172.21.15.151:0/2275820450 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:06.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.353+0000 7f9279057640 1 --2- 172.21.15.151:0/2275820450 >> v2:172.21.15.169:3300/0 conn(0x7f927414fe20 0x7f92741566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:06.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.356+0000 7f9279057640 1 -- 172.21.15.151:0/2275820450 >> v2:172.21.15.151:3300/0 conn(0x7f9274070ee0 msgr2=0x7f92740718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:06.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.356+0000 7f9279057640 1 --2- 172.21.15.151:0/2275820450 >> v2:172.21.15.151:3300/0 conn(0x7f9274070ee0 0x7f92740718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.356+0000 7f9279057640 1 -- 172.21.15.151:0/2275820450 >> v1:172.21.15.169:6789/0 conn(0x7f9274070790 legacy=0x7f92740c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:06.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.356+0000 7f9279057640 1 -- 172.21.15.151:0/2275820450 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740c1b30 con 0x7f927414fe20 2023-10-18T11:10:06.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.361+0000 7f9279057640 1 --2- 172.21.15.151:0/2275820450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927414fe20 0x7f92741566f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f92740c7bf0 tx=0x7f927002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69a61f668c183bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:06.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.364+0000 7f926bfff640 1 -- 172.21.15.151:0/2275820450 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270031830 con 0x7f927414fe20 2023-10-18T11:10:06.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.364+0000 7f926bfff640 1 -- 172.21.15.151:0/2275820450 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270031990 con 0x7f927414fe20 2023-10-18T11:10:06.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.364+0000 7f926bfff640 1 -- 172.21.15.151:0/2275820450 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270031d20 con 0x7f927414fe20 2023-10-18T11:10:06.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.365+0000 7f927b2bb640 1 -- 172.21.15.151:0/2275820450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927414fe20 msgr2=0x7f92741566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:06.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.365+0000 7f927b2bb640 1 --2- 172.21.15.151:0/2275820450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927414fe20 0x7f92741566f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f92740c7bf0 tx=0x7f927002b8d0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.365+0000 7f927b2bb640 1 -- 172.21.15.151:0/2275820450 shutdown_connections 2023-10-18T11:10:06.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.365+0000 7f927b2bb640 1 --2- 172.21.15.151:0/2275820450 >> v2:172.21.15.151:3300/0 conn(0x7f9274070ee0 0x7f92740718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.365+0000 7f927b2bb640 1 --2- 172.21.15.151:0/2275820450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f927414fe20 0x7f92741566f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.365+0000 7f927b2bb640 1 -- 172.21.15.151:0/2275820450 >> 172.21.15.151:0/2275820450 conn(0x7f9274069f70 msgr2=0x7f927406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:06.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.366+0000 7f927b2bb640 1 -- 172.21.15.151:0/2275820450 shutdown_connections 2023-10-18T11:10:06.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.366+0000 7f927b2bb640 1 -- 172.21.15.151:0/2275820450 wait complete. 2023-10-18T11:10:06.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.367+0000 7f927b2bb640 1 Processor -- start 2023-10-18T11:10:06.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.368+0000 7f927b2bb640 1 -- start start 2023-10-18T11:10:06.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.369+0000 7f927b2bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9274070790 0x7f92741f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:06.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.369+0000 7f927b2bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9274070ee0 0x7f9274159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:06.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.369+0000 7f927b2bb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927414fe20 0x7f927414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:06.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.369+0000 7f927b2bb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92741593c0 con 0x7f927414fe20 2023-10-18T11:10:06.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.369+0000 7f927b2bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92741f1c30 con 0x7f9274070ee0 2023-10-18T11:10:06.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.369+0000 7f927b2bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927413fd20 con 0x7f9274070790 2023-10-18T11:10:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.370+0000 7f9279057640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9274070790 0x7f92741f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.370+0000 7f9279057640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9274070790 0x7f92741f20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:48412/0 (socket says 172.21.15.151:48412) 2023-10-18T11:10:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.370+0000 7f9279057640 1 -- 172.21.15.151:0/1146495285 learned_addr learned my addr 172.21.15.151:0/1146495285 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.371+0000 7f9278856640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9274070ee0 0x7f9274159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:06.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.372+0000 7f9279858640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927414fe20 0x7f927414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:06.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.375+0000 7f9279057640 1 -- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9274070ee0 msgr2=0x7f9274159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:06.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.375+0000 7f9279057640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9274070ee0 0x7f9274159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.375+0000 7f9279057640 1 -- 172.21.15.151:0/1146495285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927414fe20 msgr2=0x7f927414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:06.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.375+0000 7f9279057640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927414fe20 0x7f927414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.375+0000 7f9279057640 1 -- 172.21.15.151:0/1146495285 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270009400 con 0x7f9274070790 2023-10-18T11:10:06.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.380+0000 7f9279057640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9274070790 0x7f92741f20c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9270000c00 tx=0x7f92700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:06.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.384+0000 7f9269ffb640 1 -- 172.21.15.151:0/1146495285 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927003aa60 con 0x7f9274070790 2023-10-18T11:10:06.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.384+0000 7f9269ffb640 1 -- 172.21.15.151:0/1146495285 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927003abe0 con 0x7f9274070790 2023-10-18T11:10:06.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.384+0000 7f9269ffb640 1 -- 172.21.15.151:0/1146495285 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92700443f0 con 0x7f9274070790 2023-10-18T11:10:06.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.384+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9274140820 con 0x7f9274070790 2023-10-18T11:10:06.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.384+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9274140260 con 0x7f9274070790 2023-10-18T11:10:06.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.385+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927404e160 con 0x7f9274070790 2023-10-18T11:10:06.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.405+0000 7f9269ffb640 1 -- 172.21.15.151:0/1146495285 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f927004d450 con 0x7f9274070790 2023-10-18T11:10:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.406+0000 7f9269ffb640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f925806aec0 0x7f925806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:06.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.406+0000 7f9278856640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f925806aec0 0x7f925806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:06.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.407+0000 7f9278856640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f925806aec0 0x7f925806d380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f927414f1a0 tx=0x7f9264009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.632+0000 7f9269ffb640 1 -- 172.21.15.151:0/1146495285 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f927007a9c0 con 0x7f9274070790 2023-10-18T11:10:06.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.643+0000 7f9269ffb640 1 -- 172.21.15.151:0/1146495285 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9270076d00 con 0x7f9274070790 2023-10-18T11:10:06.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.851+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92740c6900 con 0x7f9274070790 2023-10-18T11:10:06.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.857+0000 7f9269ffb640 1 -- 172.21.15.151:0/1146495285 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f927007a320 con 0x7f9274070790 2023-10-18T11:10:06.859 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:10:06.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f925806aec0 msgr2=0x7f925806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:06.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f925806aec0 0x7f925806d380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f927414f1a0 tx=0x7f9264009040 comp rx=0 tx=0).stop 2023-10-18T11:10:06.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9274070790 msgr2=0x7f92741f20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:06.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9274070790 0x7f92741f20c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9270000c00 tx=0x7f92700046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 shutdown_connections 2023-10-18T11:10:06.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f927414fe20 0x7f927414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f925806aec0 0x7f925806d380 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9274070ee0 0x7f9274159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 --2- 172.21.15.151:0/1146495285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9274070790 0x7f92741f20c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:06.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 >> 172.21.15.151:0/1146495285 conn(0x7f9274069f70 msgr2=0x7f9274072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:06.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 shutdown_connections 2023-10-18T11:10:06.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:06.860+0000 7f927b2bb640 1 -- 172.21.15.151:0/1146495285 wait complete. 2023-10-18T11:10:06.883 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T11:10:07.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.097+0000 7f7792c7c640 1 Processor -- start 2023-10-18T11:10:07.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.097+0000 7f7792c7c640 1 -- start start 2023-10-18T11:10:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.099+0000 7f7792c7c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f778c14fe20 0x7f778c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.099+0000 7f7792c7c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c070ee0 0x7f778c0718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.099+0000 7f7792c7c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778c0c18e0 con 0x7f778c070790 2023-10-18T11:10:07.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.099+0000 7f7792c7c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c0c5350 con 0x7f778c14fe20 2023-10-18T11:10:07.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.099+0000 7f7792c7c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0c20f0 con 0x7f778c070ee0 2023-10-18T11:10:07.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.099+0000 7f7791219640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c070ee0 0x7f778c0718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.099+0000 7f7790a18640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f778c14fe20 0x7f778c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.100+0000 7f778bfff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f778c070790 0x7f778c0c57e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:37754/0 (socket says 172.21.15.151:37754) 2023-10-18T11:10:07.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.100+0000 7f778bfff640 1 -- 172.21.15.151:0/1959662527 learned_addr learned my addr 172.21.15.151:0/1959662527 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.103+0000 7f7790a18640 1 -- 172.21.15.151:0/1959662527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c070ee0 msgr2=0x7f778c0718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.103+0000 7f7790a18640 1 --2- 172.21.15.151:0/1959662527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c070ee0 0x7f778c0718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.103+0000 7f7790a18640 1 -- 172.21.15.151:0/1959662527 >> v1:172.21.15.169:6789/0 conn(0x7f778c070790 legacy=0x7f778c0c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.103+0000 7f7790a18640 1 -- 172.21.15.151:0/1959662527 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c0c1b30 con 0x7f778c14fe20 2023-10-18T11:10:07.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.107+0000 7f7790a18640 1 --2- 172.21.15.151:0/1959662527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c14fe20 0x7f778c1566f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77800097a0 tx=0x7f778002dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4adbf4e231e5c2b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:07.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.112+0000 7f778b7fe640 1 -- 172.21.15.151:0/1959662527 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778002f8a0 con 0x7f778c14fe20 2023-10-18T11:10:07.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.112+0000 7f778b7fe640 1 -- 172.21.15.151:0/1959662527 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778002fa00 con 0x7f778c14fe20 2023-10-18T11:10:07.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.112+0000 7f778b7fe640 1 -- 172.21.15.151:0/1959662527 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778002fd90 con 0x7f778c14fe20 2023-10-18T11:10:07.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.112+0000 7f7792c7c640 1 -- 172.21.15.151:0/1959662527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c14fe20 msgr2=0x7f778c1566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.112+0000 7f7792c7c640 1 --2- 172.21.15.151:0/1959662527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c14fe20 0x7f778c1566f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77800097a0 tx=0x7f778002dae0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.112+0000 7f7792c7c640 1 -- 172.21.15.151:0/1959662527 shutdown_connections 2023-10-18T11:10:07.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.112+0000 7f7792c7c640 1 --2- 172.21.15.151:0/1959662527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c070ee0 0x7f778c0718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.112+0000 7f7792c7c640 1 --2- 172.21.15.151:0/1959662527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c14fe20 0x7f778c1566f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.112+0000 7f7792c7c640 1 -- 172.21.15.151:0/1959662527 >> 172.21.15.151:0/1959662527 conn(0x7f778c069f70 msgr2=0x7f778c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:07.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.113+0000 7f7792c7c640 1 -- 172.21.15.151:0/1959662527 shutdown_connections 2023-10-18T11:10:07.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.113+0000 7f7792c7c640 1 -- 172.21.15.151:0/1959662527 wait complete. 2023-10-18T11:10:07.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.115+0000 7f7792c7c640 1 Processor -- start 2023-10-18T11:10:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.116+0000 7f7792c7c640 1 -- start start 2023-10-18T11:10:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.117+0000 7f7792c7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f778c070790 0x7f778c159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.117+0000 7f7792c7c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c070ee0 0x7f778c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.117+0000 7f7792c7c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c14fe20 0x7f778c158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.117+0000 7f7792c7c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0c9c00 con 0x7f778c070790 2023-10-18T11:10:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.117+0000 7f7792c7c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1eeac0 con 0x7f778c070ee0 2023-10-18T11:10:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.117+0000 7f7792c7c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1eed60 con 0x7f778c14fe20 2023-10-18T11:10:07.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.118+0000 7f778bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c070ee0 0x7f778c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.118+0000 7f7790a18640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f778c070790 0x7f778c159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.118+0000 7f7791219640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c14fe20 0x7f778c158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.118+0000 7f778bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c070ee0 0x7f778c0c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:55616/0 (socket says 172.21.15.151:55616) 2023-10-18T11:10:07.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.118+0000 7f778bfff640 1 -- 172.21.15.151:0/3427721828 learned_addr learned my addr 172.21.15.151:0/3427721828 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:07.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.121+0000 7f7791219640 1 -- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c070ee0 msgr2=0x7f778c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.121+0000 7f7791219640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c070ee0 0x7f778c0c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.121+0000 7f7791219640 1 -- 172.21.15.151:0/3427721828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f778c070790 msgr2=0x7f778c159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.121+0000 7f7791219640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f778c070790 0x7f778c159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.122+0000 7f7791219640 1 -- 172.21.15.151:0/3427721828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780009400 con 0x7f778c14fe20 2023-10-18T11:10:07.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.122+0000 7f778bfff640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c070ee0 0x7f778c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:07.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.124+0000 7f7791219640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c14fe20 0x7f778c158100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f778400eba0 tx=0x7f778400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:07.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.127+0000 7f77897fa640 1 -- 172.21.15.151:0/3427721828 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400cd20 con 0x7f778c14fe20 2023-10-18T11:10:07.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.128+0000 7f77897fa640 1 -- 172.21.15.151:0/3427721828 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778400f040 con 0x7f778c14fe20 2023-10-18T11:10:07.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.128+0000 7f77897fa640 1 -- 172.21.15.151:0/3427721828 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77840146c0 con 0x7f778c14fe20 2023-10-18T11:10:07.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.128+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c1ef020 con 0x7f778c14fe20 2023-10-18T11:10:07.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.128+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c1ef5e0 con 0x7f778c14fe20 2023-10-18T11:10:07.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.129+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c04e160 con 0x7f778c14fe20 2023-10-18T11:10:07.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.149+0000 7f77897fa640 1 -- 172.21.15.151:0/3427721828 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7784014820 con 0x7f778c14fe20 2023-10-18T11:10:07.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.151+0000 7f77897fa640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f777006aec0 0x7f777006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.151+0000 7f77897fa640 1 -- 172.21.15.151:0/3427721828 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f778408aa30 con 0x7f778c14fe20 2023-10-18T11:10:07.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.151+0000 7f7790a18640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f777006aec0 0x7f777006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.152+0000 7f7790a18640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f777006aec0 0x7f777006d380 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7780038000 tx=0x7f778003b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:07.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.384+0000 7f77897fa640 1 -- 172.21.15.151:0/3427721828 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7784055980 con 0x7f778c14fe20 2023-10-18T11:10:07.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.583+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f778c0c9d40 con 0x7f778c14fe20 2023-10-18T11:10:07.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.589+0000 7f77897fa640 1 -- 172.21.15.151:0/3427721828 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7784088e60 con 0x7f778c14fe20 2023-10-18T11:10:07.591 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-10-18T11:10:07.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.591+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f777006aec0 msgr2=0x7f777006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.591+0000 7f7792c7c640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f777006aec0 0x7f777006d380 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7780038000 tx=0x7f778003b040 comp rx=0 tx=0).stop 2023-10-18T11:10:07.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.591+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c14fe20 msgr2=0x7f778c158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.591+0000 7f7792c7c640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c14fe20 0x7f778c158100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f778400eba0 tx=0x7f778400c490 comp rx=0 tx=0).stop 2023-10-18T11:10:07.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.592+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 shutdown_connections 2023-10-18T11:10:07.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.592+0000 7f7792c7c640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f778c14fe20 0x7f778c158100 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.592+0000 7f7792c7c640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f777006aec0 0x7f777006d380 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.592+0000 7f7792c7c640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f778c070ee0 0x7f778c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.592+0000 7f7792c7c640 1 --2- 172.21.15.151:0/3427721828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f778c070790 0x7f778c159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.592+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 >> 172.21.15.151:0/3427721828 conn(0x7f778c069f70 msgr2=0x7f778c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:07.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.592+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 shutdown_connections 2023-10-18T11:10:07.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.592+0000 7f7792c7c640 1 -- 172.21.15.151:0/3427721828 wait complete. 2023-10-18T11:10:07.613 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T11:10:07.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.839+0000 7ff7f084f640 1 Processor -- start 2023-10-18T11:10:07.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.839+0000 7ff7f084f640 1 -- start start 2023-10-18T11:10:07.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.841+0000 7ff7f084f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff7ec1532a0 0x7ff7ec0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.841+0000 7ff7f084f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ec0c5ae0 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.841+0000 7ff7f084f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ec0c54a0 con 0x7ff7ec15c5d0 2023-10-18T11:10:07.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.841+0000 7ff7f084f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ec0c5780 con 0x7ff7ec1532a0 2023-10-18T11:10:07.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.841+0000 7ff7ea59c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff7ec1532a0 0x7ff7ec0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.842+0000 7ff7e9d9b640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff7ec0c5f10 0x7ff7ec06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:58286/0 (socket says 172.21.15.151:58286) 2023-10-18T11:10:07.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.842+0000 7ff7e9d9b640 1 -- 172.21.15.151:0/4153768838 learned_addr learned my addr 172.21.15.151:0/4153768838 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:07.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.845+0000 7ff7ea59c640 1 -- 172.21.15.151:0/4153768838 >> v1:172.21.15.169:6789/0 conn(0x7ff7ec15c5d0 legacy=0x7ff7ec15ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.845+0000 7ff7ea59c640 1 -- 172.21.15.151:0/4153768838 >> v1:172.21.15.151:6789/0 conn(0x7ff7ec0c5f10 legacy=0x7ff7ec06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.845+0000 7ff7ea59c640 1 -- 172.21.15.151:0/4153768838 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec070810 con 0x7ff7ec1532a0 2023-10-18T11:10:07.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.848+0000 7ff7ea59c640 1 --2- 172.21.15.151:0/4153768838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 0x7ff7ec0715d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0097a0 tx=0x7ff7dc02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=338784333dd3498b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.852+0000 7ff7e959a640 1 -- 172.21.15.151:0/4153768838 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc02f810 con 0x7ff7ec1532a0 2023-10-18T11:10:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.852+0000 7ff7e959a640 1 -- 172.21.15.151:0/4153768838 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc02f970 con 0x7ff7ec1532a0 2023-10-18T11:10:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.852+0000 7ff7e959a640 1 -- 172.21.15.151:0/4153768838 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc02fd00 con 0x7ff7ec1532a0 2023-10-18T11:10:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.852+0000 7ff7f084f640 1 -- 172.21.15.151:0/4153768838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 msgr2=0x7ff7ec0715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.852+0000 7ff7f084f640 1 --2- 172.21.15.151:0/4153768838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 0x7ff7ec0715d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0097a0 tx=0x7ff7dc02b9f0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.853+0000 7ff7f084f640 1 -- 172.21.15.151:0/4153768838 shutdown_connections 2023-10-18T11:10:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.853+0000 7ff7f084f640 1 --2- 172.21.15.151:0/4153768838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 0x7ff7ec0715d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.853+0000 7ff7f084f640 1 -- 172.21.15.151:0/4153768838 >> 172.21.15.151:0/4153768838 conn(0x7ff7ec069f70 msgr2=0x7ff7ec06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.853+0000 7ff7f084f640 1 -- 172.21.15.151:0/4153768838 shutdown_connections 2023-10-18T11:10:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.853+0000 7ff7f084f640 1 -- 172.21.15.151:0/4153768838 wait complete. 2023-10-18T11:10:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.854+0000 7ff7f084f640 1 Processor -- start 2023-10-18T11:10:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.855+0000 7ff7f084f640 1 -- start start 2023-10-18T11:10:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.855+0000 7ff7f084f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7ec0c5f10 0x7ff7ec156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7f084f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 0x7ff7ec14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7f084f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec15c5d0 0x7ff7ec153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7f084f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec148380 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7f084f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec14e0d0 con 0x7ff7ec1532a0 2023-10-18T11:10:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7f084f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec14e3b0 con 0x7ff7ec15c5d0 2023-10-18T11:10:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7e9d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 0x7ff7ec14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7ea59c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7ec0c5f10 0x7ff7ec156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7ead9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec15c5d0 0x7ff7ec153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7e9d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 0x7ff7ec14d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:57604/0 (socket says 172.21.15.151:57604) 2023-10-18T11:10:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.856+0000 7ff7e9d9b640 1 -- 172.21.15.151:0/3922591367 learned_addr learned my addr 172.21.15.151:0/3922591367 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.861+0000 7ff7ea59c640 1 -- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec15c5d0 msgr2=0x7ff7ec153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.861+0000 7ff7ea59c640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec15c5d0 0x7ff7ec153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.861+0000 7ff7ea59c640 1 -- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 msgr2=0x7ff7ec14d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.861+0000 7ff7ea59c640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 0x7ff7ec14d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.861+0000 7ff7ea59c640 1 -- 172.21.15.151:0/3922591367 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc009400 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.863+0000 7ff7ea59c640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7ec0c5f10 0x7ff7ec156170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc033000 tx=0x7ff7dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.868+0000 7ff7e2ffd640 1 -- 172.21.15.151:0/3922591367 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc03b040 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.868+0000 7ff7e2ffd640 1 -- 172.21.15.151:0/3922591367 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc037a70 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.868+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ec14e690 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.868+0000 7ff7e2ffd640 1 -- 172.21.15.151:0/3922591367 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc037e20 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.868+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ec14ec50 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.869+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ec153930 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.893+0000 7ff7e2ffd640 1 -- 172.21.15.151:0/3922591367 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff7dc0413e0 con 0x7ff7ec0c5f10 2023-10-18T11:10:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.896+0000 7ff7e2ffd640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff7cc06aef0 0x7ff7cc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.896+0000 7ff7e9d9b640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff7cc06aef0 0x7ff7cc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:07.897+0000 7ff7e9d9b640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff7cc06aef0 0x7ff7cc06d3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec070750 tx=0x7ff7d4009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:08.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.209+0000 7ff7e2ffd640 1 -- 172.21.15.151:0/3922591367 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7dc07abf0 con 0x7ff7ec0c5f10 2023-10-18T11:10:08.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.211+0000 7ff7e2ffd640 1 -- 172.21.15.151:0/3922591367 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7dc076f30 con 0x7ff7ec0c5f10 2023-10-18T11:10:08.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.407+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff7ec153930 con 0x7ff7ec0c5f10 2023-10-18T11:10:08.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.464+0000 7ff7e2ffd640 1 -- 172.21.15.151:0/3922591367 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff7ec153930 con 0x7ff7ec0c5f10 2023-10-18T11:10:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:10:08.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.466+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff7cc06aef0 msgr2=0x7ff7cc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:08.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff7cc06aef0 0x7ff7cc06d3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec070750 tx=0x7ff7d4009040 comp rx=0 tx=0).stop 2023-10-18T11:10:08.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7ec0c5f10 msgr2=0x7ff7ec156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:08.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7ec0c5f10 0x7ff7ec156170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc033000 tx=0x7ff7dc0046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:08.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 shutdown_connections 2023-10-18T11:10:08.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec15c5d0 0x7ff7ec153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:08.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff7cc06aef0 0x7ff7cc06d3b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec1532a0 0x7ff7ec14d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 --2- 172.21.15.151:0/3922591367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7ec0c5f10 0x7ff7ec156170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 >> 172.21.15.151:0/3922591367 conn(0x7ff7ec069f70 msgr2=0x7ff7ec06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 shutdown_connections 2023-10-18T11:10:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.467+0000 7ff7f084f640 1 -- 172.21.15.151:0/3922591367 wait complete. 2023-10-18T11:10:08.489 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T11:10:08.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.706+0000 7f481bcf2640 1 Processor -- start 2023-10-18T11:10:08.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.706+0000 7f481bcf2640 1 -- start start 2023-10-18T11:10:08.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.708+0000 7f481bcf2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f48140c9360 0x7f48140c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:08.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.708+0000 7f481bcf2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48140c9d30 con 0x7f4814156480 2023-10-18T11:10:08.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.708+0000 7f481bcf2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48141591a0 con 0x7f48140c8700 2023-10-18T11:10:08.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.708+0000 7f481bcf2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4814158fb0 con 0x7f48140c9360 2023-10-18T11:10:08.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.709+0000 7f481a28f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f48140c9360 0x7f48140c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:08.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.709+0000 7f481928d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f48140c8700 0x7f48140659d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:49922/0 (socket says 172.21.15.151:49922) 2023-10-18T11:10:08.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.709+0000 7f481928d640 1 -- 172.21.15.151:0/2016386899 learned_addr learned my addr 172.21.15.151:0/2016386899 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:08.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.713+0000 7f481a28f640 1 -- 172.21.15.151:0/2016386899 >> v1:172.21.15.169:6789/0 conn(0x7f48140c8700 legacy=0x7f48140659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:08.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.713+0000 7f481a28f640 1 -- 172.21.15.151:0/2016386899 >> v1:172.21.15.151:6789/0 conn(0x7f4814156480 legacy=0x7f48140ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:08.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.713+0000 7f481a28f640 1 -- 172.21.15.151:0/2016386899 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4814159440 con 0x7f48140c9360 2023-10-18T11:10:08.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.717+0000 7f481a28f640 1 --2- 172.21.15.151:0/2016386899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48140c9360 0x7f48140c97f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f480c009d90 tx=0x7f480c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b848262231a661 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:08.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.724+0000 7f4818a8c640 1 -- 172.21.15.151:0/2016386899 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c02cc60 con 0x7f48140c9360 2023-10-18T11:10:08.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.724+0000 7f4818a8c640 1 -- 172.21.15.151:0/2016386899 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c02cdc0 con 0x7f48140c9360 2023-10-18T11:10:08.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.724+0000 7f4818a8c640 1 -- 172.21.15.151:0/2016386899 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c034660 con 0x7f48140c9360 2023-10-18T11:10:08.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.724+0000 7f481bcf2640 1 -- 172.21.15.151:0/2016386899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48140c9360 msgr2=0x7f48140c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:08.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.724+0000 7f481bcf2640 1 --2- 172.21.15.151:0/2016386899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48140c9360 0x7f48140c97f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f480c009d90 tx=0x7f480c02beb0 comp rx=0 tx=0).stop 2023-10-18T11:10:08.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.725+0000 7f481bcf2640 1 -- 172.21.15.151:0/2016386899 shutdown_connections 2023-10-18T11:10:08.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.725+0000 7f481bcf2640 1 --2- 172.21.15.151:0/2016386899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48140c9360 0x7f48140c97f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:08.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.725+0000 7f481bcf2640 1 -- 172.21.15.151:0/2016386899 >> 172.21.15.151:0/2016386899 conn(0x7f481406e210 msgr2=0x7f481406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:08.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.725+0000 7f481bcf2640 1 -- 172.21.15.151:0/2016386899 shutdown_connections 2023-10-18T11:10:08.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.725+0000 7f481bcf2640 1 -- 172.21.15.151:0/2016386899 wait complete. 2023-10-18T11:10:08.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.727+0000 7f481bcf2640 1 Processor -- start 2023-10-18T11:10:08.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.727+0000 7f481bcf2640 1 -- start start 2023-10-18T11:10:08.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.728+0000 7f481bcf2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48140c8700 0x7f48141f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:08.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.728+0000 7f481bcf2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48140c9360 0x7f481406b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:08.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.728+0000 7f481bcf2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4814156480 0x7f481415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:08.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.728+0000 7f481bcf2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48141f2a40 con 0x7f48140c8700 2023-10-18T11:10:08.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.728+0000 7f481bcf2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140adbe0 con 0x7f4814156480 2023-10-18T11:10:08.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.728+0000 7f481bcf2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481415d020 con 0x7f48140c9360 2023-10-18T11:10:08.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.728+0000 7f481a28f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4814156480 0x7f481415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:08.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.728+0000 7f481928d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48140c9360 0x7f481406b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:08.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.729+0000 7f481a28f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4814156480 0x7f481415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:57620/0 (socket says 172.21.15.151:57620) 2023-10-18T11:10:08.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.729+0000 7f481a28f640 1 -- 172.21.15.151:0/4150410947 learned_addr learned my addr 172.21.15.151:0/4150410947 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:08.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.731+0000 7f4819a8e640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48140c8700 0x7f48141f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:08.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.733+0000 7f481928d640 1 -- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4814156480 msgr2=0x7f481415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:08.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.733+0000 7f481928d640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4814156480 0x7f481415ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:08.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.733+0000 7f481928d640 1 -- 172.21.15.151:0/4150410947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48140c8700 msgr2=0x7f48141f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:08.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.733+0000 7f481928d640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48140c8700 0x7f48141f2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:08.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.733+0000 7f481928d640 1 -- 172.21.15.151:0/4150410947 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c009a70 con 0x7f48140c9360 2023-10-18T11:10:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.736+0000 7f481928d640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48140c9360 0x7f481406b8d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f480400c440 tx=0x7f4804001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.740+0000 7f480a7fc640 1 -- 172.21.15.151:0/4150410947 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804005ce0 con 0x7f48140c9360 2023-10-18T11:10:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.740+0000 7f480a7fc640 1 -- 172.21.15.151:0/4150410947 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804005e40 con 0x7f48140c9360 2023-10-18T11:10:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.740+0000 7f480a7fc640 1 -- 172.21.15.151:0/4150410947 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040072d0 con 0x7f48140c9360 2023-10-18T11:10:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.740+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481415cd50 con 0x7f48140c9360 2023-10-18T11:10:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.740+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48140ad2b0 con 0x7f48140c9360 2023-10-18T11:10:08.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.742+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481404e160 con 0x7f48140c9360 2023-10-18T11:10:08.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.762+0000 7f480a7fc640 1 -- 172.21.15.151:0/4150410947 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f48040074f0 con 0x7f48140c9360 2023-10-18T11:10:08.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.762+0000 7f480a7fc640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47f806aec0 0x7f47f806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:08.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.763+0000 7f4819a8e640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47f806aec0 0x7f47f806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:08.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.763+0000 7f4819a8e640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47f806aec0 0x7f47f806d380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f481000a730 tx=0x7f4810008040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:08.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:08.764+0000 7f480a7fc640 1 -- 172.21.15.151:0/4150410947 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4804057dd0 con 0x7f48140c9360 2023-10-18T11:10:09.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.002+0000 7f480a7fc640 1 -- 172.21.15.151:0/4150410947 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4804054110 con 0x7f48140c9360 2023-10-18T11:10:09.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.227+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f48141599b0 con 0x7f48140c9360 2023-10-18T11:10:09.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.245+0000 7f480a7fc640 1 -- 172.21.15.151:0/4150410947 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4804017080 con 0x7f48140c9360 2023-10-18T11:10:09.248 INFO:teuthology.orchestra.run.smithi151.stderr:listed 0 entries 2023-10-18T11:10:09.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47f806aec0 msgr2=0x7f47f806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47f806aec0 0x7f47f806d380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f481000a730 tx=0x7f4810008040 comp rx=0 tx=0).stop 2023-10-18T11:10:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48140c9360 msgr2=0x7f481406b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48140c9360 0x7f481406b8d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f480400c440 tx=0x7f4804001e70 comp rx=0 tx=0).stop 2023-10-18T11:10:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 shutdown_connections 2023-10-18T11:10:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47f806aec0 0x7f47f806d380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4814156480 0x7f481415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48140c9360 0x7f481406b8d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 --2- 172.21.15.151:0/4150410947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48140c8700 0x7f48141f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 >> 172.21.15.151:0/4150410947 conn(0x7f481406e210 msgr2=0x7f4814151fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 shutdown_connections 2023-10-18T11:10:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:09.248+0000 7f481bcf2640 1 -- 172.21.15.151:0/4150410947 wait complete. 2023-10-18T11:10:09.270 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi151.front.sepia.ceph.com... 2023-10-18T11:10:09.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:09.270 DEBUG:teuthology.orchestra.run.smithi151:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-18T11:10:09.349 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi151.stderr:ceph-fuse[92524]: fuse finished with error 0 and tester_r 0 2023-10-18T11:10:09.352 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:10:15.454 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:10:15.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:15.455 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-18T11:10:15.528 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:10:15.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.746+0000 7f818dcda640 1 Processor -- start 2023-10-18T11:10:15.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.747+0000 7f818dcda640 1 -- start start 2023-10-18T11:10:15.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.748+0000 7f818dcda640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81881576b0 0x7f818815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:15.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.748+0000 7f818dcda640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f818806d760 0x7f818806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:15.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.748+0000 7f818dcda640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8188157a90 con 0x7f81880c6820 2023-10-18T11:10:15.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.748+0000 7f818dcda640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81880c5ab0 con 0x7f81881576b0 2023-10-18T11:10:15.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.748+0000 7f818dcda640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818815e2c0 con 0x7f818806d760 2023-10-18T11:10:15.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.749+0000 7f8187fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f818806d760 0x7f818806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:15.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.749+0000 7f81877fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81881576b0 0x7f818815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:15.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.749+0000 7f8187fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f818806d760 0x7f818806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:57632/0 (socket says 172.21.15.151:57632) 2023-10-18T11:10:15.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.749+0000 7f8187fff640 1 -- 172.21.15.151:0/1657092811 learned_addr learned my addr 172.21.15.151:0/1657092811 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:15.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.752+0000 7f81877fe640 1 -- 172.21.15.151:0/1657092811 >> v2:172.21.15.169:3300/0 conn(0x7f818806d760 msgr2=0x7f818806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:15.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.752+0000 7f81877fe640 1 --2- 172.21.15.151:0/1657092811 >> v2:172.21.15.169:3300/0 conn(0x7f818806d760 0x7f818806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:15.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.752+0000 7f81877fe640 1 -- 172.21.15.151:0/1657092811 >> v1:172.21.15.169:6789/0 conn(0x7f81880c6820 legacy=0x7f818806fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:15.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.752+0000 7f81877fe640 1 -- 172.21.15.151:0/1657092811 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8188161850 con 0x7f81881576b0 2023-10-18T11:10:15.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.754+0000 7f81877fe640 1 --2- 172.21.15.151:0/1657092811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 0x7f818815dd80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f818806c3b0 tx=0x7f817802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86f57f4ea3529e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:15.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.758+0000 7f8186ffd640 1 -- 172.21.15.151:0/1657092811 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178030610 con 0x7f81881576b0 2023-10-18T11:10:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.758+0000 7f8186ffd640 1 -- 172.21.15.151:0/1657092811 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8178030770 con 0x7f81881576b0 2023-10-18T11:10:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.758+0000 7f8186ffd640 1 -- 172.21.15.151:0/1657092811 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178030b00 con 0x7f81881576b0 2023-10-18T11:10:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.759+0000 7f818dcda640 1 -- 172.21.15.151:0/1657092811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 msgr2=0x7f818815dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.759+0000 7f818dcda640 1 --2- 172.21.15.151:0/1657092811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 0x7f818815dd80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f818806c3b0 tx=0x7f817802b960 comp rx=0 tx=0).stop 2023-10-18T11:10:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.759+0000 7f818dcda640 1 -- 172.21.15.151:0/1657092811 shutdown_connections 2023-10-18T11:10:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.759+0000 7f818dcda640 1 --2- 172.21.15.151:0/1657092811 >> v2:172.21.15.169:3300/0 conn(0x7f818806d760 0x7f818806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:15.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.759+0000 7f818dcda640 1 --2- 172.21.15.151:0/1657092811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 0x7f818815dd80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:15.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.759+0000 7f818dcda640 1 -- 172.21.15.151:0/1657092811 >> 172.21.15.151:0/1657092811 conn(0x7f81880c6f10 msgr2=0x7f81880c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:15.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.759+0000 7f818dcda640 1 -- 172.21.15.151:0/1657092811 shutdown_connections 2023-10-18T11:10:15.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.759+0000 7f818dcda640 1 -- 172.21.15.151:0/1657092811 wait complete. 2023-10-18T11:10:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.761+0000 7f818dcda640 1 Processor -- start 2023-10-18T11:10:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.761+0000 7f818dcda640 1 -- start start 2023-10-18T11:10:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.762+0000 7f818dcda640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f818806d760 0x7f8188152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.762+0000 7f818dcda640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81880c6820 0x7f8188160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.762+0000 7f818dcda640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 0x7f81880c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.762+0000 7f818dcda640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8188160200 con 0x7f81881576b0 2023-10-18T11:10:15.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.762+0000 7f818dcda640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818814aee0 con 0x7f81880c6820 2023-10-18T11:10:15.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.762+0000 7f818dcda640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81881f66e0 con 0x7f818806d760 2023-10-18T11:10:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.763+0000 7f8187fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 0x7f81880c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.763+0000 7f817ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81880c6820 0x7f8188160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.763+0000 7f81877fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f818806d760 0x7f8188152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.763+0000 7f8187fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 0x7f81880c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46838/0 (socket says 172.21.15.151:46838) 2023-10-18T11:10:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.763+0000 7f8187fff640 1 -- 172.21.15.151:0/3927954554 learned_addr learned my addr 172.21.15.151:0/3927954554 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.767+0000 7f817ffff640 1 -- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f818806d760 msgr2=0x7f8188152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.767+0000 7f817ffff640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f818806d760 0x7f8188152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.767+0000 7f817ffff640 1 -- 172.21.15.151:0/3927954554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 msgr2=0x7f81880c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.767+0000 7f817ffff640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 0x7f81880c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.767+0000 7f817ffff640 1 -- 172.21.15.151:0/3927954554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8178009400 con 0x7f81880c6820 2023-10-18T11:10:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.767+0000 7f8187fff640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 0x7f81880c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:15.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.770+0000 7f817ffff640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81880c6820 0x7f8188160470 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f817000c3c0 tx=0x7f817000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:15.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.773+0000 7f8184ff9640 1 -- 172.21.15.151:0/3927954554 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81700052d0 con 0x7f81880c6820 2023-10-18T11:10:15.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.773+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81880c28a0 con 0x7f81880c6820 2023-10-18T11:10:15.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.773+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818814b150 con 0x7f81880c6820 2023-10-18T11:10:15.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.773+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81880c5f80 con 0x7f81880c6820 2023-10-18T11:10:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.774+0000 7f8184ff9640 1 -- 172.21.15.151:0/3927954554 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8170005430 con 0x7f81880c6820 2023-10-18T11:10:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:15.774+0000 7f8184ff9640 1 -- 172.21.15.151:0/3927954554 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81700037f0 con 0x7f81880c6820 2023-10-18T11:10:16.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.030+0000 7f8184ff9640 1 -- 172.21.15.151:0/3927954554 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8170003950 con 0x7f81880c6820 2023-10-18T11:10:16.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.033+0000 7f8184ff9640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f816806ae70 0x7f816806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:16.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.033+0000 7f8184ff9640 1 -- 172.21.15.151:0/3927954554 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8170089540 con 0x7f81880c6820 2023-10-18T11:10:16.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.033+0000 7f81877fe640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f816806ae70 0x7f816806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:16.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.035+0000 7f81877fe640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f816806ae70 0x7f816806d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8178036000 tx=0x7f817803b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:16.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.044+0000 7f8184ff9640 1 -- 172.21.15.151:0/3927954554 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81700543c0 con 0x7f81880c6820 2023-10-18T11:10:16.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.250+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8188156c60 con 0x7f81880c6820 2023-10-18T11:10:16.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.295+0000 7f8184ff9640 1 -- 172.21.15.151:0/3927954554 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f817005ce60 con 0x7f81880c6820 2023-10-18T11:10:16.299 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:16.299 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:16.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f816806ae70 msgr2=0x7f816806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f816806ae70 0x7f816806d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8178036000 tx=0x7f817803b040 comp rx=0 tx=0).stop 2023-10-18T11:10:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81880c6820 msgr2=0x7f8188160470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81880c6820 0x7f8188160470 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f817000c3c0 tx=0x7f817000c880 comp rx=0 tx=0).stop 2023-10-18T11:10:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 shutdown_connections 2023-10-18T11:10:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81881576b0 0x7f81880c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f816806ae70 0x7f816806d330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81880c6820 0x7f8188160470 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 --2- 172.21.15.151:0/3927954554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f818806d760 0x7f8188152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 >> 172.21.15.151:0/3927954554 conn(0x7f81880c6f10 msgr2=0x7f81880c30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 shutdown_connections 2023-10-18T11:10:16.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.298+0000 7f818dcda640 1 -- 172.21.15.151:0/3927954554 wait complete. 2023-10-18T11:10:16.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:10:16.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.527+0000 7f4c607b0640 1 Processor -- start 2023-10-18T11:10:16.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.527+0000 7f4c607b0640 1 -- start start 2023-10-18T11:10:16.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.528+0000 7f4c607b0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c581595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:16.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.528+0000 7f4c607b0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c580c5740 con 0x7f4c580c67b0 2023-10-18T11:10:16.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.529+0000 7f4c607b0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c58150320 con 0x7f4c5814ff40 2023-10-18T11:10:16.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.529+0000 7f4c607b0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580c2d60 con 0x7f4c58159170 2023-10-18T11:10:16.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.529+0000 7f4c5e54c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f4c5814ff40 0x7f4c580c3900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:49932/0 (socket says 172.21.15.151:49932) 2023-10-18T11:10:16.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.529+0000 7f4c5e54c640 1 -- 172.21.15.151:0/265105718 learned_addr learned my addr 172.21.15.151:0/265105718 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:16.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.529+0000 7f4c5ed4d640 1 --2- 172.21.15.151:0/265105718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c581595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:16.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.532+0000 7f4c5d54a640 1 -- 172.21.15.151:0/265105718 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831692816 0 0) 0x7f4c58150320 con 0x7f4c5814ff40 2023-10-18T11:10:16.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.532+0000 7f4c5d54a640 1 -- 172.21.15.151:0/265105718 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c44005730 con 0x7f4c5814ff40 2023-10-18T11:10:16.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.532+0000 7f4c5ed4d640 1 -- 172.21.15.151:0/265105718 >> v1:172.21.15.169:6789/0 conn(0x7f4c5814ff40 legacy=0x7f4c580c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:16.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.532+0000 7f4c5ed4d640 1 -- 172.21.15.151:0/265105718 >> v1:172.21.15.151:6789/0 conn(0x7f4c580c67b0 legacy=0x7f4c5806d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:16.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.532+0000 7f4c5ed4d640 1 -- 172.21.15.151:0/265105718 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58159d00 con 0x7f4c58159170 2023-10-18T11:10:16.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.534+0000 7f4c5ed4d640 1 --2- 172.21.15.151:0/265105718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c581595a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009dc0 tx=0x7f4c5002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9257209f62e36e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.538+0000 7f4c5d54a640 1 -- 172.21.15.151:0/265105718 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5002cc40 con 0x7f4c58159170 2023-10-18T11:10:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.538+0000 7f4c5d54a640 1 -- 172.21.15.151:0/265105718 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5002cda0 con 0x7f4c58159170 2023-10-18T11:10:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.538+0000 7f4c5d54a640 1 -- 172.21.15.151:0/265105718 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50034660 con 0x7f4c58159170 2023-10-18T11:10:16.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.538+0000 7f4c607b0640 1 -- 172.21.15.151:0/265105718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 msgr2=0x7f4c581595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:16.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.538+0000 7f4c607b0640 1 --2- 172.21.15.151:0/265105718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c581595a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009dc0 tx=0x7f4c5002be90 comp rx=0 tx=0).stop 2023-10-18T11:10:16.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.538+0000 7f4c607b0640 1 -- 172.21.15.151:0/265105718 shutdown_connections 2023-10-18T11:10:16.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.538+0000 7f4c607b0640 1 --2- 172.21.15.151:0/265105718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c581595a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:16.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.538+0000 7f4c607b0640 1 -- 172.21.15.151:0/265105718 >> 172.21.15.151:0/265105718 conn(0x7f4c580c6f10 msgr2=0x7f4c580c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:16.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.538+0000 7f4c607b0640 1 -- 172.21.15.151:0/265105718 shutdown_connections 2023-10-18T11:10:16.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.539+0000 7f4c607b0640 1 -- 172.21.15.151:0/265105718 wait complete. 2023-10-18T11:10:16.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.540+0000 7f4c607b0640 1 Processor -- start 2023-10-18T11:10:16.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.540+0000 7f4c607b0640 1 -- start start 2023-10-18T11:10:16.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.541+0000 7f4c607b0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c580c67b0 0x7f4c5806d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.541+0000 7f4c607b0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c5814ff40 0x7f4c581ea480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.541+0000 7f4c607b0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c58149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.541+0000 7f4c607b0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581ed9f0 con 0x7f4c580c67b0 2023-10-18T11:10:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.541+0000 7f4c607b0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581ee290 con 0x7f4c5814ff40 2023-10-18T11:10:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.541+0000 7f4c607b0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581589a0 con 0x7f4c58159170 2023-10-18T11:10:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.542+0000 7f4c5dd4b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c5814ff40 0x7f4c581ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.542+0000 7f4c5ed4d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c58149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:16.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.542+0000 7f4c5dd4b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c5814ff40 0x7f4c581ea480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:57652/0 (socket says 172.21.15.151:57652) 2023-10-18T11:10:16.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.542+0000 7f4c5dd4b640 1 -- 172.21.15.151:0/2048538291 learned_addr learned my addr 172.21.15.151:0/2048538291 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.546+0000 7f4c5ed4d640 1 -- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c5814ff40 msgr2=0x7f4c581ea480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.546+0000 7f4c5ed4d640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c5814ff40 0x7f4c581ea480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.546+0000 7f4c5ed4d640 1 -- 172.21.15.151:0/2048538291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c580c67b0 msgr2=0x7f4c5806d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.546+0000 7f4c5ed4d640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c580c67b0 0x7f4c5806d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:16.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.546+0000 7f4c5ed4d640 1 -- 172.21.15.151:0/2048538291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c50009a70 con 0x7f4c58159170 2023-10-18T11:10:16.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.546+0000 7f4c5dd4b640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c5814ff40 0x7f4c581ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:16.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.548+0000 7f4c5ed4d640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c58149c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c50033000 tx=0x7f4c50004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:16.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.551+0000 7f4c4effd640 1 -- 172.21.15.151:0/2048538291 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5003e610 con 0x7f4c58159170 2023-10-18T11:10:16.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.551+0000 7f4c4effd640 1 -- 172.21.15.151:0/2048538291 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5003e770 con 0x7f4c58159170 2023-10-18T11:10:16.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.551+0000 7f4c4effd640 1 -- 172.21.15.151:0/2048538291 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5003eae0 con 0x7f4c58159170 2023-10-18T11:10:16.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.551+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c58158c80 con 0x7f4c58159170 2023-10-18T11:10:16.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.552+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c581edf20 con 0x7f4c58159170 2023-10-18T11:10:16.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.553+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c581ee0b0 con 0x7f4c58159170 2023-10-18T11:10:16.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.572+0000 7f4c4effd640 1 -- 172.21.15.151:0/2048538291 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c5003b050 con 0x7f4c58159170 2023-10-18T11:10:16.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.574+0000 7f4c4effd640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4c3c06aec0 0x7f4c3c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:16.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.574+0000 7f4c4effd640 1 -- 172.21.15.151:0/2048538291 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4c5007ae00 con 0x7f4c58159170 2023-10-18T11:10:16.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.574+0000 7f4c5e54c640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4c3c06aec0 0x7f4c3c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:16.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.575+0000 7f4c5e54c640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4c3c06aec0 0x7f4c3c06d380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c54001610 tx=0x7f4c54007930 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:16.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:16.809+0000 7f4c4effd640 1 -- 172.21.15.151:0/2048538291 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c50077140 con 0x7f4c58159170 2023-10-18T11:10:17.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.008+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c581ee3d0 con 0x7f4c58159170 2023-10-18T11:10:17.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.052+0000 7f4c4effd640 1 -- 172.21.15.151:0/2048538291 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f4c5004d090 con 0x7f4c58159170 2023-10-18T11:10:17.056 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:17.056 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:17.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4c3c06aec0 msgr2=0x7f4c3c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:17.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4c3c06aec0 0x7f4c3c06d380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c54001610 tx=0x7f4c54007930 comp rx=0 tx=0).stop 2023-10-18T11:10:17.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 msgr2=0x7f4c58149c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c58149c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c50033000 tx=0x7f4c50004a40 comp rx=0 tx=0).stop 2023-10-18T11:10:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 shutdown_connections 2023-10-18T11:10:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c58159170 0x7f4c58149c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4c3c06aec0 0x7f4c3c06d380 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:17.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c5814ff40 0x7f4c581ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:17.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 --2- 172.21.15.151:0/2048538291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c580c67b0 0x7f4c5806d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:17.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 >> 172.21.15.151:0/2048538291 conn(0x7f4c580c6f10 msgr2=0x7f4c580c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:17.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 shutdown_connections 2023-10-18T11:10:17.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.054+0000 7f4c607b0640 1 -- 172.21.15.151:0/2048538291 wait complete. 2023-10-18T11:10:17.077 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-18T11:10:17.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.286+0000 7f0470287640 1 Processor -- start 2023-10-18T11:10:17.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.286+0000 7f0470287640 1 -- start start 2023-10-18T11:10:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.288+0000 7f0470287640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f04681510a0 0x7f04680c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.288+0000 7f0470287640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0468157770 0x7f046806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.288+0000 7f0470287640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046806d430 con 0x7f046806de00 2023-10-18T11:10:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.288+0000 7f0470287640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0468151480 con 0x7f04681510a0 2023-10-18T11:10:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.288+0000 7f0470287640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04680c27d0 con 0x7f0468157770 2023-10-18T11:10:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.289+0000 7f046e023640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f04681510a0 0x7f04680c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.289+0000 7f046e023640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f04681510a0 0x7f04680c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46852/0 (socket says 172.21.15.151:46852) 2023-10-18T11:10:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.289+0000 7f046e023640 1 -- 172.21.15.151:0/307787920 learned_addr learned my addr 172.21.15.151:0/307787920 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:17.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.292+0000 7f046e023640 1 -- 172.21.15.151:0/307787920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0468157770 msgr2=0x7f046806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:17.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.292+0000 7f046e023640 1 --2- 172.21.15.151:0/307787920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0468157770 0x7f046806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:17.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.292+0000 7f046e023640 1 -- 172.21.15.151:0/307787920 >> v1:172.21.15.169:6789/0 conn(0x7f046806de00 legacy=0x7f04680c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:17.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.292+0000 7f046e023640 1 -- 172.21.15.151:0/307787920 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04680c2a90 con 0x7f04681510a0 2023-10-18T11:10:17.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.298+0000 7f046e023640 1 --2- 172.21.15.151:0/307787920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04681510a0 0x7f04680c2180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0464009870 tx=0x7f046402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ccc251d6a18da5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.304+0000 7f046d021640 1 -- 172.21.15.151:0/307787920 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464030840 con 0x7f04681510a0 2023-10-18T11:10:17.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.304+0000 7f046d021640 1 -- 172.21.15.151:0/307787920 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04640309a0 con 0x7f04681510a0 2023-10-18T11:10:17.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.304+0000 7f046d021640 1 -- 172.21.15.151:0/307787920 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464030d30 con 0x7f04681510a0 2023-10-18T11:10:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.305+0000 7f0470287640 1 -- 172.21.15.151:0/307787920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04681510a0 msgr2=0x7f04680c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.305+0000 7f0470287640 1 --2- 172.21.15.151:0/307787920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04681510a0 0x7f04680c2180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0464009870 tx=0x7f046402b980 comp rx=0 tx=0).stop 2023-10-18T11:10:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.305+0000 7f0470287640 1 -- 172.21.15.151:0/307787920 shutdown_connections 2023-10-18T11:10:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.305+0000 7f0470287640 1 --2- 172.21.15.151:0/307787920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0468157770 0x7f046806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:17.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.305+0000 7f0470287640 1 --2- 172.21.15.151:0/307787920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04681510a0 0x7f04680c2180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:17.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.305+0000 7f0470287640 1 -- 172.21.15.151:0/307787920 >> 172.21.15.151:0/307787920 conn(0x7f0468069f70 msgr2=0x7f046806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:17.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.305+0000 7f0470287640 1 -- 172.21.15.151:0/307787920 shutdown_connections 2023-10-18T11:10:17.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.306+0000 7f0470287640 1 -- 172.21.15.151:0/307787920 wait complete. 2023-10-18T11:10:17.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.307+0000 7f0470287640 1 Processor -- start 2023-10-18T11:10:17.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.307+0000 7f0470287640 1 -- start start 2023-10-18T11:10:17.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.308+0000 7f0470287640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f046806de00 0x7f0468156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:17.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.308+0000 7f0470287640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04681510a0 0x7f046814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:17.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.308+0000 7f0470287640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0468157770 0x7f0468144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:17.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.308+0000 7f0470287640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04681486f0 con 0x7f0468157770 2023-10-18T11:10:17.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.308+0000 7f0470287640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046814af60 con 0x7f04681510a0 2023-10-18T11:10:17.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.308+0000 7f0470287640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0468148070 con 0x7f046806de00 2023-10-18T11:10:17.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.309+0000 7f046e023640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f046806de00 0x7f0468156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:17.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.309+0000 7f046d822640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04681510a0 0x7f046814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:17.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.309+0000 7f046e824640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0468157770 0x7f0468144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:17.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.309+0000 7f046d822640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04681510a0 0x7f046814ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:57654/0 (socket says 172.21.15.151:57654) 2023-10-18T11:10:17.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.309+0000 7f046d822640 1 -- 172.21.15.151:0/4039125980 learned_addr learned my addr 172.21.15.151:0/4039125980 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:17.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.309+0000 7f046e023640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f046806de00 0x7f0468156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41216/0 (socket says 172.21.15.151:41216) 2023-10-18T11:10:17.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.313+0000 7f046d822640 1 -- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f046806de00 msgr2=0x7f0468156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:17.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.313+0000 7f046d822640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f046806de00 0x7f0468156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:17.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.313+0000 7f046d822640 1 -- 172.21.15.151:0/4039125980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0468157770 msgr2=0x7f0468144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:17.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.313+0000 7f046d822640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0468157770 0x7f0468144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:17.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.313+0000 7f046d822640 1 -- 172.21.15.151:0/4039125980 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04640094d0 con 0x7f04681510a0 2023-10-18T11:10:17.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.313+0000 7f046e023640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f046806de00 0x7f0468156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:17.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.315+0000 7f046d822640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04681510a0 0x7f046814ca60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f045800b410 tx=0x7f045800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:17.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.320+0000 7f045effd640 1 -- 172.21.15.151:0/4039125980 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0458011830 con 0x7f04681510a0 2023-10-18T11:10:17.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.320+0000 7f045effd640 1 -- 172.21.15.151:0/4039125980 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04580119b0 con 0x7f04681510a0 2023-10-18T11:10:17.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.320+0000 7f045effd640 1 -- 172.21.15.151:0/4039125980 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0458011d60 con 0x7f04681510a0 2023-10-18T11:10:17.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.320+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0468156680 con 0x7f04681510a0 2023-10-18T11:10:17.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.320+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0468070db0 con 0x7f04681510a0 2023-10-18T11:10:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.320+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046804e160 con 0x7f04681510a0 2023-10-18T11:10:17.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.341+0000 7f045effd640 1 -- 172.21.15.151:0/4039125980 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0458023430 con 0x7f04681510a0 2023-10-18T11:10:17.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.342+0000 7f045effd640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f044c06aef0 0x7f044c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:17.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.342+0000 7f046e023640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f044c06aef0 0x7f044c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:17.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.343+0000 7f046e023640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f044c06aef0 0x7f044c06d3b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0464036000 tx=0x7f0464008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:17.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.572+0000 7f045effd640 1 -- 172.21.15.151:0/4039125980 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0458058520 con 0x7f04681510a0 2023-10-18T11:10:17.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.585+0000 7f045effd640 1 -- 172.21.15.151:0/4039125980 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0458054860 con 0x7f04681510a0 2023-10-18T11:10:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:17.828+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f046806a760 con 0x7f04681510a0 2023-10-18T11:10:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.381+0000 7f045effd640 1 -- 172.21.15.151:0/4039125980 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0458015020 con 0x7f04681510a0 2023-10-18T11:10:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.384+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f044c06aef0 msgr2=0x7f044c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.384+0000 7f0470287640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f044c06aef0 0x7f044c06d3b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0464036000 tx=0x7f0464008030 comp rx=0 tx=0).stop 2023-10-18T11:10:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.384+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04681510a0 msgr2=0x7f046814ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:18.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.384+0000 7f0470287640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04681510a0 0x7f046814ca60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f045800b410 tx=0x7f045800b8d0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.384+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 shutdown_connections 2023-10-18T11:10:18.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.384+0000 7f0470287640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0468157770 0x7f0468144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.385+0000 7f0470287640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f044c06aef0 0x7f044c06d3b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.385+0000 7f0470287640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04681510a0 0x7f046814ca60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.385+0000 7f0470287640 1 --2- 172.21.15.151:0/4039125980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f046806de00 0x7f0468156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.385+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 >> 172.21.15.151:0/4039125980 conn(0x7f0468069f70 msgr2=0x7f0468147050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:18.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.385+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 shutdown_connections 2023-10-18T11:10:18.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.385+0000 7f0470287640 1 -- 172.21.15.151:0/4039125980 wait complete. 2023-10-18T11:10:18.410 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2023-10-18T11:10:18.410 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-18T11:10:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.628+0000 7f32cae4b640 1 Processor -- start 2023-10-18T11:10:18.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.628+0000 7f32cae4b640 1 -- start start 2023-10-18T11:10:18.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.630+0000 7f32cae4b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f32c414fe20 0x7f32c41566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:18.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.630+0000 7f32cae4b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f32c4070790 0x7f32c40c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:18.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.630+0000 7f32cae4b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c40718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.630+0000 7f32cae4b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c40c18e0 con 0x7f32c4070790 2023-10-18T11:10:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.630+0000 7f32cae4b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c40c5350 con 0x7f32c414fe20 2023-10-18T11:10:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.630+0000 7f32cae4b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40c20f0 con 0x7f32c4070ee0 2023-10-18T11:10:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.631+0000 7f32c93e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c40718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.631+0000 7f32c8be7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f32c414fe20 0x7f32c41566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.631+0000 7f32c93e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c40718e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:54726/0 (socket says 172.21.15.151:54726) 2023-10-18T11:10:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.631+0000 7f32c93e8640 1 -- 172.21.15.151:0/4050754145 learned_addr learned my addr 172.21.15.151:0/4050754145 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:18.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.633+0000 7f32c93e8640 1 -- 172.21.15.151:0/4050754145 >> v2:172.21.15.169:3300/0 conn(0x7f32c414fe20 msgr2=0x7f32c41566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:18.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.633+0000 7f32c93e8640 1 --2- 172.21.15.151:0/4050754145 >> v2:172.21.15.169:3300/0 conn(0x7f32c414fe20 0x7f32c41566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.633+0000 7f32c93e8640 1 -- 172.21.15.151:0/4050754145 >> v2:172.21.15.151:3300/0 conn(0x7f32c4070790 msgr2=0x7f32c40c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:18.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.633+0000 7f32c93e8640 1 --2- 172.21.15.151:0/4050754145 >> v2:172.21.15.151:3300/0 conn(0x7f32c4070790 0x7f32c40c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.633+0000 7f32c93e8640 1 -- 172.21.15.151:0/4050754145 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40c1b30 con 0x7f32c4070ee0 2023-10-18T11:10:18.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.635+0000 7f32c93e8640 1 --2- 172.21.15.151:0/4050754145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c40718e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32c40c7bf0 tx=0x7f32bc02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b892cefb7a5d51b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.639+0000 7f32bb7fe640 1 -- 172.21.15.151:0/4050754145 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc02ca80 con 0x7f32c4070ee0 2023-10-18T11:10:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.639+0000 7f32bb7fe640 1 -- 172.21.15.151:0/4050754145 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc02cbe0 con 0x7f32c4070ee0 2023-10-18T11:10:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.639+0000 7f32bb7fe640 1 -- 172.21.15.151:0/4050754145 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0343f0 con 0x7f32c4070ee0 2023-10-18T11:10:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.640+0000 7f32cae4b640 1 -- 172.21.15.151:0/4050754145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 msgr2=0x7f32c40718e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.640+0000 7f32cae4b640 1 --2- 172.21.15.151:0/4050754145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c40718e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32c40c7bf0 tx=0x7f32bc02bee0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.640+0000 7f32cae4b640 1 -- 172.21.15.151:0/4050754145 shutdown_connections 2023-10-18T11:10:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.640+0000 7f32cae4b640 1 --2- 172.21.15.151:0/4050754145 >> v2:172.21.15.151:3300/0 conn(0x7f32c4070790 0x7f32c40c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.640+0000 7f32cae4b640 1 --2- 172.21.15.151:0/4050754145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c40718e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.640+0000 7f32cae4b640 1 --2- 172.21.15.151:0/4050754145 >> v2:172.21.15.169:3300/0 conn(0x7f32c414fe20 0x7f32c41566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.640+0000 7f32cae4b640 1 -- 172.21.15.151:0/4050754145 >> 172.21.15.151:0/4050754145 conn(0x7f32c4069f70 msgr2=0x7f32c406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:18.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.640+0000 7f32cae4b640 1 -- 172.21.15.151:0/4050754145 shutdown_connections 2023-10-18T11:10:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.641+0000 7f32cae4b640 1 -- 172.21.15.151:0/4050754145 wait complete. 2023-10-18T11:10:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.642+0000 7f32cae4b640 1 Processor -- start 2023-10-18T11:10:18.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.642+0000 7f32cae4b640 1 -- start start 2023-10-18T11:10:18.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.643+0000 7f32cae4b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4070790 0x7f32c4143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:18.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.643+0000 7f32cae4b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c4142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:18.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.643+0000 7f32cae4b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32c414fe20 0x7f32c41433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:18.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.643+0000 7f32cae4b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40bf280 con 0x7f32c4070790 2023-10-18T11:10:18.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.643+0000 7f32cae4b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c41448c0 con 0x7f32c414fe20 2023-10-18T11:10:18.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.643+0000 7f32cae4b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c41ea8e0 con 0x7f32c4070ee0 2023-10-18T11:10:18.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.644+0000 7f32c8be7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4070790 0x7f32c4143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:18.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.644+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c4142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:18.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.644+0000 7f32c93e8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32c414fe20 0x7f32c41433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:18.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.644+0000 7f32c8be7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4070790 0x7f32c4143ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40188/0 (socket says 172.21.15.151:40188) 2023-10-18T11:10:18.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.644+0000 7f32c8be7640 1 -- 172.21.15.151:0/1762544555 learned_addr learned my addr 172.21.15.151:0/1762544555 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:18.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.647+0000 7f32bbfff640 1 -- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32c414fe20 msgr2=0x7f32c41433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:18.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.647+0000 7f32bbfff640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32c414fe20 0x7f32c41433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.648+0000 7f32bbfff640 1 -- 172.21.15.151:0/1762544555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4070790 msgr2=0x7f32c4143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:18.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.648+0000 7f32bbfff640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4070790 0x7f32c4143ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:18.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.648+0000 7f32bbfff640 1 -- 172.21.15.151:0/1762544555 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc009b30 con 0x7f32c4070ee0 2023-10-18T11:10:18.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.650+0000 7f32bbfff640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c4142e60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f32b400b440 tx=0x7f32b400b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.654+0000 7f32b97fa640 1 -- 172.21.15.151:0/1762544555 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4011830 con 0x7f32c4070ee0 2023-10-18T11:10:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.654+0000 7f32b97fa640 1 -- 172.21.15.151:0/1762544555 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b4011990 con 0x7f32c4070ee0 2023-10-18T11:10:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.654+0000 7f32b97fa640 1 -- 172.21.15.151:0/1762544555 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4011d40 con 0x7f32c4070ee0 2023-10-18T11:10:18.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.654+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c41eabc0 con 0x7f32c4070ee0 2023-10-18T11:10:18.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.654+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c4142940 con 0x7f32c4070ee0 2023-10-18T11:10:18.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.655+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c4142b60 con 0x7f32c4070ee0 2023-10-18T11:10:18.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.675+0000 7f32b97fa640 1 -- 172.21.15.151:0/1762544555 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32b40243d0 con 0x7f32c4070ee0 2023-10-18T11:10:18.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.676+0000 7f32b97fa640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f32b006aec0 0x7f32b006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:18.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.677+0000 7f32b97fa640 1 -- 172.21.15.151:0/1762544555 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32b408a040 con 0x7f32c4070ee0 2023-10-18T11:10:18.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.677+0000 7f32c8be7640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f32b006aec0 0x7f32b006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:18.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.678+0000 7f32c8be7640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f32b006aec0 0x7f32b006d380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009b60 tx=0x7f32c0009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:18.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:18.913+0000 7f32b97fa640 1 -- 172.21.15.151:0/1762544555 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32b4054e30 con 0x7f32c4070ee0 2023-10-18T11:10:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:19.162+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f32c404e160 con 0x7f32c4070ee0 2023-10-18T11:10:20.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.106+0000 7f32b97fa640 1 -- 172.21.15.151:0/1762544555 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f32b4058450 con 0x7f32c4070ee0 2023-10-18T11:10:20.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f32b006aec0 msgr2=0x7f32b006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:20.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f32b006aec0 0x7f32b006d380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009b60 tx=0x7f32c0009190 comp rx=0 tx=0).stop 2023-10-18T11:10:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 msgr2=0x7f32c4142e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c4142e60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f32b400b440 tx=0x7f32b400b900 comp rx=0 tx=0).stop 2023-10-18T11:10:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 shutdown_connections 2023-10-18T11:10:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f32b006aec0 0x7f32b006d380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32c414fe20 0x7f32c41433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f32c4070ee0 0x7f32c4142e60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 --2- 172.21.15.151:0/1762544555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4070790 0x7f32c4143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 >> 172.21.15.151:0/1762544555 conn(0x7f32c4069f70 msgr2=0x7f32c40c3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 shutdown_connections 2023-10-18T11:10:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.110+0000 7f32cae4b640 1 -- 172.21.15.151:0/1762544555 wait complete. 2023-10-18T11:10:20.135 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-18T11:10:20.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.324+0000 7fc9e592c640 1 Processor -- start 2023-10-18T11:10:20.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.324+0000 7fc9e592c640 1 -- start start 2023-10-18T11:10:20.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.325+0000 7fc9e592c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc9e006fcf0 0x7fc9e0155430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:20.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.325+0000 7fc9e592c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e00c5ed0 con 0x7fc9e006e4a0 2023-10-18T11:10:20.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.325+0000 7fc9e592c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e00c68f0 con 0x7fc9e014f580 2023-10-18T11:10:20.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.326+0000 7fc9e592c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e00c6360 con 0x7fc9e006fcf0 2023-10-18T11:10:20.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.326+0000 7fc9deffd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fc9e014f580 0x7fc9e0070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:38442/0 (socket says 172.21.15.151:38442) 2023-10-18T11:10:20.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.326+0000 7fc9deffd640 1 -- 172.21.15.151:0/62288137 learned_addr learned my addr 172.21.15.151:0/62288137 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:20.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.326+0000 7fc9df7fe640 1 --2- 172.21.15.151:0/62288137 >> v2:172.21.15.151:3300/0 conn(0x7fc9e006fcf0 0x7fc9e0155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:20.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.329+0000 7fc9de7fc640 1 -- 172.21.15.151:0/62288137 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763933204 0 0) 0x7fc9e00c68f0 con 0x7fc9e014f580 2023-10-18T11:10:20.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.329+0000 7fc9de7fc640 1 -- 172.21.15.151:0/62288137 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9cc003440 con 0x7fc9e014f580 2023-10-18T11:10:20.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.330+0000 7fc9df7fe640 1 -- 172.21.15.151:0/62288137 >> v1:172.21.15.169:6789/0 conn(0x7fc9e014f580 legacy=0x7fc9e0070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:20.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.330+0000 7fc9df7fe640 1 -- 172.21.15.151:0/62288137 >> v1:172.21.15.151:6789/0 conn(0x7fc9e006e4a0 legacy=0x7fc9e006d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:20.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.330+0000 7fc9df7fe640 1 -- 172.21.15.151:0/62288137 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00c4fe0 con 0x7fc9e006fcf0 2023-10-18T11:10:20.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.336+0000 7fc9df7fe640 1 --2- 172.21.15.151:0/62288137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e006fcf0 0x7fc9e0155430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009d90 tx=0x7fc9d802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a155104329ebaf0b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:20.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.344+0000 7fc9de7fc640 1 -- 172.21.15.151:0/62288137 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d802cd80 con 0x7fc9e006fcf0 2023-10-18T11:10:20.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.344+0000 7fc9de7fc640 1 -- 172.21.15.151:0/62288137 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d8034440 con 0x7fc9e006fcf0 2023-10-18T11:10:20.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.344+0000 7fc9de7fc640 1 -- 172.21.15.151:0/62288137 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80347d0 con 0x7fc9e006fcf0 2023-10-18T11:10:20.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.345+0000 7fc9e592c640 1 -- 172.21.15.151:0/62288137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e006fcf0 msgr2=0x7fc9e0155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:20.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.345+0000 7fc9e592c640 1 --2- 172.21.15.151:0/62288137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e006fcf0 0x7fc9e0155430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009d90 tx=0x7fc9d802bfd0 comp rx=0 tx=0).stop 2023-10-18T11:10:20.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.345+0000 7fc9e592c640 1 -- 172.21.15.151:0/62288137 shutdown_connections 2023-10-18T11:10:20.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.345+0000 7fc9e592c640 1 --2- 172.21.15.151:0/62288137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e006fcf0 0x7fc9e0155430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:20.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.345+0000 7fc9e592c640 1 -- 172.21.15.151:0/62288137 >> 172.21.15.151:0/62288137 conn(0x7fc9e0069f70 msgr2=0x7fc9e006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:20.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.345+0000 7fc9e592c640 1 -- 172.21.15.151:0/62288137 shutdown_connections 2023-10-18T11:10:20.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.345+0000 7fc9e592c640 1 -- 172.21.15.151:0/62288137 wait complete. 2023-10-18T11:10:20.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.348+0000 7fc9e592c640 1 Processor -- start 2023-10-18T11:10:20.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.349+0000 7fc9e592c640 1 -- start start 2023-10-18T11:10:20.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.350+0000 7fc9e592c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9e006e4a0 0x7fc9e0144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:20.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.350+0000 7fc9e592c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9e006fcf0 0x7fc9e0144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:20.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.350+0000 7fc9e592c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e014f580 0x7fc9e0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:20.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.350+0000 7fc9e592c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e01588c0 con 0x7fc9e014f580 2023-10-18T11:10:20.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.350+0000 7fc9e592c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00c83d0 con 0x7fc9e006e4a0 2023-10-18T11:10:20.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.350+0000 7fc9e592c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e0157fd0 con 0x7fc9e006fcf0 2023-10-18T11:10:20.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.351+0000 7fc9deffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9e006e4a0 0x7fc9e0144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:20.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.351+0000 7fc9d7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9e006fcf0 0x7fc9e0144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:20.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.351+0000 7fc9df7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e014f580 0x7fc9e0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:20.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.351+0000 7fc9deffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9e006e4a0 0x7fc9e0144440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36652/0 (socket says 172.21.15.151:36652) 2023-10-18T11:10:20.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.351+0000 7fc9deffd640 1 -- 172.21.15.151:0/2728936654 learned_addr learned my addr 172.21.15.151:0/2728936654 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.354+0000 7fc9deffd640 1 -- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9e006fcf0 msgr2=0x7fc9e0144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.354+0000 7fc9deffd640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9e006fcf0 0x7fc9e0144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.354+0000 7fc9deffd640 1 -- 172.21.15.151:0/2728936654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e014f580 msgr2=0x7fc9e0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.354+0000 7fc9deffd640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e014f580 0x7fc9e0158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:20.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.354+0000 7fc9deffd640 1 -- 172.21.15.151:0/2728936654 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8009a70 con 0x7fc9e006e4a0 2023-10-18T11:10:20.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.357+0000 7fc9deffd640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9e006e4a0 0x7fc9e0144440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000c410 tx=0x7fc9d000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:20.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.360+0000 7fc9dcff9640 1 -- 172.21.15.151:0/2728936654 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0005ce0 con 0x7fc9e006e4a0 2023-10-18T11:10:20.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.360+0000 7fc9dcff9640 1 -- 172.21.15.151:0/2728936654 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d0005e40 con 0x7fc9e006e4a0 2023-10-18T11:10:20.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.360+0000 7fc9dcff9640 1 -- 172.21.15.151:0/2728936654 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00072f0 con 0x7fc9e006e4a0 2023-10-18T11:10:20.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.360+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e00c8670 con 0x7fc9e006e4a0 2023-10-18T11:10:20.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.361+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e0158270 con 0x7fc9e006e4a0 2023-10-18T11:10:20.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.362+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e004e160 con 0x7fc9e006e4a0 2023-10-18T11:10:20.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.381+0000 7fc9dcff9640 1 -- 172.21.15.151:0/2728936654 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc9d0007450 con 0x7fc9e006e4a0 2023-10-18T11:10:20.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.382+0000 7fc9dcff9640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc9c006aef0 0x7fc9c006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:20.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.382+0000 7fc9d7fff640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc9c006aef0 0x7fc9c006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:20.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.383+0000 7fc9dcff9640 1 -- 172.21.15.151:0/2728936654 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc9d0013e70 con 0x7fc9e006e4a0 2023-10-18T11:10:20.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.383+0000 7fc9d7fff640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc9c006aef0 0x7fc9c006d3b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0070900 tx=0x7fc9c8009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:20.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.623+0000 7fc9dcff9640 1 -- 172.21.15.151:0/2728936654 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9d0054240 con 0x7fc9e006e4a0 2023-10-18T11:10:20.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:20.864+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc9e0160ba0 con 0x7fc9e006e4a0 2023-10-18T11:10:21.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.995+0000 7fc9dcff9640 1 -- 172.21.15.151:0/2728936654 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc9d0057860 con 0x7fc9e006e4a0 2023-10-18T11:10:22.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc9c006aef0 msgr2=0x7fc9c006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:22.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc9c006aef0 0x7fc9c006d3b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0070900 tx=0x7fc9c8009040 comp rx=0 tx=0).stop 2023-10-18T11:10:22.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9e006e4a0 msgr2=0x7fc9e0144440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:22.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9e006e4a0 0x7fc9e0144440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000c410 tx=0x7fc9d000c8d0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 shutdown_connections 2023-10-18T11:10:22.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9e014f580 0x7fc9e0158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9e006fcf0 0x7fc9e0144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc9c006aef0 0x7fc9c006d3b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 --2- 172.21.15.151:0/2728936654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9e006e4a0 0x7fc9e0144440 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 >> 172.21.15.151:0/2728936654 conn(0x7fc9e0069f70 msgr2=0x7fc9e0070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.998+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 shutdown_connections 2023-10-18T11:10:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:21.999+0000 7fc9e592c640 1 -- 172.21.15.151:0/2728936654 wait complete. 2023-10-18T11:10:22.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-18T11:10:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.227+0000 7f1636613640 1 Processor -- start 2023-10-18T11:10:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.227+0000 7f1636613640 1 -- start start 2023-10-18T11:10:22.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.229+0000 7f1636613640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16300c5a60 0x7f163006a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:22.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.229+0000 7f1636613640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16300c9dd0 con 0x7f163006ac60 2023-10-18T11:10:22.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.229+0000 7f1636613640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1630158f60 con 0x7f1630153170 2023-10-18T11:10:22.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.229+0000 7f1636613640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1630159b80 con 0x7f16300c5a60 2023-10-18T11:10:22.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.230+0000 7f1635611640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f1630153170 0x7f16300c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:38458/0 (socket says 172.21.15.151:38458) 2023-10-18T11:10:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.230+0000 7f1635611640 1 -- 172.21.15.151:0/126952682 learned_addr learned my addr 172.21.15.151:0/126952682 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.232+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195465157 0 0) 0x7f1630158f60 con 0x7f1630153170 2023-10-18T11:10:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.232+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f161c003520 con 0x7f1630153170 2023-10-18T11:10:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2430022160 0 0) 0x7f161c003520 con 0x7f1630153170 2023-10-18T11:10:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 >> v2:172.21.15.151:3300/0 conn(0x7f16300c5a60 msgr2=0x7f163006a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 --2- 172.21.15.151:0/126952682 >> v2:172.21.15.151:3300/0 conn(0x7f16300c5a60 0x7f163006a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 >> v1:172.21.15.151:6789/0 conn(0x7f163006ac60 legacy=0x7f16300cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16300c5fc0 con 0x7f1630153170 2023-10-18T11:10:22.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f162c001670 con 0x7f1630153170 2023-10-18T11:10:22.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 >> v1:172.21.15.169:6789/0 conn(0x7f1630153170 legacy=0x7f16300c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:22.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f161c0039c0 0x7f161c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:22.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f161c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:22.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f161c0052a0 0x7f161c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1630159b80 con 0x7f161c0052a0 2023-10-18T11:10:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c00c1e0 con 0x7f161c0039c0 2023-10-18T11:10:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c00c3a0 con 0x7f161c0047c0 2023-10-18T11:10:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.236+0000 7f1634e10640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f161c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.238+0000 7f1635611640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f161c0039c0 0x7f161c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.239+0000 7f1634e10640 1 -- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f161c0039c0 msgr2=0x7f161c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.239+0000 7f1634e10640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f161c0039c0 0x7f161c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.239+0000 7f1634e10640 1 -- 172.21.15.151:0/126952682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f161c0052a0 msgr2=0x7f161c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:22.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.239+0000 7f1634e10640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f161c0052a0 0x7f161c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.239+0000 7f1634e10640 1 -- 172.21.15.151:0/126952682 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c003520 con 0x7f161c0047c0 2023-10-18T11:10:22.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.239+0000 7f1635e12640 1 -- 172.21.15.151:0/126952682 reap_dead start 2023-10-18T11:10:22.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.241+0000 7f1634e10640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f161c004c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1620006fd0 tx=0x7f161c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5530ffa8b301506 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.245+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620032600 con 0x7f161c0047c0 2023-10-18T11:10:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.245+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162002e050 con 0x7f161c0047c0 2023-10-18T11:10:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.245+0000 7f1627fff640 1 -- 172.21.15.151:0/126952682 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16200329c0 con 0x7f161c0047c0 2023-10-18T11:10:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.246+0000 7f1636613640 1 -- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 msgr2=0x7f161c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:22.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.246+0000 7f1636613640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f161c004c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1620006fd0 tx=0x7f161c0057f0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.246+0000 7f1636613640 1 -- 172.21.15.151:0/126952682 shutdown_connections 2023-10-18T11:10:22.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.246+0000 7f1636613640 1 --2- 172.21.15.151:0/126952682 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f161c004c40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.246+0000 7f1636613640 1 -- 172.21.15.151:0/126952682 >> 172.21.15.151:0/126952682 conn(0x7f16300659d0 msgr2=0x7f1630065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:22.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.246+0000 7f1636613640 1 -- 172.21.15.151:0/126952682 shutdown_connections 2023-10-18T11:10:22.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.246+0000 7f1636613640 1 -- 172.21.15.151:0/126952682 wait complete. 2023-10-18T11:10:22.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.249+0000 7f1636613640 1 Processor -- start 2023-10-18T11:10:22.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.250+0000 7f1636613640 1 -- start start 2023-10-18T11:10:22.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.251+0000 7f1636613640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f1630150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:22.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.251+0000 7f1636613640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16300ca1d0 0x7f1630155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:22.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.251+0000 7f1636613640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16301ee7f0 0x7f1630157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:22.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.251+0000 7f1636613640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1630156930 con 0x7f16301ee7f0 2023-10-18T11:10:22.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.251+0000 7f1636613640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1630154ac0 con 0x7f16300ca1d0 2023-10-18T11:10:22.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.251+0000 7f1636613640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16301eece0 con 0x7f161c0047c0 2023-10-18T11:10:22.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.252+0000 7f1635611640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f1630150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:22.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.252+0000 7f1635e12640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16301ee7f0 0x7f1630157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:22.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.252+0000 7f1634e10640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16300ca1d0 0x7f1630155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:22.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.252+0000 7f1635611640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f1630150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:54754/0 (socket says 172.21.15.151:54754) 2023-10-18T11:10:22.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.252+0000 7f1635611640 1 -- 172.21.15.151:0/737732042 learned_addr learned my addr 172.21.15.151:0/737732042 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:22.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.257+0000 7f1635611640 1 -- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16300ca1d0 msgr2=0x7f1630155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:22.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.257+0000 7f1635611640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16300ca1d0 0x7f1630155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.257+0000 7f1635611640 1 -- 172.21.15.151:0/737732042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16301ee7f0 msgr2=0x7f1630157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:22.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.257+0000 7f1635611640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16301ee7f0 0x7f1630157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:22.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.257+0000 7f1635611640 1 -- 172.21.15.151:0/737732042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630156370 con 0x7f161c0047c0 2023-10-18T11:10:22.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.260+0000 7f1635611640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f1630150440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f162c00e8c0 tx=0x7f162c00ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:22.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.264+0000 7f1625ffb640 1 -- 172.21.15.151:0/737732042 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c00c8d0 con 0x7f161c0047c0 2023-10-18T11:10:22.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.264+0000 7f1625ffb640 1 -- 172.21.15.151:0/737732042 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c00ca50 con 0x7f161c0047c0 2023-10-18T11:10:22.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.264+0000 7f1625ffb640 1 -- 172.21.15.151:0/737732042 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c00ce00 con 0x7f161c0047c0 2023-10-18T11:10:22.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.264+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1630156650 con 0x7f161c0047c0 2023-10-18T11:10:22.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.264+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16301ef260 con 0x7f161c0047c0 2023-10-18T11:10:22.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.265+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16301ef3f0 con 0x7f161c0047c0 2023-10-18T11:10:22.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.285+0000 7f1625ffb640 1 -- 172.21.15.151:0/737732042 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f162c01d460 con 0x7f161c0047c0 2023-10-18T11:10:22.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.286+0000 7f1625ffb640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f161406aec0 0x7f161406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:22.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.286+0000 7f1625ffb640 1 -- 172.21.15.151:0/737732042 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f162c08a1a0 con 0x7f161c0047c0 2023-10-18T11:10:22.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.287+0000 7f1634e10640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f161406aec0 0x7f161406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:22.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.288+0000 7f1634e10640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f161406aec0 0x7f161406d380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1620034000 tx=0x7f1620008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.521+0000 7f1625ffb640 1 -- 172.21.15.151:0/737732042 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f162c054f90 con 0x7f161c0047c0 2023-10-18T11:10:22.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:22.772+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f1630154920 con 0x7f161c0047c0 2023-10-18T11:10:23.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.096+0000 7f1625ffb640 1 -- 172.21.15.151:0/737732042 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1630154920 con 0x7f161c0047c0 2023-10-18T11:10:23.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.100+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f161406aec0 msgr2=0x7f161406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:23.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.100+0000 7f1636613640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f161406aec0 0x7f161406d380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1620034000 tx=0x7f1620008030 comp rx=0 tx=0).stop 2023-10-18T11:10:23.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.100+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 msgr2=0x7f1630150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:23.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.100+0000 7f1636613640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f1630150440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f162c00e8c0 tx=0x7f162c00ed80 comp rx=0 tx=0).stop 2023-10-18T11:10:23.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.101+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 shutdown_connections 2023-10-18T11:10:23.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.101+0000 7f1636613640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16301ee7f0 0x7f1630157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.101+0000 7f1636613640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f161406aec0 0x7f161406d380 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.101+0000 7f1636613640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16300ca1d0 0x7f1630155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.101+0000 7f1636613640 1 --2- 172.21.15.151:0/737732042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f161c0047c0 0x7f1630150440 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.101+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 >> 172.21.15.151:0/737732042 conn(0x7f16300659d0 msgr2=0x7f16300c62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:23.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.101+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 shutdown_connections 2023-10-18T11:10:23.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.101+0000 7f1636613640 1 -- 172.21.15.151:0/737732042 wait complete. 2023-10-18T11:10:23.125 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-18T11:10:23.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:10:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.332+0000 7f5be8b9e640 1 Processor -- start 2023-10-18T11:10:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.332+0000 7f5be8b9e640 1 -- start start 2023-10-18T11:10:23.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.334+0000 7f5be8b9e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5be40c57a0 0x7f5be4157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:23.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.334+0000 7f5be8b9e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5be40c5080 0x7f5be415a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:23.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.334+0000 7f5be8b9e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be40c6820 con 0x7f5be4150ec0 2023-10-18T11:10:23.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.334+0000 7f5be8b9e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40c3b00 con 0x7f5be40c57a0 2023-10-18T11:10:23.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.334+0000 7f5be8b9e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40c6b00 con 0x7f5be40c5080 2023-10-18T11:10:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.335+0000 7f5be2d9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5be40c5080 0x7f5be415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.335+0000 7f5bdbfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5be40c57a0 0x7f5be4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.335+0000 7f5be2d9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5be40c5080 0x7f5be415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36674/0 (socket says 172.21.15.151:36674) 2023-10-18T11:10:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.335+0000 7f5be2d9d640 1 -- 172.21.15.151:0/3836077691 learned_addr learned my addr 172.21.15.151:0/3836077691 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:23.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.338+0000 7f5bdbfff640 1 -- 172.21.15.151:0/3836077691 >> v2:172.21.15.169:3300/0 conn(0x7f5be40c5080 msgr2=0x7f5be415a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:23.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.338+0000 7f5bdbfff640 1 --2- 172.21.15.151:0/3836077691 >> v2:172.21.15.169:3300/0 conn(0x7f5be40c5080 0x7f5be415a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.338+0000 7f5bdbfff640 1 -- 172.21.15.151:0/3836077691 >> v1:172.21.15.169:6789/0 conn(0x7f5be4150ec0 legacy=0x7f5be406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:23.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.338+0000 7f5bdbfff640 1 -- 172.21.15.151:0/3836077691 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40c1ab0 con 0x7f5be40c57a0 2023-10-18T11:10:23.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.338+0000 7f5be2d9d640 1 --2- 172.21.15.151:0/3836077691 >> v2:172.21.15.169:3300/0 conn(0x7f5be40c5080 0x7f5be415a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:23.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.341+0000 7f5bdbfff640 1 --2- 172.21.15.151:0/3836077691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5be40c57a0 0x7f5be4157790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5be40c4fc0 tx=0x7f5bcc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19a917a6f2386df server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:23.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.346+0000 7f5be1d9b640 1 -- 172.21.15.151:0/3836077691 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc031830 con 0x7f5be40c57a0 2023-10-18T11:10:23.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.346+0000 7f5be1d9b640 1 -- 172.21.15.151:0/3836077691 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc031990 con 0x7f5be40c57a0 2023-10-18T11:10:23.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.346+0000 7f5be1d9b640 1 -- 172.21.15.151:0/3836077691 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc031d20 con 0x7f5be40c57a0 2023-10-18T11:10:23.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.347+0000 7f5be8b9e640 1 -- 172.21.15.151:0/3836077691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5be40c57a0 msgr2=0x7f5be4157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:23.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.347+0000 7f5be8b9e640 1 --2- 172.21.15.151:0/3836077691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5be40c57a0 0x7f5be4157790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5be40c4fc0 tx=0x7f5bcc02b8d0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.347+0000 7f5be8b9e640 1 -- 172.21.15.151:0/3836077691 shutdown_connections 2023-10-18T11:10:23.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.347+0000 7f5be8b9e640 1 --2- 172.21.15.151:0/3836077691 >> v2:172.21.15.169:3300/0 conn(0x7f5be40c5080 0x7f5be415a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.347+0000 7f5be8b9e640 1 --2- 172.21.15.151:0/3836077691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5be40c57a0 0x7f5be4157790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.347+0000 7f5be8b9e640 1 -- 172.21.15.151:0/3836077691 >> 172.21.15.151:0/3836077691 conn(0x7f5be40c6f10 msgr2=0x7f5be40c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:23.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.347+0000 7f5be8b9e640 1 -- 172.21.15.151:0/3836077691 shutdown_connections 2023-10-18T11:10:23.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.347+0000 7f5be8b9e640 1 -- 172.21.15.151:0/3836077691 wait complete. 2023-10-18T11:10:23.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.349+0000 7f5be8b9e640 1 Processor -- start 2023-10-18T11:10:23.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.349+0000 7f5be8b9e640 1 -- start start 2023-10-18T11:10:23.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.350+0000 7f5be8b9e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5be40c5080 0x7f5be41e1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:23.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.350+0000 7f5be8b9e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5be40c57a0 0x7f5be4155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:23.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.350+0000 7f5be8b9e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5be4150ec0 0x7f5be4142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:23.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.350+0000 7f5be8b9e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4158850 con 0x7f5be40c57a0 2023-10-18T11:10:23.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.350+0000 7f5be8b9e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4158af0 con 0x7f5be40c5080 2023-10-18T11:10:23.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.350+0000 7f5be8b9e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4158db0 con 0x7f5be4150ec0 2023-10-18T11:10:23.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.350+0000 7f5be259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5be40c5080 0x7f5be41e1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:23.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.351+0000 7f5bdbfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5be40c57a0 0x7f5be4155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:23.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.351+0000 7f5be2d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5be4150ec0 0x7f5be4142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:23.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.351+0000 7f5be259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5be40c5080 0x7f5be41e1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36684/0 (socket says 172.21.15.151:36684) 2023-10-18T11:10:23.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.351+0000 7f5be259c640 1 -- 172.21.15.151:0/776477637 learned_addr learned my addr 172.21.15.151:0/776477637 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.354+0000 7f5be259c640 1 -- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5be4150ec0 msgr2=0x7f5be4142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.354+0000 7f5be259c640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5be4150ec0 0x7f5be4142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.354+0000 7f5be259c640 1 -- 172.21.15.151:0/776477637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5be40c57a0 msgr2=0x7f5be4155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:23.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.354+0000 7f5be259c640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5be40c57a0 0x7f5be4155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.354+0000 7f5be259c640 1 -- 172.21.15.151:0/776477637 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc009b30 con 0x7f5be40c5080 2023-10-18T11:10:23.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.356+0000 7f5be259c640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5be40c5080 0x7f5be41e1930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400c400 tx=0x7f5bd400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.360+0000 7f5bdaffd640 1 -- 172.21.15.151:0/776477637 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40052d0 con 0x7f5be40c5080 2023-10-18T11:10:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.360+0000 7f5bdaffd640 1 -- 172.21.15.151:0/776477637 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd4005430 con 0x7f5be40c5080 2023-10-18T11:10:23.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.360+0000 7f5bdaffd640 1 -- 172.21.15.151:0/776477637 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4003830 con 0x7f5be40c5080 2023-10-18T11:10:23.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.360+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc009400 con 0x7f5be40c5080 2023-10-18T11:10:23.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.360+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be41ece40 con 0x7f5be40c5080 2023-10-18T11:10:23.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.361+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be40c62c0 con 0x7f5be40c5080 2023-10-18T11:10:23.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.615+0000 7f5bdaffd640 1 -- 172.21.15.151:0/776477637 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5bd4003990 con 0x7f5be40c5080 2023-10-18T11:10:23.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.617+0000 7f5bdaffd640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5bc406aec0 0x7f5bc406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:23.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.617+0000 7f5bdaffd640 1 -- 172.21.15.151:0/776477637 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5bd40893b0 con 0x7f5be40c5080 2023-10-18T11:10:23.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.617+0000 7f5bdbfff640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5bc406aec0 0x7f5bc406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:23.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.618+0000 7f5bdbfff640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5bc406aec0 0x7f5bc406d380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc036000 tx=0x7f5bcc03c040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:23.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.626+0000 7f5bdaffd640 1 -- 172.21.15.151:0/776477637 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5bd4054130 con 0x7f5be40c5080 2023-10-18T11:10:23.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.865+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5be40c7490 con 0x7f5be40c5080 2023-10-18T11:10:23.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.879+0000 7f5bdaffd640 1 -- 172.21.15.151:0/776477637 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+6514 (secure 0 0 0) 0x7f5bd4057750 con 0x7f5be40c5080 2023-10-18T11:10:23.882 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:23.883 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2025487091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2025487091},{"type":"v1","addr":"172.21.15.169:6835","nonce":2025487091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/872383111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":872383111},{"type":"v1","addr":"172.21.15.169:6837","nonce":872383111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/520473080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":520473080},{"type":"v1","addr":"172.21.15.169:6839","nonce":520473080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2666139932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2666139932},{"type":"v1","addr":"172.21.15.151:6835","nonce":2666139932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T11:09:38.819021+0000","modified":"2023-10-18T11:10:22.794483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4294,"mds_1":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"c","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.151:6833/251484638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":251484638},{"type":"v1","addr":"172.21.15.151:6833","nonce":251484638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4294":{"gid":4294,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6837/909327926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":909327926},{"type":"v1","addr":"172.21.15.151:6837","nonce":909327926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T11:10:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 11 2023-10-18T11:10:23.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5bc406aec0 msgr2=0x7f5bc406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:23.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5bc406aec0 0x7f5bc406d380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc036000 tx=0x7f5bcc03c040 comp rx=0 tx=0).stop 2023-10-18T11:10:23.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5be40c5080 msgr2=0x7f5be41e1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:23.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5be40c5080 0x7f5be41e1930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400c400 tx=0x7f5bd400c8c0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 shutdown_connections 2023-10-18T11:10:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5be4150ec0 0x7f5be4142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5be40c57a0 0x7f5be4155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5bc406aec0 0x7f5bc406d380 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 --2- 172.21.15.151:0/776477637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5be40c5080 0x7f5be41e1930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:23.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.883+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 >> 172.21.15.151:0/776477637 conn(0x7f5be40c6f10 msgr2=0x7f5be40c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:23.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.884+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 shutdown_connections 2023-10-18T11:10:23.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:23.884+0000 7f5be8b9e640 1 -- 172.21.15.151:0/776477637 wait complete. 2023-10-18T11:10:23.904 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:10:24.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.115+0000 7fb36f3a7640 1 Processor -- start 2023-10-18T11:10:24.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.115+0000 7fb36f3a7640 1 -- start start 2023-10-18T11:10:24.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.116+0000 7fb36f3a7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3680c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.116+0000 7fb36f3a7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb36806faf0 0x7fb36815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.116+0000 7fb36f3a7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680c7470 con 0x7fb36806a620 2023-10-18T11:10:24.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.116+0000 7fb36f3a7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680c5670 con 0x7fb36806faf0 2023-10-18T11:10:24.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.116+0000 7fb36f3a7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680705f0 con 0x7fb36806a240 2023-10-18T11:10:24.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.132+0000 7fb36e3a5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3680c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.133+0000 7fb36e3a5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3680c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:54776/0 (socket says 172.21.15.151:54776) 2023-10-18T11:10:24.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.133+0000 7fb36e3a5640 1 -- 172.21.15.151:0/2049030312 learned_addr learned my addr 172.21.15.151:0/2049030312 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:24.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.135+0000 7fb36e3a5640 1 -- 172.21.15.151:0/2049030312 >> v2:172.21.15.169:3300/0 conn(0x7fb36806faf0 msgr2=0x7fb36815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:24.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.135+0000 7fb36e3a5640 1 --2- 172.21.15.151:0/2049030312 >> v2:172.21.15.169:3300/0 conn(0x7fb36806faf0 0x7fb36815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.135+0000 7fb36e3a5640 1 -- 172.21.15.151:0/2049030312 >> v1:172.21.15.169:6789/0 conn(0x7fb36806a620 legacy=0x7fb368150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:24.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.135+0000 7fb36e3a5640 1 -- 172.21.15.151:0/2049030312 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680c4dd0 con 0x7fb36806a240 2023-10-18T11:10:24.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.137+0000 7fb36e3a5640 1 --2- 172.21.15.151:0/2049030312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3680c7900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb364009870 tx=0x7fb36402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e8d7649d86cc271 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:24.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.141+0000 7fb36d3a3640 1 -- 172.21.15.151:0/2049030312 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364031640 con 0x7fb36806a240 2023-10-18T11:10:24.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.141+0000 7fb36d3a3640 1 -- 172.21.15.151:0/2049030312 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3640317a0 con 0x7fb36806a240 2023-10-18T11:10:24.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.141+0000 7fb36d3a3640 1 -- 172.21.15.151:0/2049030312 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364031b30 con 0x7fb36806a240 2023-10-18T11:10:24.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.142+0000 7fb36f3a7640 1 -- 172.21.15.151:0/2049030312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 msgr2=0x7fb3680c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.142+0000 7fb36f3a7640 1 --2- 172.21.15.151:0/2049030312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3680c7900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb364009870 tx=0x7fb36402b8f0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.142+0000 7fb36f3a7640 1 -- 172.21.15.151:0/2049030312 shutdown_connections 2023-10-18T11:10:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.142+0000 7fb36f3a7640 1 --2- 172.21.15.151:0/2049030312 >> v2:172.21.15.169:3300/0 conn(0x7fb36806faf0 0x7fb36815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.142+0000 7fb36f3a7640 1 --2- 172.21.15.151:0/2049030312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3680c7900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.142+0000 7fb36f3a7640 1 -- 172.21.15.151:0/2049030312 >> 172.21.15.151:0/2049030312 conn(0x7fb3680659d0 msgr2=0x7fb368065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.142+0000 7fb36f3a7640 1 -- 172.21.15.151:0/2049030312 shutdown_connections 2023-10-18T11:10:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.142+0000 7fb36f3a7640 1 -- 172.21.15.151:0/2049030312 wait complete. 2023-10-18T11:10:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.144+0000 7fb36f3a7640 1 Processor -- start 2023-10-18T11:10:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.144+0000 7fb36f3a7640 1 -- start start 2023-10-18T11:10:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.145+0000 7fb36f3a7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3681f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.145+0000 7fb36f3a7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb36806a620 0x7fb3681f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.145+0000 7fb36f3a7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb36806faf0 0x7fb3681f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.145+0000 7fb36f3a7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3681e1780 con 0x7fb36806faf0 2023-10-18T11:10:24.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.145+0000 7fb36f3a7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368159950 con 0x7fb36806a620 2023-10-18T11:10:24.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.145+0000 7fb36f3a7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36814ead0 con 0x7fb36806a240 2023-10-18T11:10:24.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.146+0000 7fb36dba4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb36806a620 0x7fb3681f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.146+0000 7fb36dba4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb36806a620 0x7fb3681f20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36706/0 (socket says 172.21.15.151:36706) 2023-10-18T11:10:24.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.146+0000 7fb36dba4640 1 -- 172.21.15.151:0/3906988938 learned_addr learned my addr 172.21.15.151:0/3906988938 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:24.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.146+0000 7fb36e3a5640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3681f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.149+0000 7fb36dba4640 1 -- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 msgr2=0x7fb3681f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.149+0000 7fb36dba4640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3681f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.149+0000 7fb36dba4640 1 -- 172.21.15.151:0/3906988938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb36806faf0 msgr2=0x7fb3681f0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.149+0000 7fb36dba4640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb36806faf0 0x7fb3681f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.149+0000 7fb36dba4640 1 -- 172.21.15.151:0/3906988938 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3640094d0 con 0x7fb36806a620 2023-10-18T11:10:24.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.152+0000 7fb36dba4640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb36806a620 0x7fb3681f20b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb35800b440 tx=0x7fb35800b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:24.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.155+0000 7fb35effd640 1 -- 172.21.15.151:0/3906988938 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358011890 con 0x7fb36806a620 2023-10-18T11:10:24.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.155+0000 7fb35effd640 1 -- 172.21.15.151:0/3906988938 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3580119f0 con 0x7fb36806a620 2023-10-18T11:10:24.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.155+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3681e2890 con 0x7fb36806a620 2023-10-18T11:10:24.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.155+0000 7fb35effd640 1 -- 172.21.15.151:0/3906988938 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358011da0 con 0x7fb36806a620 2023-10-18T11:10:24.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.155+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb368159670 con 0x7fb36806a620 2023-10-18T11:10:24.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.157+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36804e160 con 0x7fb36806a620 2023-10-18T11:10:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.415+0000 7fb35effd640 1 -- 172.21.15.151:0/3906988938 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb35801a400 con 0x7fb36806a620 2023-10-18T11:10:24.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.417+0000 7fb35effd640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb34c06aec0 0x7fb34c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.417+0000 7fb35effd640 1 -- 172.21.15.151:0/3906988938 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb35808a360 con 0x7fb36806a620 2023-10-18T11:10:24.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.418+0000 7fb36e3a5640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb34c06aec0 0x7fb34c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.419+0000 7fb36e3a5640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb34c06aec0 0x7fb34c06d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb364036000 tx=0x7fb36403c040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:24.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.427+0000 7fb35effd640 1 -- 172.21.15.151:0/3906988938 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb358054fa0 con 0x7fb36806a620 2023-10-18T11:10:24.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.626+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3680c6e50 con 0x7fb36806a620 2023-10-18T11:10:24.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.668+0000 7fb35effd640 1 -- 172.21.15.151:0/3906988938 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7fb358015090 con 0x7fb36806a620 2023-10-18T11:10:24.671 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:24.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb34c06aec0 msgr2=0x7fb34c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb34c06aec0 0x7fb34c06d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb364036000 tx=0x7fb36403c040 comp rx=0 tx=0).stop 2023-10-18T11:10:24.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb36806a620 msgr2=0x7fb3681f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb36806a620 0x7fb3681f20b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb35800b440 tx=0x7fb35800b900 comp rx=0 tx=0).stop 2023-10-18T11:10:24.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 shutdown_connections 2023-10-18T11:10:24.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb36806faf0 0x7fb3681f0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb34c06aec0 0x7fb34c06d380 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb36806a620 0x7fb3681f20b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 --2- 172.21.15.151:0/3906988938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb36806a240 0x7fb3681f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 >> 172.21.15.151:0/3906988938 conn(0x7fb3680659d0 msgr2=0x7fb3680ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:24.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.671+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 shutdown_connections 2023-10-18T11:10:24.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.672+0000 7fb36f3a7640 1 -- 172.21.15.151:0/3906988938 wait complete. 2023-10-18T11:10:24.692 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-18T11:10:24.693 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:10:24.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.901+0000 7f40d5bb0640 1 Processor -- start 2023-10-18T11:10:24.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.901+0000 7f40d5bb0640 1 -- start start 2023-10-18T11:10:24.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.903+0000 7f40d5bb0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40d00c57a0 0x7f40d0157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.903+0000 7f40d5bb0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d00c6820 con 0x7f40d00c5080 2023-10-18T11:10:24.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.903+0000 7f40d5bb0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d00c6b00 con 0x7f40d0150ec0 2023-10-18T11:10:24.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.903+0000 7f40d5bb0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d00c3b00 con 0x7f40d00c57a0 2023-10-18T11:10:24.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.904+0000 7f40cf7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f40d0150ec0 0x7f40d006d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:38484/0 (socket says 172.21.15.151:38484) 2023-10-18T11:10:24.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.904+0000 7f40cf7fe640 1 -- 172.21.15.151:0/1308605303 learned_addr learned my addr 172.21.15.151:0/1308605303 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:24.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.904+0000 7f40c7fff640 1 --2- 172.21.15.151:0/1308605303 >> v2:172.21.15.151:3300/0 conn(0x7f40d00c57a0 0x7f40d0157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.906+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800627857 0 0) 0x7f40d00c6b00 con 0x7f40d0150ec0 2023-10-18T11:10:24.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.906+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40bc003520 con 0x7f40d0150ec0 2023-10-18T11:10:24.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.909+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766692979 0 0) 0x7f40bc003520 con 0x7f40d0150ec0 2023-10-18T11:10:24.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 >> v2:172.21.15.151:3300/0 conn(0x7f40d00c57a0 msgr2=0x7f40d0157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:24.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 --2- 172.21.15.151:0/1308605303 >> v2:172.21.15.151:3300/0 conn(0x7f40d00c57a0 0x7f40d0157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 >> v1:172.21.15.151:6789/0 conn(0x7f40d00c5080 legacy=0x7f40d015a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00c1ab0 con 0x7f40d0150ec0 2023-10-18T11:10:24.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f40c0001670 con 0x7f40d0150ec0 2023-10-18T11:10:24.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 >> v1:172.21.15.169:6789/0 conn(0x7f40d0150ec0 legacy=0x7f40d006d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40bc0039c0 0x7f40bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0047c0 0x7f40bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40bc005180 0x7f40bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc00c050 con 0x7f40bc005180 2023-10-18T11:10:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc00c1c0 con 0x7f40bc0047c0 2023-10-18T11:10:24.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc00c380 con 0x7f40bc0039c0 2023-10-18T11:10:24.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.910+0000 7f40cf7fe640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40bc0039c0 0x7f40bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.912+0000 7f40c7fff640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0047c0 0x7f40bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.914+0000 7f40cf7fe640 1 -- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0047c0 msgr2=0x7f40bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.914+0000 7f40cf7fe640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0047c0 0x7f40bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.914+0000 7f40cf7fe640 1 -- 172.21.15.151:0/1308605303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40bc005180 msgr2=0x7f40bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:24.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.914+0000 7f40cf7fe640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40bc005180 0x7f40bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.914+0000 7f40cf7fe640 1 -- 172.21.15.151:0/1308605303 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc003520 con 0x7f40bc0039c0 2023-10-18T11:10:24.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.914+0000 7f40cffff640 1 -- 172.21.15.151:0/1308605303 reap_dead start 2023-10-18T11:10:24.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.914+0000 7f40c7fff640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0047c0 0x7f40bc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T11:10:24.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.916+0000 7f40cf7fe640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40bc0039c0 0x7f40bc003de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c0e0 tx=0x7f40bc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7625232127ec5df server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.919+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0005ad0 con 0x7f40bc0039c0 2023-10-18T11:10:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.919+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0005c30 con 0x7f40bc0039c0 2023-10-18T11:10:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.920+0000 7f40ceffd640 1 -- 172.21.15.151:0/1308605303 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c002ca30 con 0x7f40bc0039c0 2023-10-18T11:10:24.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.920+0000 7f40d5bb0640 1 -- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40bc0039c0 msgr2=0x7f40bc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.920+0000 7f40d5bb0640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40bc0039c0 0x7f40bc003de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c0e0 tx=0x7f40bc0057f0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.920+0000 7f40d5bb0640 1 -- 172.21.15.151:0/1308605303 shutdown_connections 2023-10-18T11:10:24.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.920+0000 7f40d5bb0640 1 --2- 172.21.15.151:0/1308605303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40bc0039c0 0x7f40bc003de0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.920+0000 7f40d5bb0640 1 -- 172.21.15.151:0/1308605303 >> 172.21.15.151:0/1308605303 conn(0x7f40d00c6f10 msgr2=0x7f40d00c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:24.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.921+0000 7f40d5bb0640 1 -- 172.21.15.151:0/1308605303 shutdown_connections 2023-10-18T11:10:24.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.921+0000 7f40d5bb0640 1 -- 172.21.15.151:0/1308605303 wait complete. 2023-10-18T11:10:24.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.923+0000 7f40d5bb0640 1 Processor -- start 2023-10-18T11:10:24.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.923+0000 7f40d5bb0640 1 -- start start 2023-10-18T11:10:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.924+0000 7f40d5bb0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0039c0 0x7f40d01ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.924+0000 7f40d5bb0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40d01f2860 0x7f40d0149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.924+0000 7f40d5bb0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40d0159070 0x7f40d014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.924+0000 7f40d5bb0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d0070360 con 0x7f40d0159070 2023-10-18T11:10:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.924+0000 7f40d5bb0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006fde0 con 0x7f40bc0039c0 2023-10-18T11:10:24.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.924+0000 7f40d5bb0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d0070080 con 0x7f40d01f2860 2023-10-18T11:10:24.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.925+0000 7f40cf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0039c0 0x7f40d01ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.925+0000 7f40c7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40d01f2860 0x7f40d0149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.926+0000 7f40c7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40d01f2860 0x7f40d0149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:54802/0 (socket says 172.21.15.151:54802) 2023-10-18T11:10:24.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.926+0000 7f40cf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0039c0 0x7f40d01ee6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36718/0 (socket says 172.21.15.151:36718) 2023-10-18T11:10:24.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.926+0000 7f40c7fff640 1 -- 172.21.15.151:0/3959613586 learned_addr learned my addr 172.21.15.151:0/3959613586 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:24.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.926+0000 7f40cffff640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40d0159070 0x7f40d014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.929+0000 7f40c7fff640 1 -- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0039c0 msgr2=0x7f40d01ee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.929+0000 7f40c7fff640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0039c0 0x7f40d01ee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.929+0000 7f40c7fff640 1 -- 172.21.15.151:0/3959613586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40d0159070 msgr2=0x7f40d014f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.929+0000 7f40c7fff640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40d0159070 0x7f40d014f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.929+0000 7f40c7fff640 1 -- 172.21.15.151:0/3959613586 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d01f1d80 con 0x7f40d01f2860 2023-10-18T11:10:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.931+0000 7f40c7fff640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40d01f2860 0x7f40d0149fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f40b80114c0 tx=0x7f40b8011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.937+0000 7f40ccff9640 1 -- 172.21.15.151:0/3959613586 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8015870 con 0x7f40d01f2860 2023-10-18T11:10:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.937+0000 7f40ccff9640 1 -- 172.21.15.151:0/3959613586 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b80159d0 con 0x7f40d01f2860 2023-10-18T11:10:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.937+0000 7f40ccff9640 1 -- 172.21.15.151:0/3959613586 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8015da0 con 0x7f40d01f2860 2023-10-18T11:10:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.937+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d01f2060 con 0x7f40d01f2860 2023-10-18T11:10:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.937+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d01eec20 con 0x7f40d01f2860 2023-10-18T11:10:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.938+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d0157540 con 0x7f40d01f2860 2023-10-18T11:10:24.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.958+0000 7f40ccff9640 1 -- 172.21.15.151:0/3959613586 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40b801d400 con 0x7f40d01f2860 2023-10-18T11:10:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.959+0000 7f40ccff9640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40b006ae70 0x7f40b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.959+0000 7f40cf7fe640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40b006ae70 0x7f40b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.960+0000 7f40cf7fe640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40b006ae70 0x7f40b006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f40c0034000 tx=0x7f40c0009030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:24.960+0000 7f40ccff9640 1 -- 172.21.15.151:0/3959613586 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40b8059260 con 0x7f40d01f2860 2023-10-18T11:10:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.248+0000 7f40ccff9640 1 -- 172.21.15.151:0/3959613586 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40b8054ea0 con 0x7f40d01f2860 2023-10-18T11:10:25.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.453+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40d00c2070 con 0x7f40b006ae70 2023-10-18T11:10:25.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.465+0000 7f40ccff9640 1 -- 172.21.15.151:0/3959613586 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368004 (secure 0 0 0) 0x7f40c003d040 con 0x7f40b006ae70 2023-10-18T11:10:25.473 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:25.475 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:10:25.477 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.473+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40b006ae70 msgr2=0x7f40b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:25.477 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.473+0000 7f40d5bb0640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40b006ae70 0x7f40b006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f40c0034000 tx=0x7f40c0009030 comp rx=0 tx=0).stop 2023-10-18T11:10:25.477 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.473+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40d01f2860 msgr2=0x7f40d0149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:25.478 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.473+0000 7f40d5bb0640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40d01f2860 0x7f40d0149fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f40b80114c0 tx=0x7f40b8011980 comp rx=0 tx=0).stop 2023-10-18T11:10:25.478 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.474+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 shutdown_connections 2023-10-18T11:10:25.478 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.474+0000 7f40d5bb0640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40d0159070 0x7f40d014f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:25.478 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.474+0000 7f40d5bb0640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40d01f2860 0x7f40d0149fe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:25.478 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.474+0000 7f40d5bb0640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40b006ae70 0x7f40b006d330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:25.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.474+0000 7f40d5bb0640 1 --2- 172.21.15.151:0/3959613586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40bc0039c0 0x7f40d01ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:25.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.474+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 >> 172.21.15.151:0/3959613586 conn(0x7f40d00c6f10 msgr2=0x7f40d00c2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:25.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.474+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 shutdown_connections 2023-10-18T11:10:25.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.474+0000 7f40d5bb0640 1 -- 172.21.15.151:0/3959613586 wait complete. 2023-10-18T11:10:25.494 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-10-18T11:10:24.200388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218948,"kb_used_data":2784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":2850816,"data_stored":2268814,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003111"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176454+0000","last_change":"2023-10-18T11:09:36.796784+0000","last_active":"2023-10-18T11:10:09.176454+0000","last_peered":"2023-10-18T11:10:09.176454+0000","last_clean":"2023-10-18T11:10:09.176454+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:10:09.176454+0000","last_undegraded":"2023-10-18T11:10:09.176454+0000","last_fullsized":"2023-10-18T11:10:09.176454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.181907+0000","last_change":"2023-10-18T11:09:39.421701+0000","last_active":"2023-10-18T11:10:09.181907+0000","last_peered":"2023-10-18T11:10:09.181907+0000","last_clean":"2023-10-18T11:10:09.181907+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:10:09.181907+0000","last_undegraded":"2023-10-18T11:10:09.181907+0000","last_fullsized":"2023-10-18T11:10:09.181907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179158+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:10:09.179158+0000","last_peered":"2023-10-18T11:10:09.179158+0000","last_clean":"2023-10-18T11:10:09.179158+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:10:09.179158+0000","last_undegraded":"2023-10-18T11:10:09.179158+0000","last_fullsized":"2023-10-18T11:10:09.179158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182224+0000","last_change":"2023-10-18T11:09:36.909894+0000","last_active":"2023-10-18T11:10:09.182224+0000","last_peered":"2023-10-18T11:10:09.182224+0000","last_clean":"2023-10-18T11:10:09.182224+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:10:09.182224+0000","last_undegraded":"2023-10-18T11:10:09.182224+0000","last_fullsized":"2023-10-18T11:10:09.182224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176067+0000","last_change":"2023-10-18T11:09:39.363102+0000","last_active":"2023-10-18T11:10:09.176067+0000","last_peered":"2023-10-18T11:10:09.176067+0000","last_clean":"2023-10-18T11:10:09.176067+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:10:09.176067+0000","last_undegraded":"2023-10-18T11:10:09.176067+0000","last_fullsized":"2023-10-18T11:10:09.176067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168922+0000","last_change":"2023-10-18T11:09:46.109981+0000","last_active":"2023-10-18T11:10:09.168922+0000","last_peered":"2023-10-18T11:10:09.168922+0000","last_clean":"2023-10-18T11:10:09.168922+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:10:09.168922+0000","last_undegraded":"2023-10-18T11:10:09.168922+0000","last_fullsized":"2023-10-18T11:10:09.168922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:26.971949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167340+0000","last_change":"2023-10-18T11:09:36.896708+0000","last_active":"2023-10-18T11:10:09.167340+0000","last_peered":"2023-10-18T11:10:09.167340+0000","last_clean":"2023-10-18T11:10:09.167340+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:10:09.167340+0000","last_undegraded":"2023-10-18T11:10:09.167340+0000","last_fullsized":"2023-10-18T11:10:09.167340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171648+0000","last_change":"2023-10-18T11:09:39.397225+0000","last_active":"2023-10-18T11:10:09.171648+0000","last_peered":"2023-10-18T11:10:09.171648+0000","last_clean":"2023-10-18T11:10:09.171648+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:10:09.171648+0000","last_undegraded":"2023-10-18T11:10:09.171648+0000","last_fullsized":"2023-10-18T11:10:09.171648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169423+0000","last_change":"2023-10-18T11:09:46.114798+0000","last_active":"2023-10-18T11:10:09.169423+0000","last_peered":"2023-10-18T11:10:09.169423+0000","last_clean":"2023-10-18T11:10:09.169423+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:10:09.169423+0000","last_undegraded":"2023-10-18T11:10:09.169423+0000","last_fullsized":"2023-10-18T11:10:09.169423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:57.280120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166779+0000","last_change":"2023-10-18T11:09:36.795004+0000","last_active":"2023-10-18T11:10:09.166779+0000","last_peered":"2023-10-18T11:10:09.166779+0000","last_clean":"2023-10-18T11:10:09.166779+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:10:09.166779+0000","last_undegraded":"2023-10-18T11:10:09.166779+0000","last_fullsized":"2023-10-18T11:10:09.166779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171988+0000","last_change":"2023-10-18T11:09:39.398621+0000","last_active":"2023-10-18T11:10:09.171988+0000","last_peered":"2023-10-18T11:10:09.171988+0000","last_clean":"2023-10-18T11:10:09.171988+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:10:09.171988+0000","last_undegraded":"2023-10-18T11:10:09.171988+0000","last_fullsized":"2023-10-18T11:10:09.171988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169095+0000","last_change":"2023-10-18T11:09:46.115280+0000","last_active":"2023-10-18T11:10:09.169095+0000","last_peered":"2023-10-18T11:10:09.169095+0000","last_clean":"2023-10-18T11:10:09.169095+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:10:09.169095+0000","last_undegraded":"2023-10-18T11:10:09.169095+0000","last_fullsized":"2023-10-18T11:10:09.169095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:26.647416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165312+0000","last_change":"2023-10-18T11:09:39.397253+0000","last_active":"2023-10-18T11:10:09.165312+0000","last_peered":"2023-10-18T11:10:09.165312+0000","last_clean":"2023-10-18T11:10:09.165312+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:10:09.165312+0000","last_undegraded":"2023-10-18T11:10:09.165312+0000","last_fullsized":"2023-10-18T11:10:09.165312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167303+0000","last_change":"2023-10-18T11:09:36.893066+0000","last_active":"2023-10-18T11:10:09.167303+0000","last_peered":"2023-10-18T11:10:09.167303+0000","last_clean":"2023-10-18T11:10:09.167303+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:10:09.167303+0000","last_undegraded":"2023-10-18T11:10:09.167303+0000","last_fullsized":"2023-10-18T11:10:09.167303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:32.587464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169855+0000","last_change":"2023-10-18T11:09:46.096113+0000","last_active":"2023-10-18T11:10:09.169855+0000","last_peered":"2023-10-18T11:10:09.169855+0000","last_clean":"2023-10-18T11:10:09.169855+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:10:09.169855+0000","last_undegraded":"2023-10-18T11:10:09.169855+0000","last_fullsized":"2023-10-18T11:10:09.169855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:09.971210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.180886+0000","last_change":"2023-10-18T11:09:39.423651+0000","last_active":"2023-10-18T11:10:09.180886+0000","last_peered":"2023-10-18T11:10:09.180886+0000","last_clean":"2023-10-18T11:10:09.180886+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:10:09.180886+0000","last_undegraded":"2023-10-18T11:10:09.180886+0000","last_fullsized":"2023-10-18T11:10:09.180886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161718+0000","last_change":"2023-10-18T11:09:36.913611+0000","last_active":"2023-10-18T11:10:09.161718+0000","last_peered":"2023-10-18T11:10:09.161718+0000","last_clean":"2023-10-18T11:10:09.161718+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:10:09.161718+0000","last_undegraded":"2023-10-18T11:10:09.161718+0000","last_fullsized":"2023-10-18T11:10:09.161718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169776+0000","last_change":"2023-10-18T11:09:46.114729+0000","last_active":"2023-10-18T11:10:09.169776+0000","last_peered":"2023-10-18T11:10:09.169776+0000","last_clean":"2023-10-18T11:10:09.169776+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:10:09.169776+0000","last_undegraded":"2023-10-18T11:10:09.169776+0000","last_fullsized":"2023-10-18T11:10:09.169776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:50.156790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178636+0000","last_change":"2023-10-18T11:09:39.420146+0000","last_active":"2023-10-18T11:10:09.178636+0000","last_peered":"2023-10-18T11:10:09.178636+0000","last_clean":"2023-10-18T11:10:09.178636+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:10:09.178636+0000","last_undegraded":"2023-10-18T11:10:09.178636+0000","last_fullsized":"2023-10-18T11:10:09.178636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161253+0000","last_change":"2023-10-18T11:09:36.915198+0000","last_active":"2023-10-18T11:10:09.161253+0000","last_peered":"2023-10-18T11:10:09.161253+0000","last_clean":"2023-10-18T11:10:09.161253+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:10:09.161253+0000","last_undegraded":"2023-10-18T11:10:09.161253+0000","last_fullsized":"2023-10-18T11:10:09.161253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:18.429550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.416467+0000","last_change":"2023-10-18T11:10:10.413988+0000","last_active":"2023-10-18T11:10:10.416467+0000","last_peered":"2023-10-18T11:10:10.416467+0000","last_clean":"2023-10-18T11:10:10.416467+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:10:10.416467+0000","last_undegraded":"2023-10-18T11:10:10.416467+0000","last_fullsized":"2023-10-18T11:10:10.416467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169153+0000","last_change":"2023-10-18T11:09:39.399181+0000","last_active":"2023-10-18T11:10:09.169153+0000","last_peered":"2023-10-18T11:10:09.169153+0000","last_clean":"2023-10-18T11:10:09.169153+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:10:09.169153+0000","last_undegraded":"2023-10-18T11:10:09.169153+0000","last_fullsized":"2023-10-18T11:10:09.169153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:13.349921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166495+0000","last_change":"2023-10-18T11:09:36.797637+0000","last_active":"2023-10-18T11:10:09.166495+0000","last_peered":"2023-10-18T11:10:09.166495+0000","last_clean":"2023-10-18T11:10:09.166495+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:10:09.166495+0000","last_undegraded":"2023-10-18T11:10:09.166495+0000","last_fullsized":"2023-10-18T11:10:09.166495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:08.109221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169728+0000","last_change":"2023-10-18T11:09:46.109408+0000","last_active":"2023-10-18T11:10:09.169728+0000","last_peered":"2023-10-18T11:10:09.169728+0000","last_clean":"2023-10-18T11:10:09.169728+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:10:09.169728+0000","last_undegraded":"2023-10-18T11:10:09.169728+0000","last_fullsized":"2023-10-18T11:10:09.169728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.174070+0000","last_change":"2023-10-18T11:09:39.366234+0000","last_active":"2023-10-18T11:10:09.174070+0000","last_peered":"2023-10-18T11:10:09.174070+0000","last_clean":"2023-10-18T11:10:09.174070+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:10:09.174070+0000","last_undegraded":"2023-10-18T11:10:09.174070+0000","last_fullsized":"2023-10-18T11:10:09.174070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165007+0000","last_change":"2023-10-18T11:09:36.896533+0000","last_active":"2023-10-18T11:10:09.165007+0000","last_peered":"2023-10-18T11:10:09.165007+0000","last_clean":"2023-10-18T11:10:09.165007+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:10:09.165007+0000","last_undegraded":"2023-10-18T11:10:09.165007+0000","last_fullsized":"2023-10-18T11:10:09.165007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168970+0000","last_change":"2023-10-18T11:09:46.094196+0000","last_active":"2023-10-18T11:10:09.168970+0000","last_peered":"2023-10-18T11:10:09.168970+0000","last_clean":"2023-10-18T11:10:09.168970+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:10:09.168970+0000","last_undegraded":"2023-10-18T11:10:09.168970+0000","last_fullsized":"2023-10-18T11:10:09.168970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:43.456989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182246+0000","last_change":"2023-10-18T11:09:39.420016+0000","last_active":"2023-10-18T11:10:09.182246+0000","last_peered":"2023-10-18T11:10:09.182246+0000","last_clean":"2023-10-18T11:10:09.182246+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:10:09.182246+0000","last_undegraded":"2023-10-18T11:10:09.182246+0000","last_fullsized":"2023-10-18T11:10:09.182246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163703+0000","last_change":"2023-10-18T11:09:36.913659+0000","last_active":"2023-10-18T11:10:09.163703+0000","last_peered":"2023-10-18T11:10:09.163703+0000","last_clean":"2023-10-18T11:10:09.163703+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:10:09.163703+0000","last_undegraded":"2023-10-18T11:10:09.163703+0000","last_fullsized":"2023-10-18T11:10:09.163703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179764+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:10:09.179764+0000","last_peered":"2023-10-18T11:10:09.179764+0000","last_clean":"2023-10-18T11:10:09.179764+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:10:09.179764+0000","last_undegraded":"2023-10-18T11:10:09.179764+0000","last_fullsized":"2023-10-18T11:10:09.179764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162384+0000","last_change":"2023-10-18T11:09:39.243607+0000","last_active":"2023-10-18T11:10:09.162384+0000","last_peered":"2023-10-18T11:10:09.162384+0000","last_clean":"2023-10-18T11:10:09.162384+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:10:09.162384+0000","last_undegraded":"2023-10-18T11:10:09.162384+0000","last_fullsized":"2023-10-18T11:10:09.162384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167313+0000","last_change":"2023-10-18T11:09:36.798396+0000","last_active":"2023-10-18T11:10:09.167313+0000","last_peered":"2023-10-18T11:10:09.167313+0000","last_clean":"2023-10-18T11:10:09.167313+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:10:09.167313+0000","last_undegraded":"2023-10-18T11:10:09.167313+0000","last_fullsized":"2023-10-18T11:10:09.167313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:04.311252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177625+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:10:09.177625+0000","last_peered":"2023-10-18T11:10:09.177625+0000","last_clean":"2023-10-18T11:10:09.177625+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:10:09.177625+0000","last_undegraded":"2023-10-18T11:10:09.177625+0000","last_fullsized":"2023-10-18T11:10:09.177625+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.172014+0000","last_change":"2023-10-18T11:09:39.417304+0000","last_active":"2023-10-18T11:10:09.172014+0000","last_peered":"2023-10-18T11:10:09.172014+0000","last_clean":"2023-10-18T11:10:09.172014+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:10:09.172014+0000","last_undegraded":"2023-10-18T11:10:09.172014+0000","last_fullsized":"2023-10-18T11:10:09.172014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162464+0000","last_change":"2023-10-18T11:09:36.909623+0000","last_active":"2023-10-18T11:10:09.162464+0000","last_peered":"2023-10-18T11:10:09.162464+0000","last_clean":"2023-10-18T11:10:09.162464+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:10:09.162464+0000","last_undegraded":"2023-10-18T11:10:09.162464+0000","last_fullsized":"2023-10-18T11:10:09.162464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161364+0000","last_change":"2023-10-18T11:09:46.100735+0000","last_active":"2023-10-18T11:10:09.161364+0000","last_peered":"2023-10-18T11:10:09.161364+0000","last_clean":"2023-10-18T11:10:09.161364+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:10:09.161364+0000","last_undegraded":"2023-10-18T11:10:09.161364+0000","last_fullsized":"2023-10-18T11:10:09.161364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169573+0000","last_change":"2023-10-18T11:09:39.400602+0000","last_active":"2023-10-18T11:10:09.169573+0000","last_peered":"2023-10-18T11:10:09.169573+0000","last_clean":"2023-10-18T11:10:09.169573+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:10:09.169573+0000","last_undegraded":"2023-10-18T11:10:09.169573+0000","last_fullsized":"2023-10-18T11:10:09.169573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:37.020893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171903+0000","last_change":"2023-10-18T11:09:36.915028+0000","last_active":"2023-10-18T11:10:09.171903+0000","last_peered":"2023-10-18T11:10:09.171903+0000","last_clean":"2023-10-18T11:10:09.171903+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:10:09.171903+0000","last_undegraded":"2023-10-18T11:10:09.171903+0000","last_fullsized":"2023-10-18T11:10:09.171903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162244+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:10:09.162244+0000","last_peered":"2023-10-18T11:10:09.162244+0000","last_clean":"2023-10-18T11:10:09.162244+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:10:09.162244+0000","last_undegraded":"2023-10-18T11:10:09.162244+0000","last_fullsized":"2023-10-18T11:10:09.162244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161140+0000","last_change":"2023-10-18T11:09:39.243829+0000","last_active":"2023-10-18T11:10:09.161140+0000","last_peered":"2023-10-18T11:10:09.161140+0000","last_clean":"2023-10-18T11:10:09.161140+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:10:09.161140+0000","last_undegraded":"2023-10-18T11:10:09.161140+0000","last_fullsized":"2023-10-18T11:10:09.161140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144963+0000","last_change":"2023-10-18T11:09:36.910270+0000","last_active":"2023-10-18T11:10:09.144963+0000","last_peered":"2023-10-18T11:10:09.144963+0000","last_clean":"2023-10-18T11:10:09.144963+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:10:09.144963+0000","last_undegraded":"2023-10-18T11:10:09.144963+0000","last_fullsized":"2023-10-18T11:10:09.144963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163801+0000","last_change":"2023-10-18T11:09:46.114610+0000","last_active":"2023-10-18T11:10:09.163801+0000","last_peered":"2023-10-18T11:10:09.163801+0000","last_clean":"2023-10-18T11:10:09.163801+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:10:09.163801+0000","last_undegraded":"2023-10-18T11:10:09.163801+0000","last_fullsized":"2023-10-18T11:10:09.163801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177327+0000","last_change":"2023-10-18T11:09:39.404210+0000","last_active":"2023-10-18T11:10:09.177327+0000","last_peered":"2023-10-18T11:10:09.177327+0000","last_clean":"2023-10-18T11:10:09.177327+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:10:09.177327+0000","last_undegraded":"2023-10-18T11:10:09.177327+0000","last_fullsized":"2023-10-18T11:10:09.177327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166545+0000","last_change":"2023-10-18T11:09:36.913804+0000","last_active":"2023-10-18T11:10:09.166545+0000","last_peered":"2023-10-18T11:10:09.166545+0000","last_clean":"2023-10-18T11:10:09.166545+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:10:09.166545+0000","last_undegraded":"2023-10-18T11:10:09.166545+0000","last_fullsized":"2023-10-18T11:10:09.166545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173920+0000","last_change":"2023-10-18T11:09:46.092566+0000","last_active":"2023-10-18T11:10:09.173920+0000","last_peered":"2023-10-18T11:10:09.173920+0000","last_clean":"2023-10-18T11:10:09.173920+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:10:09.173920+0000","last_undegraded":"2023-10-18T11:10:09.173920+0000","last_fullsized":"2023-10-18T11:10:09.173920+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:42.848835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178796+0000","last_change":"2023-10-18T11:09:39.422507+0000","last_active":"2023-10-18T11:10:09.178796+0000","last_peered":"2023-10-18T11:10:09.178796+0000","last_clean":"2023-10-18T11:10:09.178796+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:10:09.178796+0000","last_undegraded":"2023-10-18T11:10:09.178796+0000","last_fullsized":"2023-10-18T11:10:09.178796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171592+0000","last_change":"2023-10-18T11:09:36.828474+0000","last_active":"2023-10-18T11:10:09.171592+0000","last_peered":"2023-10-18T11:10:09.171592+0000","last_clean":"2023-10-18T11:10:09.171592+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:10:09.171592+0000","last_undegraded":"2023-10-18T11:10:09.171592+0000","last_fullsized":"2023-10-18T11:10:09.171592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166583+0000","last_change":"2023-10-18T11:09:19.365660+0000","last_active":"2023-10-18T11:10:09.166583+0000","last_peered":"2023-10-18T11:10:09.166583+0000","last_clean":"2023-10-18T11:10:09.166583+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:10:09.166583+0000","last_undegraded":"2023-10-18T11:10:09.166583+0000","last_fullsized":"2023-10-18T11:10:09.166583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_clean_scrub_stamp":"2023-10-18T11:09:17.711667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:34:53.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164849+0000","last_change":"2023-10-18T11:09:46.118571+0000","last_active":"2023-10-18T11:10:09.164849+0000","last_peered":"2023-10-18T11:10:09.164849+0000","last_clean":"2023-10-18T11:10:09.164849+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:10:09.164849+0000","last_undegraded":"2023-10-18T11:10:09.164849+0000","last_fullsized":"2023-10-18T11:10:09.164849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:46.781070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166799+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:10:09.166799+0000","last_peered":"2023-10-18T11:10:09.166799+0000","last_clean":"2023-10-18T11:10:09.166799+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:10:09.166799+0000","last_undegraded":"2023-10-18T11:10:09.166799+0000","last_fullsized":"2023-10-18T11:10:09.166799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.145112+0000","last_change":"2023-10-18T11:09:36.829100+0000","last_active":"2023-10-18T11:10:09.145112+0000","last_peered":"2023-10-18T11:10:09.145112+0000","last_clean":"2023-10-18T11:10:09.145112+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:10:09.145112+0000","last_undegraded":"2023-10-18T11:10:09.145112+0000","last_fullsized":"2023-10-18T11:10:09.145112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.418740+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:10:10.418740+0000","last_peered":"2023-10-18T11:10:10.418740+0000","last_clean":"2023-10-18T11:10:10.418740+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:10:10.418740+0000","last_undegraded":"2023-10-18T11:10:10.418740+0000","last_fullsized":"2023-10-18T11:10:10.418740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171728+0000","last_change":"2023-10-18T11:09:39.419862+0000","last_active":"2023-10-18T11:10:09.171728+0000","last_peered":"2023-10-18T11:10:09.171728+0000","last_clean":"2023-10-18T11:10:09.171728+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:10:09.171728+0000","last_undegraded":"2023-10-18T11:10:09.171728+0000","last_fullsized":"2023-10-18T11:10:09.171728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163080+0000","last_change":"2023-10-18T11:09:36.912905+0000","last_active":"2023-10-18T11:10:09.163080+0000","last_peered":"2023-10-18T11:10:09.163080+0000","last_clean":"2023-10-18T11:10:09.163080+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:10:09.163080+0000","last_undegraded":"2023-10-18T11:10:09.163080+0000","last_fullsized":"2023-10-18T11:10:09.163080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177785+0000","last_change":"2023-10-18T11:09:46.097744+0000","last_active":"2023-10-18T11:10:09.177785+0000","last_peered":"2023-10-18T11:10:09.177785+0000","last_clean":"2023-10-18T11:10:09.177785+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:10:09.177785+0000","last_undegraded":"2023-10-18T11:10:09.177785+0000","last_fullsized":"2023-10-18T11:10:09.177785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:20.073279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167753+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:10:09.167753+0000","last_peered":"2023-10-18T11:10:09.167753+0000","last_clean":"2023-10-18T11:10:09.167753+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:10:09.167753+0000","last_undegraded":"2023-10-18T11:10:09.167753+0000","last_fullsized":"2023-10-18T11:10:09.167753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:51.220855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.145622+0000","last_change":"2023-10-18T11:09:36.907280+0000","last_active":"2023-10-18T11:10:09.145622+0000","last_peered":"2023-10-18T11:10:09.145622+0000","last_clean":"2023-10-18T11:10:09.145622+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:10:09.145622+0000","last_undegraded":"2023-10-18T11:10:09.145622+0000","last_fullsized":"2023-10-18T11:10:09.145622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171054+0000","last_change":"2023-10-18T11:09:46.096894+0000","last_active":"2023-10-18T11:10:09.171054+0000","last_peered":"2023-10-18T11:10:09.171054+0000","last_clean":"2023-10-18T11:10:09.171054+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:10:09.171054+0000","last_undegraded":"2023-10-18T11:10:09.171054+0000","last_fullsized":"2023-10-18T11:10:09.171054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167081+0000","last_change":"2023-10-18T11:09:39.399750+0000","last_active":"2023-10-18T11:10:09.167081+0000","last_peered":"2023-10-18T11:10:09.167081+0000","last_clean":"2023-10-18T11:10:09.167081+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:10:09.167081+0000","last_undegraded":"2023-10-18T11:10:09.167081+0000","last_fullsized":"2023-10-18T11:10:09.167081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:35.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169704+0000","last_change":"2023-10-18T11:09:36.897906+0000","last_active":"2023-10-18T11:10:09.169704+0000","last_peered":"2023-10-18T11:10:09.169704+0000","last_clean":"2023-10-18T11:10:09.169704+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:10:09.169704+0000","last_undegraded":"2023-10-18T11:10:09.169704+0000","last_fullsized":"2023-10-18T11:10:09.169704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:41:27.304152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168875+0000","last_change":"2023-10-18T11:09:46.109151+0000","last_active":"2023-10-18T11:10:09.168875+0000","last_peered":"2023-10-18T11:10:09.168875+0000","last_clean":"2023-10-18T11:10:09.168875+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:10:09.168875+0000","last_undegraded":"2023-10-18T11:10:09.168875+0000","last_fullsized":"2023-10-18T11:10:09.168875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:41.785820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166808+0000","last_change":"2023-10-18T11:09:39.397483+0000","last_active":"2023-10-18T11:10:09.166808+0000","last_peered":"2023-10-18T11:10:09.166808+0000","last_clean":"2023-10-18T11:10:09.166808+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:10:09.166808+0000","last_undegraded":"2023-10-18T11:10:09.166808+0000","last_fullsized":"2023-10-18T11:10:09.166808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144545+0000","last_change":"2023-10-18T11:09:36.916080+0000","last_active":"2023-10-18T11:10:09.144545+0000","last_peered":"2023-10-18T11:10:09.144545+0000","last_clean":"2023-10-18T11:10:09.144545+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:10:09.144545+0000","last_undegraded":"2023-10-18T11:10:09.144545+0000","last_fullsized":"2023-10-18T11:10:09.144545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:22.058134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173831+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:10:09.173831+0000","last_peered":"2023-10-18T11:10:09.173831+0000","last_clean":"2023-10-18T11:10:09.173831+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:10:09.173831+0000","last_undegraded":"2023-10-18T11:10:09.173831+0000","last_fullsized":"2023-10-18T11:10:09.173831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164509+0000","last_change":"2023-10-18T11:09:39.358262+0000","last_active":"2023-10-18T11:10:09.164509+0000","last_peered":"2023-10-18T11:10:09.164509+0000","last_clean":"2023-10-18T11:10:09.164509+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:10:09.164509+0000","last_undegraded":"2023-10-18T11:10:09.164509+0000","last_fullsized":"2023-10-18T11:10:09.164509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164598+0000","last_change":"2023-10-18T11:09:36.893045+0000","last_active":"2023-10-18T11:10:09.164598+0000","last_peered":"2023-10-18T11:10:09.164598+0000","last_clean":"2023-10-18T11:10:09.164598+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:10:09.164598+0000","last_undegraded":"2023-10-18T11:10:09.164598+0000","last_fullsized":"2023-10-18T11:10:09.164598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182137+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:10:09.182137+0000","last_peered":"2023-10-18T11:10:09.182137+0000","last_clean":"2023-10-18T11:10:09.182137+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:10:09.182137+0000","last_undegraded":"2023-10-18T11:10:09.182137+0000","last_fullsized":"2023-10-18T11:10:09.182137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:27.567970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167151+0000","last_change":"2023-10-18T11:09:39.399188+0000","last_active":"2023-10-18T11:10:09.167151+0000","last_peered":"2023-10-18T11:10:09.167151+0000","last_clean":"2023-10-18T11:10:09.167151+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:10:09.167151+0000","last_undegraded":"2023-10-18T11:10:09.167151+0000","last_fullsized":"2023-10-18T11:10:09.167151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171828+0000","last_change":"2023-10-18T11:09:36.905576+0000","last_active":"2023-10-18T11:10:09.171828+0000","last_peered":"2023-10-18T11:10:09.171828+0000","last_clean":"2023-10-18T11:10:09.171828+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:10:09.171828+0000","last_undegraded":"2023-10-18T11:10:09.171828+0000","last_fullsized":"2023-10-18T11:10:09.171828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179319+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:10:09.179319+0000","last_peered":"2023-10-18T11:10:09.179319+0000","last_clean":"2023-10-18T11:10:09.179319+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:10:09.179319+0000","last_undegraded":"2023-10-18T11:10:09.179319+0000","last_fullsized":"2023-10-18T11:10:09.179319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:47.871773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.174065+0000","last_change":"2023-10-18T11:09:39.361805+0000","last_active":"2023-10-18T11:10:09.174065+0000","last_peered":"2023-10-18T11:10:09.174065+0000","last_clean":"2023-10-18T11:10:09.174065+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:10:09.174065+0000","last_undegraded":"2023-10-18T11:10:09.174065+0000","last_fullsized":"2023-10-18T11:10:09.174065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178011+0000","last_change":"2023-10-18T11:09:36.894141+0000","last_active":"2023-10-18T11:10:09.178011+0000","last_peered":"2023-10-18T11:10:09.178011+0000","last_clean":"2023-10-18T11:10:09.178011+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:10:09.178011+0000","last_undegraded":"2023-10-18T11:10:09.178011+0000","last_fullsized":"2023-10-18T11:10:09.178011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171913+0000","last_change":"2023-10-18T11:09:46.114944+0000","last_active":"2023-10-18T11:10:09.171913+0000","last_peered":"2023-10-18T11:10:09.171913+0000","last_clean":"2023-10-18T11:10:09.171913+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:10:09.171913+0000","last_undegraded":"2023-10-18T11:10:09.171913+0000","last_fullsized":"2023-10-18T11:10:09.171913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166923+0000","last_change":"2023-10-18T11:09:39.420430+0000","last_active":"2023-10-18T11:10:09.166923+0000","last_peered":"2023-10-18T11:10:09.166923+0000","last_clean":"2023-10-18T11:10:09.166923+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:10:09.166923+0000","last_undegraded":"2023-10-18T11:10:09.166923+0000","last_fullsized":"2023-10-18T11:10:09.166923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:12.994704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"30'10","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.372567+0000","last_change":"2023-10-18T11:09:36.904648+0000","last_active":"2023-10-18T11:10:09.372567+0000","last_peered":"2023-10-18T11:10:09.372567+0000","last_clean":"2023-10-18T11:10:09.372567+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:10:09.372567+0000","last_undegraded":"2023-10-18T11:10:09.372567+0000","last_fullsized":"2023-10-18T11:10:09.372567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161456+0000","last_change":"2023-10-18T11:09:46.101866+0000","last_active":"2023-10-18T11:10:09.161456+0000","last_peered":"2023-10-18T11:10:09.161456+0000","last_clean":"2023-10-18T11:10:09.161456+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:10:09.161456+0000","last_undegraded":"2023-10-18T11:10:09.161456+0000","last_fullsized":"2023-10-18T11:10:09.161456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:41.150485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169443+0000","last_change":"2023-10-18T11:09:39.398597+0000","last_active":"2023-10-18T11:10:09.169443+0000","last_peered":"2023-10-18T11:10:09.169443+0000","last_clean":"2023-10-18T11:10:09.169443+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:10:09.169443+0000","last_undegraded":"2023-10-18T11:10:09.169443+0000","last_fullsized":"2023-10-18T11:10:09.169443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:10.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162838+0000","last_change":"2023-10-18T11:09:36.913285+0000","last_active":"2023-10-18T11:10:09.162838+0000","last_peered":"2023-10-18T11:10:09.162838+0000","last_clean":"2023-10-18T11:10:09.162838+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:10:09.162838+0000","last_undegraded":"2023-10-18T11:10:09.162838+0000","last_fullsized":"2023-10-18T11:10:09.162838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169273+0000","last_change":"2023-10-18T11:09:46.094205+0000","last_active":"2023-10-18T11:10:09.169273+0000","last_peered":"2023-10-18T11:10:09.169273+0000","last_clean":"2023-10-18T11:10:09.169273+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:10:09.169273+0000","last_undegraded":"2023-10-18T11:10:09.169273+0000","last_fullsized":"2023-10-18T11:10:09.169273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:13.509608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176274+0000","last_change":"2023-10-18T11:09:39.363739+0000","last_active":"2023-10-18T11:10:09.176274+0000","last_peered":"2023-10-18T11:10:09.176274+0000","last_clean":"2023-10-18T11:10:09.176274+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:10:09.176274+0000","last_undegraded":"2023-10-18T11:10:09.176274+0000","last_fullsized":"2023-10-18T11:10:09.176274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:52.069782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.172123+0000","last_change":"2023-10-18T11:09:36.896767+0000","last_active":"2023-10-18T11:10:09.172123+0000","last_peered":"2023-10-18T11:10:09.172123+0000","last_clean":"2023-10-18T11:10:09.172123+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:10:09.172123+0000","last_undegraded":"2023-10-18T11:10:09.172123+0000","last_fullsized":"2023-10-18T11:10:09.172123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178440+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:10:09.178440+0000","last_peered":"2023-10-18T11:10:09.178440+0000","last_clean":"2023-10-18T11:10:09.178440+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:10:09.178440+0000","last_undegraded":"2023-10-18T11:10:09.178440+0000","last_fullsized":"2023-10-18T11:10:09.178440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.172124+0000","last_change":"2023-10-18T11:09:39.351468+0000","last_active":"2023-10-18T11:10:09.172124+0000","last_peered":"2023-10-18T11:10:09.172124+0000","last_clean":"2023-10-18T11:10:09.172124+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:10:09.172124+0000","last_undegraded":"2023-10-18T11:10:09.172124+0000","last_fullsized":"2023-10-18T11:10:09.172124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164922+0000","last_change":"2023-10-18T11:09:36.896596+0000","last_active":"2023-10-18T11:10:09.164922+0000","last_peered":"2023-10-18T11:10:09.164922+0000","last_clean":"2023-10-18T11:10:09.164922+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:10:09.164922+0000","last_undegraded":"2023-10-18T11:10:09.164922+0000","last_fullsized":"2023-10-18T11:10:09.164922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179254+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:10:09.179254+0000","last_peered":"2023-10-18T11:10:09.179254+0000","last_clean":"2023-10-18T11:10:09.179254+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:10:09.179254+0000","last_undegraded":"2023-10-18T11:10:09.179254+0000","last_fullsized":"2023-10-18T11:10:09.179254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.417214+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:10:10.417214+0000","last_peered":"2023-10-18T11:10:10.417214+0000","last_clean":"2023-10-18T11:10:10.417214+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:10:10.417214+0000","last_undegraded":"2023-10-18T11:10:10.417214+0000","last_fullsized":"2023-10-18T11:10:10.417214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:09.785576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161029+0000","last_change":"2023-10-18T11:09:39.418416+0000","last_active":"2023-10-18T11:10:09.161029+0000","last_peered":"2023-10-18T11:10:09.161029+0000","last_clean":"2023-10-18T11:10:09.161029+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:10:09.161029+0000","last_undegraded":"2023-10-18T11:10:09.161029+0000","last_fullsized":"2023-10-18T11:10:09.161029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171229+0000","last_change":"2023-10-18T11:09:36.893158+0000","last_active":"2023-10-18T11:10:09.171229+0000","last_peered":"2023-10-18T11:10:09.171229+0000","last_clean":"2023-10-18T11:10:09.171229+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:10:09.171229+0000","last_undegraded":"2023-10-18T11:10:09.171229+0000","last_fullsized":"2023-10-18T11:10:09.171229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164789+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:10:09.164789+0000","last_peered":"2023-10-18T11:10:09.164789+0000","last_clean":"2023-10-18T11:10:09.164789+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:10:09.164789+0000","last_undegraded":"2023-10-18T11:10:09.164789+0000","last_fullsized":"2023-10-18T11:10:09.164789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178550+0000","last_change":"2023-10-18T11:09:39.421160+0000","last_active":"2023-10-18T11:10:09.178550+0000","last_peered":"2023-10-18T11:10:09.178550+0000","last_clean":"2023-10-18T11:10:09.178550+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:10:09.178550+0000","last_undegraded":"2023-10-18T11:10:09.178550+0000","last_fullsized":"2023-10-18T11:10:09.178550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179543+0000","last_change":"2023-10-18T11:09:36.911629+0000","last_active":"2023-10-18T11:10:09.179543+0000","last_peered":"2023-10-18T11:10:09.179543+0000","last_clean":"2023-10-18T11:10:09.179543+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:10:09.179543+0000","last_undegraded":"2023-10-18T11:10:09.179543+0000","last_fullsized":"2023-10-18T11:10:09.179543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:53.929992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165406+0000","last_change":"2023-10-18T11:09:36.894351+0000","last_active":"2023-10-18T11:10:09.165406+0000","last_peered":"2023-10-18T11:10:09.165406+0000","last_clean":"2023-10-18T11:10:09.165406+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:10:09.165406+0000","last_undegraded":"2023-10-18T11:10:09.165406+0000","last_fullsized":"2023-10-18T11:10:09.165406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:11.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.180784+0000","last_change":"2023-10-18T11:09:39.404508+0000","last_active":"2023-10-18T11:10:09.180784+0000","last_peered":"2023-10-18T11:10:09.180784+0000","last_clean":"2023-10-18T11:10:09.180784+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:10:09.180784+0000","last_undegraded":"2023-10-18T11:10:09.180784+0000","last_fullsized":"2023-10-18T11:10:09.180784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144886+0000","last_change":"2023-10-18T11:09:46.117246+0000","last_active":"2023-10-18T11:10:09.144886+0000","last_peered":"2023-10-18T11:10:09.144886+0000","last_clean":"2023-10-18T11:10:09.144886+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:10:09.144886+0000","last_undegraded":"2023-10-18T11:10:09.144886+0000","last_fullsized":"2023-10-18T11:10:09.144886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:59.808082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.181081+0000","last_change":"2023-10-18T11:09:36.912013+0000","last_active":"2023-10-18T11:10:09.181081+0000","last_peered":"2023-10-18T11:10:09.181081+0000","last_clean":"2023-10-18T11:10:09.181081+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:10:09.181081+0000","last_undegraded":"2023-10-18T11:10:09.181081+0000","last_fullsized":"2023-10-18T11:10:09.181081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:49.950001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169156+0000","last_change":"2023-10-18T11:09:39.400362+0000","last_active":"2023-10-18T11:10:09.169156+0000","last_peered":"2023-10-18T11:10:09.169156+0000","last_clean":"2023-10-18T11:10:09.169156+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:10:09.169156+0000","last_undegraded":"2023-10-18T11:10:09.169156+0000","last_fullsized":"2023-10-18T11:10:09.169156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:50.136754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182239+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:10:09.182239+0000","last_peered":"2023-10-18T11:10:09.182239+0000","last_clean":"2023-10-18T11:10:09.182239+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:10:09.182239+0000","last_undegraded":"2023-10-18T11:10:09.182239+0000","last_fullsized":"2023-10-18T11:10:09.182239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:52:09.414015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164430+0000","last_change":"2023-10-18T11:09:39.359747+0000","last_active":"2023-10-18T11:10:09.164430+0000","last_peered":"2023-10-18T11:10:09.164430+0000","last_clean":"2023-10-18T11:10:09.164430+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:10:09.164430+0000","last_undegraded":"2023-10-18T11:10:09.164430+0000","last_fullsized":"2023-10-18T11:10:09.164430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144846+0000","last_change":"2023-10-18T11:09:39.242600+0000","last_active":"2023-10-18T11:10:09.144846+0000","last_peered":"2023-10-18T11:10:09.144846+0000","last_clean":"2023-10-18T11:10:09.144846+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:10:09.144846+0000","last_undegraded":"2023-10-18T11:10:09.144846+0000","last_fullsized":"2023-10-18T11:10:09.144846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:45.076093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.419036+0000","last_change":"2023-10-18T11:10:10.416758+0000","last_active":"2023-10-18T11:10:10.419036+0000","last_peered":"2023-10-18T11:10:10.419036+0000","last_clean":"2023-10-18T11:10:10.419036+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:10:10.419036+0000","last_undegraded":"2023-10-18T11:10:10.419036+0000","last_fullsized":"2023-10-18T11:10:10.419036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177879+0000","last_change":"2023-10-18T11:09:39.425505+0000","last_active":"2023-10-18T11:10:09.177879+0000","last_peered":"2023-10-18T11:10:09.177879+0000","last_clean":"2023-10-18T11:10:09.177879+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:10:09.177879+0000","last_undegraded":"2023-10-18T11:10:09.177879+0000","last_fullsized":"2023-10-18T11:10:09.177879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179456+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:10:09.179456+0000","last_peered":"2023-10-18T11:10:09.179456+0000","last_clean":"2023-10-18T11:10:09.179456+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:10:09.179456+0000","last_undegraded":"2023-10-18T11:10:09.179456+0000","last_fullsized":"2023-10-18T11:10:09.179456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162742+0000","last_change":"2023-10-18T11:09:39.423043+0000","last_active":"2023-10-18T11:10:09.162742+0000","last_peered":"2023-10-18T11:10:09.162742+0000","last_clean":"2023-10-18T11:10:09.162742+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:10:09.162742+0000","last_undegraded":"2023-10-18T11:10:09.162742+0000","last_fullsized":"2023-10-18T11:10:09.162742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165107+0000","last_change":"2023-10-18T11:09:39.351604+0000","last_active":"2023-10-18T11:10:09.165107+0000","last_peered":"2023-10-18T11:10:09.165107+0000","last_clean":"2023-10-18T11:10:09.165107+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:10:09.165107+0000","last_undegraded":"2023-10-18T11:10:09.165107+0000","last_fullsized":"2023-10-18T11:10:09.165107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182241+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:10:09.182241+0000","last_peered":"2023-10-18T11:10:09.182241+0000","last_clean":"2023-10-18T11:10:09.182241+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:10:09.182241+0000","last_undegraded":"2023-10-18T11:10:09.182241+0000","last_fullsized":"2023-10-18T11:10:09.182241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171269+0000","last_change":"2023-10-18T11:09:39.419909+0000","last_active":"2023-10-18T11:10:09.171269+0000","last_peered":"2023-10-18T11:10:09.171269+0000","last_clean":"2023-10-18T11:10:09.171269+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:10:09.171269+0000","last_undegraded":"2023-10-18T11:10:09.171269+0000","last_fullsized":"2023-10-18T11:10:09.171269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179397+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:10:09.179397+0000","last_peered":"2023-10-18T11:10:09.179397+0000","last_clean":"2023-10-18T11:10:09.179397+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:10:09.179397+0000","last_undegraded":"2023-10-18T11:10:09.179397+0000","last_fullsized":"2023-10-18T11:10:09.179397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171348+0000","last_change":"2023-10-18T11:09:39.349250+0000","last_active":"2023-10-18T11:10:09.171348+0000","last_peered":"2023-10-18T11:10:09.171348+0000","last_clean":"2023-10-18T11:10:09.171348+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:10:09.171348+0000","last_undegraded":"2023-10-18T11:10:09.171348+0000","last_fullsized":"2023-10-18T11:10:09.171348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177703+0000","last_change":"2023-10-18T11:09:39.361414+0000","last_active":"2023-10-18T11:10:09.177703+0000","last_peered":"2023-10-18T11:10:09.177703+0000","last_clean":"2023-10-18T11:10:09.177703+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:10:09.177703+0000","last_undegraded":"2023-10-18T11:10:09.177703+0000","last_fullsized":"2023-10-18T11:10:09.177703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164861+0000","last_change":"2023-10-18T11:09:39.399067+0000","last_active":"2023-10-18T11:10:09.164861+0000","last_peered":"2023-10-18T11:10:09.164861+0000","last_clean":"2023-10-18T11:10:09.164861+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:10:09.164861+0000","last_undegraded":"2023-10-18T11:10:09.164861+0000","last_fullsized":"2023-10-18T11:10:09.164861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167183+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:10:09.167183+0000","last_peered":"2023-10-18T11:10:09.167183+0000","last_clean":"2023-10-18T11:10:09.167183+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:10:09.167183+0000","last_undegraded":"2023-10-18T11:10:09.167183+0000","last_fullsized":"2023-10-18T11:10:09.167183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:04.730798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.145690+0000","last_change":"2023-10-18T11:09:39.320727+0000","last_active":"2023-10-18T11:10:09.145690+0000","last_peered":"2023-10-18T11:10:09.145690+0000","last_clean":"2023-10-18T11:10:09.145690+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:10:09.145690+0000","last_undegraded":"2023-10-18T11:10:09.145690+0000","last_fullsized":"2023-10-18T11:10:09.145690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.407850+0000","last_change":"2023-10-18T11:10:10.401580+0000","last_active":"2023-10-18T11:10:10.407850+0000","last_peered":"2023-10-18T11:10:10.407850+0000","last_clean":"2023-10-18T11:10:10.407850+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:10:10.407850+0000","last_undegraded":"2023-10-18T11:10:10.407850+0000","last_fullsized":"2023-10-18T11:10:10.407850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171150+0000","last_change":"2023-10-18T11:09:39.354336+0000","last_active":"2023-10-18T11:10:09.171150+0000","last_peered":"2023-10-18T11:10:09.171150+0000","last_clean":"2023-10-18T11:10:09.171150+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:10:09.171150+0000","last_undegraded":"2023-10-18T11:10:09.171150+0000","last_fullsized":"2023-10-18T11:10:09.171150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161257+0000","last_change":"2023-10-18T11:09:39.401976+0000","last_active":"2023-10-18T11:10:09.161257+0000","last_peered":"2023-10-18T11:10:09.161257+0000","last_clean":"2023-10-18T11:10:09.161257+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:10:09.161257+0000","last_undegraded":"2023-10-18T11:10:09.161257+0000","last_fullsized":"2023-10-18T11:10:09.161257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173957+0000","last_change":"2023-10-18T11:09:39.366222+0000","last_active":"2023-10-18T11:10:09.173957+0000","last_peered":"2023-10-18T11:10:09.173957+0000","last_clean":"2023-10-18T11:10:09.173957+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:10:09.173957+0000","last_undegraded":"2023-10-18T11:10:09.173957+0000","last_fullsized":"2023-10-18T11:10:09.173957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:52.729507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.415418+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:10:10.415418+0000","last_peered":"2023-10-18T11:10:10.415418+0000","last_clean":"2023-10-18T11:10:10.415418+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:10:10.415418+0000","last_undegraded":"2023-10-18T11:10:10.415418+0000","last_fullsized":"2023-10-18T11:10:10.415418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:37:38.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169371+0000","last_change":"2023-10-18T11:09:39.400563+0000","last_active":"2023-10-18T11:10:09.169371+0000","last_peered":"2023-10-18T11:10:09.169371+0000","last_clean":"2023-10-18T11:10:09.169371+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:10:09.169371+0000","last_undegraded":"2023-10-18T11:10:09.169371+0000","last_fullsized":"2023-10-18T11:10:09.169371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:24.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164720+0000","last_change":"2023-10-18T11:09:39.320580+0000","last_active":"2023-10-18T11:10:09.164720+0000","last_peered":"2023-10-18T11:10:09.164720+0000","last_clean":"2023-10-18T11:10:09.164720+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:10:09.164720+0000","last_undegraded":"2023-10-18T11:10:09.164720+0000","last_fullsized":"2023-10-18T11:10:09.164720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165013+0000","last_change":"2023-10-18T11:09:39.320508+0000","last_active":"2023-10-18T11:10:09.165013+0000","last_peered":"2023-10-18T11:10:09.165013+0000","last_clean":"2023-10-18T11:10:09.165013+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:10:09.165013+0000","last_undegraded":"2023-10-18T11:10:09.165013+0000","last_fullsized":"2023-10-18T11:10:09.165013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167124+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:10:09.167124+0000","last_peered":"2023-10-18T11:10:09.167124+0000","last_clean":"2023-10-18T11:10:09.167124+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:10:09.167124+0000","last_undegraded":"2023-10-18T11:10:09.167124+0000","last_fullsized":"2023-10-18T11:10:09.167124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:11.432343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178301+0000","last_change":"2023-10-18T11:09:39.421921+0000","last_active":"2023-10-18T11:10:09.178301+0000","last_peered":"2023-10-18T11:10:09.178301+0000","last_clean":"2023-10-18T11:10:09.178301+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:10:09.178301+0000","last_undegraded":"2023-10-18T11:10:09.178301+0000","last_fullsized":"2023-10-18T11:10:09.178301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166717+0000","last_change":"2023-10-18T11:09:39.360846+0000","last_active":"2023-10-18T11:10:09.166717+0000","last_peered":"2023-10-18T11:10:09.166717+0000","last_clean":"2023-10-18T11:10:09.166717+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:10:09.166717+0000","last_undegraded":"2023-10-18T11:10:09.166717+0000","last_fullsized":"2023-10-18T11:10:09.166717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.417103+0000","last_change":"2023-10-18T11:10:10.413563+0000","last_active":"2023-10-18T11:10:10.417103+0000","last_peered":"2023-10-18T11:10:10.417103+0000","last_clean":"2023-10-18T11:10:10.417103+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:10:10.417103+0000","last_undegraded":"2023-10-18T11:10:10.417103+0000","last_fullsized":"2023-10-18T11:10:10.417103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:43.078216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166677+0000","last_change":"2023-10-18T11:09:39.355047+0000","last_active":"2023-10-18T11:10:09.166677+0000","last_peered":"2023-10-18T11:10:09.166677+0000","last_clean":"2023-10-18T11:10:09.166677+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:10:09.166677+0000","last_undegraded":"2023-10-18T11:10:09.166677+0000","last_fullsized":"2023-10-18T11:10:09.166677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171566+0000","last_change":"2023-10-18T11:09:39.418362+0000","last_active":"2023-10-18T11:10:09.171566+0000","last_peered":"2023-10-18T11:10:09.171566+0000","last_clean":"2023-10-18T11:10:09.171566+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:10:09.171566+0000","last_undegraded":"2023-10-18T11:10:09.171566+0000","last_fullsized":"2023-10-18T11:10:09.171566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.175529+0000","last_change":"2023-10-18T11:09:39.363750+0000","last_active":"2023-10-18T11:10:09.175529+0000","last_peered":"2023-10-18T11:10:09.175529+0000","last_clean":"2023-10-18T11:10:09.175529+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:10:09.175529+0000","last_undegraded":"2023-10-18T11:10:09.175529+0000","last_fullsized":"2023-10-18T11:10:09.175529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:43.536873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163609+0000","last_change":"2023-10-18T11:09:39.363259+0000","last_active":"2023-10-18T11:10:09.163609+0000","last_peered":"2023-10-18T11:10:09.163609+0000","last_clean":"2023-10-18T11:10:09.163609+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:10:09.163609+0000","last_undegraded":"2023-10-18T11:10:09.163609+0000","last_fullsized":"2023-10-18T11:10:09.163609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166784+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:10:09.166784+0000","last_peered":"2023-10-18T11:10:09.166784+0000","last_clean":"2023-10-18T11:10:09.166784+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:10:09.166784+0000","last_undegraded":"2023-10-18T11:10:09.166784+0000","last_fullsized":"2023-10-18T11:10:09.166784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:34.071910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":725800,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.437},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.75},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29999999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.32400000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.34599999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":134940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.93700000000000006}]},{"osd":1,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.91200000000000003}]},{"osd":2,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79700000000000004}]},{"osd":4,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.32800000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.316},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.28299999999999997}]},{"osd":7,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.36199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":134976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.90100000000000002}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41699999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.752},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.315}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.36299999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40100000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":138691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.5219999999999998,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":1.071}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.157},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.6019999999999999,"5min":3.6019999999999999,"15min":3.6019999999999999},"last":0.755}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":1.266}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.242}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":1.212},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":3.661,"5min":3.661,"15min":3.661},"last":1.522}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.292},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":1.5529999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":134850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.024},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2869999999999999}]},{"osd":1,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.097},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.3959999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":1.7},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.466}]},{"osd":4,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.556,"5min":3.556,"15min":3.556},"last":1.3400000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.7069999999999999,"5min":3.7069999999999999,"15min":3.7069999999999999},"last":1.496},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":4.0209999999999999,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":1.5369999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":1.593}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":135010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.232}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.302},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":1.1120000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.4590000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.4199999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":3.2040000000000002,"5min":3.2040000000000002,"15min":3.2040000000000002},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.385}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.544},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.7330000000000001,"5min":2.7330000000000001,"15min":2.7330000000000001},"last":1.5189999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":725856,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.0169999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.877},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.4870000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.409}]},{"osd":4,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.355}]},{"osd":5,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.137}]},{"osd":6,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.8740000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.764},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.454}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":138691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.53300000000000003}]},{"osd":1,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.52400000000000002}]},{"osd":3,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.63900000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.27900000000000003}]},{"osd":5,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.33500000000000002}]},{"osd":7,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.312},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.32200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:10:25.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:10:25.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.748+0000 7fa31dbd7640 1 Processor -- start 2023-10-18T11:10:25.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.748+0000 7fa31dbd7640 1 -- start start 2023-10-18T11:10:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.750+0000 7fa31dbd7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa3180c57a0 0x7fa318157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.750+0000 7fa31dbd7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180c6820 con 0x7fa318150ec0 2023-10-18T11:10:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.750+0000 7fa31dbd7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180c6b00 con 0x7fa3180c5080 2023-10-18T11:10:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.750+0000 7fa31dbd7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180c3b00 con 0x7fa3180c57a0 2023-10-18T11:10:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.751+0000 7fa3177fe640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa318150ec0 0x7fa31806d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:59788/0 (socket says 172.21.15.151:59788) 2023-10-18T11:10:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.751+0000 7fa3177fe640 1 -- 172.21.15.151:0/1603715251 learned_addr learned my addr 172.21.15.151:0/1603715251 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.751+0000 7fa30effd640 1 --2- 172.21.15.151:0/1603715251 >> v2:172.21.15.169:3300/0 conn(0x7fa3180c57a0 0x7fa318157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:25.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.754+0000 7fa316ffd640 1 -- 172.21.15.151:0/1603715251 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068865994 0 0) 0x7fa3180c6820 con 0x7fa318150ec0 2023-10-18T11:10:25.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.754+0000 7fa316ffd640 1 -- 172.21.15.151:0/1603715251 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa304003520 con 0x7fa318150ec0 2023-10-18T11:10:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.755+0000 7fa316ffd640 1 -- 172.21.15.151:0/1603715251 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030048243 0 0) 0x7fa3180c6b00 con 0x7fa3180c5080 2023-10-18T11:10:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.755+0000 7fa316ffd640 1 -- 172.21.15.151:0/1603715251 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3180c6820 con 0x7fa3180c5080 2023-10-18T11:10:25.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.756+0000 7fa30effd640 1 -- 172.21.15.151:0/1603715251 >> v1:172.21.15.169:6789/0 conn(0x7fa3180c5080 legacy=0x7fa31815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:25.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.756+0000 7fa30effd640 1 -- 172.21.15.151:0/1603715251 >> v1:172.21.15.151:6789/0 conn(0x7fa318150ec0 legacy=0x7fa31806d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:25.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.756+0000 7fa30effd640 1 -- 172.21.15.151:0/1603715251 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180c1ab0 con 0x7fa3180c57a0 2023-10-18T11:10:25.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.764+0000 7fa30effd640 1 --2- 172.21.15.151:0/1603715251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3180c57a0 0x7fa318157790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa3000097a0 tx=0x7fa30002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ed68d7b346dc86 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:25.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.768+0000 7fa316ffd640 1 -- 172.21.15.151:0/1603715251 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300030610 con 0x7fa3180c57a0 2023-10-18T11:10:25.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.768+0000 7fa316ffd640 1 -- 172.21.15.151:0/1603715251 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa300030770 con 0x7fa3180c57a0 2023-10-18T11:10:25.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.768+0000 7fa316ffd640 1 -- 172.21.15.151:0/1603715251 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300030b00 con 0x7fa3180c57a0 2023-10-18T11:10:25.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.769+0000 7fa31dbd7640 1 -- 172.21.15.151:0/1603715251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3180c57a0 msgr2=0x7fa318157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:25.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.769+0000 7fa31dbd7640 1 --2- 172.21.15.151:0/1603715251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3180c57a0 0x7fa318157790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa3000097a0 tx=0x7fa30002b960 comp rx=0 tx=0).stop 2023-10-18T11:10:25.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.769+0000 7fa31dbd7640 1 -- 172.21.15.151:0/1603715251 shutdown_connections 2023-10-18T11:10:25.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.769+0000 7fa31dbd7640 1 --2- 172.21.15.151:0/1603715251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3180c57a0 0x7fa318157790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:25.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.769+0000 7fa31dbd7640 1 -- 172.21.15.151:0/1603715251 >> 172.21.15.151:0/1603715251 conn(0x7fa3180c6f10 msgr2=0x7fa3180c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:25.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.769+0000 7fa31dbd7640 1 -- 172.21.15.151:0/1603715251 shutdown_connections 2023-10-18T11:10:25.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.770+0000 7fa31dbd7640 1 -- 172.21.15.151:0/1603715251 wait complete. 2023-10-18T11:10:25.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.771+0000 7fa31dbd7640 1 Processor -- start 2023-10-18T11:10:25.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.772+0000 7fa31dbd7640 1 -- start start 2023-10-18T11:10:25.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.773+0000 7fa31dbd7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3180c5080 0x7fa3181564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:25.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.773+0000 7fa31dbd7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3180c57a0 0x7fa3180c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:25.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.773+0000 7fa31dbd7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa318150ec0 0x7fa318155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:25.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.773+0000 7fa31dbd7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3181418e0 con 0x7fa3180c5080 2023-10-18T11:10:25.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.773+0000 7fa31dbd7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3181f2020 con 0x7fa318150ec0 2023-10-18T11:10:25.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.773+0000 7fa31dbd7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3181f2e80 con 0x7fa3180c57a0 2023-10-18T11:10:25.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.773+0000 7fa317fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa318150ec0 0x7fa318155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:25.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.773+0000 7fa30effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3180c57a0 0x7fa3180c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:25.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.773+0000 7fa3177fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3180c5080 0x7fa3181564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:25.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.774+0000 7fa317fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa318150ec0 0x7fa318155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36742/0 (socket says 172.21.15.151:36742) 2023-10-18T11:10:25.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.774+0000 7fa317fff640 1 -- 172.21.15.151:0/3498862993 learned_addr learned my addr 172.21.15.151:0/3498862993 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:25.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.777+0000 7fa317fff640 1 -- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3180c57a0 msgr2=0x7fa3180c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:25.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.777+0000 7fa317fff640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3180c57a0 0x7fa3180c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:25.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.777+0000 7fa317fff640 1 -- 172.21.15.151:0/3498862993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3180c5080 msgr2=0x7fa3181564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:25.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.777+0000 7fa317fff640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3180c5080 0x7fa3181564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:25.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.777+0000 7fa317fff640 1 -- 172.21.15.151:0/3498862993 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300009400 con 0x7fa318150ec0 2023-10-18T11:10:25.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.779+0000 7fa317fff640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa318150ec0 0x7fa318155a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c430 tx=0x7fa31000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:25.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.782+0000 7fa314ff9640 1 -- 172.21.15.151:0/3498862993 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100052d0 con 0x7fa318150ec0 2023-10-18T11:10:25.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.782+0000 7fa314ff9640 1 -- 172.21.15.151:0/3498862993 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310005430 con 0x7fa318150ec0 2023-10-18T11:10:25.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.782+0000 7fa314ff9640 1 -- 172.21.15.151:0/3498862993 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100037f0 con 0x7fa318150ec0 2023-10-18T11:10:25.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.782+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3181f2270 con 0x7fa318150ec0 2023-10-18T11:10:25.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.783+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3181f2830 con 0x7fa318150ec0 2023-10-18T11:10:25.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.784+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3181eeab0 con 0x7fa318150ec0 2023-10-18T11:10:25.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.802+0000 7fa314ff9640 1 -- 172.21.15.151:0/3498862993 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa310003950 con 0x7fa318150ec0 2023-10-18T11:10:25.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.804+0000 7fa314ff9640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa2f806aec0 0x7fa2f806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:25.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.804+0000 7fa3177fe640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa2f806aec0 0x7fa2f806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:25.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.805+0000 7fa314ff9640 1 -- 172.21.15.151:0/3498862993 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa310057e00 con 0x7fa318150ec0 2023-10-18T11:10:25.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:25.805+0000 7fa3177fe640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa2f806aec0 0x7fa2f806d380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa3080012e0 tx=0x7fa3080019f0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:26.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.051+0000 7fa314ff9640 1 -- 172.21.15.151:0/3498862993 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa310054140 con 0x7fa318150ec0 2023-10-18T11:10:26.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.247+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3180c2070 con 0x7fa2f806aec0 2023-10-18T11:10:26.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.258+0000 7fa314ff9640 1 -- 172.21.15.151:0/3498862993 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368072 (secure 0 0 0) 0x7fa308001ec0 con 0x7fa2f806aec0 2023-10-18T11:10:26.262 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:26.268 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:10:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa2f806aec0 msgr2=0x7fa2f806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa2f806aec0 0x7fa2f806d380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa3080012e0 tx=0x7fa3080019f0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa318150ec0 msgr2=0x7fa318155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa318150ec0 0x7fa318155a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c430 tx=0x7fa31000c8f0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 shutdown_connections 2023-10-18T11:10:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa2f806aec0 0x7fa2f806d380 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa318150ec0 0x7fa318155a30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3180c57a0 0x7fa3180c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 --2- 172.21.15.151:0/3498862993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3180c5080 0x7fa3181564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.267+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 >> 172.21.15.151:0/3498862993 conn(0x7fa3180c6f10 msgr2=0x7fa31814f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:26.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.268+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 shutdown_connections 2023-10-18T11:10:26.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.268+0000 7fa31dbd7640 1 -- 172.21.15.151:0/3498862993 wait complete. 2023-10-18T11:10:26.289 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-10-18T11:10:26.200683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596413,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":247,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218960,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2899968,"data_stored":2271626,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002705"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176454+0000","last_change":"2023-10-18T11:09:36.796784+0000","last_active":"2023-10-18T11:10:09.176454+0000","last_peered":"2023-10-18T11:10:09.176454+0000","last_clean":"2023-10-18T11:10:09.176454+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:10:09.176454+0000","last_undegraded":"2023-10-18T11:10:09.176454+0000","last_fullsized":"2023-10-18T11:10:09.176454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.181907+0000","last_change":"2023-10-18T11:09:39.421701+0000","last_active":"2023-10-18T11:10:09.181907+0000","last_peered":"2023-10-18T11:10:09.181907+0000","last_clean":"2023-10-18T11:10:09.181907+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:10:09.181907+0000","last_undegraded":"2023-10-18T11:10:09.181907+0000","last_fullsized":"2023-10-18T11:10:09.181907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179158+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:10:09.179158+0000","last_peered":"2023-10-18T11:10:09.179158+0000","last_clean":"2023-10-18T11:10:09.179158+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:10:09.179158+0000","last_undegraded":"2023-10-18T11:10:09.179158+0000","last_fullsized":"2023-10-18T11:10:09.179158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182224+0000","last_change":"2023-10-18T11:09:36.909894+0000","last_active":"2023-10-18T11:10:09.182224+0000","last_peered":"2023-10-18T11:10:09.182224+0000","last_clean":"2023-10-18T11:10:09.182224+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:10:09.182224+0000","last_undegraded":"2023-10-18T11:10:09.182224+0000","last_fullsized":"2023-10-18T11:10:09.182224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176067+0000","last_change":"2023-10-18T11:09:39.363102+0000","last_active":"2023-10-18T11:10:09.176067+0000","last_peered":"2023-10-18T11:10:09.176067+0000","last_clean":"2023-10-18T11:10:09.176067+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:10:09.176067+0000","last_undegraded":"2023-10-18T11:10:09.176067+0000","last_fullsized":"2023-10-18T11:10:09.176067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168922+0000","last_change":"2023-10-18T11:09:46.109981+0000","last_active":"2023-10-18T11:10:09.168922+0000","last_peered":"2023-10-18T11:10:09.168922+0000","last_clean":"2023-10-18T11:10:09.168922+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:10:09.168922+0000","last_undegraded":"2023-10-18T11:10:09.168922+0000","last_fullsized":"2023-10-18T11:10:09.168922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:26.971949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167340+0000","last_change":"2023-10-18T11:09:36.896708+0000","last_active":"2023-10-18T11:10:09.167340+0000","last_peered":"2023-10-18T11:10:09.167340+0000","last_clean":"2023-10-18T11:10:09.167340+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:10:09.167340+0000","last_undegraded":"2023-10-18T11:10:09.167340+0000","last_fullsized":"2023-10-18T11:10:09.167340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171648+0000","last_change":"2023-10-18T11:09:39.397225+0000","last_active":"2023-10-18T11:10:09.171648+0000","last_peered":"2023-10-18T11:10:09.171648+0000","last_clean":"2023-10-18T11:10:09.171648+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:10:09.171648+0000","last_undegraded":"2023-10-18T11:10:09.171648+0000","last_fullsized":"2023-10-18T11:10:09.171648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169423+0000","last_change":"2023-10-18T11:09:46.114798+0000","last_active":"2023-10-18T11:10:09.169423+0000","last_peered":"2023-10-18T11:10:09.169423+0000","last_clean":"2023-10-18T11:10:09.169423+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:10:09.169423+0000","last_undegraded":"2023-10-18T11:10:09.169423+0000","last_fullsized":"2023-10-18T11:10:09.169423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:57.280120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166779+0000","last_change":"2023-10-18T11:09:36.795004+0000","last_active":"2023-10-18T11:10:09.166779+0000","last_peered":"2023-10-18T11:10:09.166779+0000","last_clean":"2023-10-18T11:10:09.166779+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:10:09.166779+0000","last_undegraded":"2023-10-18T11:10:09.166779+0000","last_fullsized":"2023-10-18T11:10:09.166779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171988+0000","last_change":"2023-10-18T11:09:39.398621+0000","last_active":"2023-10-18T11:10:09.171988+0000","last_peered":"2023-10-18T11:10:09.171988+0000","last_clean":"2023-10-18T11:10:09.171988+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:10:09.171988+0000","last_undegraded":"2023-10-18T11:10:09.171988+0000","last_fullsized":"2023-10-18T11:10:09.171988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169095+0000","last_change":"2023-10-18T11:09:46.115280+0000","last_active":"2023-10-18T11:10:09.169095+0000","last_peered":"2023-10-18T11:10:09.169095+0000","last_clean":"2023-10-18T11:10:09.169095+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:10:09.169095+0000","last_undegraded":"2023-10-18T11:10:09.169095+0000","last_fullsized":"2023-10-18T11:10:09.169095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:26.647416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165312+0000","last_change":"2023-10-18T11:09:39.397253+0000","last_active":"2023-10-18T11:10:09.165312+0000","last_peered":"2023-10-18T11:10:09.165312+0000","last_clean":"2023-10-18T11:10:09.165312+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:10:09.165312+0000","last_undegraded":"2023-10-18T11:10:09.165312+0000","last_fullsized":"2023-10-18T11:10:09.165312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.424298+0000","last_change":"2023-10-18T11:09:36.893066+0000","last_active":"2023-10-18T11:10:21.424298+0000","last_peered":"2023-10-18T11:10:21.424298+0000","last_clean":"2023-10-18T11:10:21.424298+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:10:21.424298+0000","last_undegraded":"2023-10-18T11:10:21.424298+0000","last_fullsized":"2023-10-18T11:10:21.424298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:32.587464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169855+0000","last_change":"2023-10-18T11:09:46.096113+0000","last_active":"2023-10-18T11:10:09.169855+0000","last_peered":"2023-10-18T11:10:09.169855+0000","last_clean":"2023-10-18T11:10:09.169855+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:10:09.169855+0000","last_undegraded":"2023-10-18T11:10:09.169855+0000","last_fullsized":"2023-10-18T11:10:09.169855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:09.971210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.180886+0000","last_change":"2023-10-18T11:09:39.423651+0000","last_active":"2023-10-18T11:10:09.180886+0000","last_peered":"2023-10-18T11:10:09.180886+0000","last_clean":"2023-10-18T11:10:09.180886+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:10:09.180886+0000","last_undegraded":"2023-10-18T11:10:09.180886+0000","last_fullsized":"2023-10-18T11:10:09.180886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161718+0000","last_change":"2023-10-18T11:09:36.913611+0000","last_active":"2023-10-18T11:10:09.161718+0000","last_peered":"2023-10-18T11:10:09.161718+0000","last_clean":"2023-10-18T11:10:09.161718+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:10:09.161718+0000","last_undegraded":"2023-10-18T11:10:09.161718+0000","last_fullsized":"2023-10-18T11:10:09.161718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169776+0000","last_change":"2023-10-18T11:09:46.114729+0000","last_active":"2023-10-18T11:10:09.169776+0000","last_peered":"2023-10-18T11:10:09.169776+0000","last_clean":"2023-10-18T11:10:09.169776+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:10:09.169776+0000","last_undegraded":"2023-10-18T11:10:09.169776+0000","last_fullsized":"2023-10-18T11:10:09.169776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:50.156790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178636+0000","last_change":"2023-10-18T11:09:39.420146+0000","last_active":"2023-10-18T11:10:09.178636+0000","last_peered":"2023-10-18T11:10:09.178636+0000","last_clean":"2023-10-18T11:10:09.178636+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:10:09.178636+0000","last_undegraded":"2023-10-18T11:10:09.178636+0000","last_fullsized":"2023-10-18T11:10:09.178636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.678218+0000","last_change":"2023-10-18T11:09:36.915198+0000","last_active":"2023-10-18T11:10:21.678218+0000","last_peered":"2023-10-18T11:10:21.678218+0000","last_clean":"2023-10-18T11:10:21.678218+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:10:21.678218+0000","last_undegraded":"2023-10-18T11:10:21.678218+0000","last_fullsized":"2023-10-18T11:10:21.678218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:18.429550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.416467+0000","last_change":"2023-10-18T11:10:10.413988+0000","last_active":"2023-10-18T11:10:10.416467+0000","last_peered":"2023-10-18T11:10:10.416467+0000","last_clean":"2023-10-18T11:10:10.416467+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:10:10.416467+0000","last_undegraded":"2023-10-18T11:10:10.416467+0000","last_fullsized":"2023-10-18T11:10:10.416467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169153+0000","last_change":"2023-10-18T11:09:39.399181+0000","last_active":"2023-10-18T11:10:09.169153+0000","last_peered":"2023-10-18T11:10:09.169153+0000","last_clean":"2023-10-18T11:10:09.169153+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:10:09.169153+0000","last_undegraded":"2023-10-18T11:10:09.169153+0000","last_fullsized":"2023-10-18T11:10:09.169153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:13.349921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.425764+0000","last_change":"2023-10-18T11:09:36.797637+0000","last_active":"2023-10-18T11:10:21.425764+0000","last_peered":"2023-10-18T11:10:21.425764+0000","last_clean":"2023-10-18T11:10:21.425764+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:10:21.425764+0000","last_undegraded":"2023-10-18T11:10:21.425764+0000","last_fullsized":"2023-10-18T11:10:21.425764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:08.109221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169728+0000","last_change":"2023-10-18T11:09:46.109408+0000","last_active":"2023-10-18T11:10:09.169728+0000","last_peered":"2023-10-18T11:10:09.169728+0000","last_clean":"2023-10-18T11:10:09.169728+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:10:09.169728+0000","last_undegraded":"2023-10-18T11:10:09.169728+0000","last_fullsized":"2023-10-18T11:10:09.169728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.174070+0000","last_change":"2023-10-18T11:09:39.366234+0000","last_active":"2023-10-18T11:10:09.174070+0000","last_peered":"2023-10-18T11:10:09.174070+0000","last_clean":"2023-10-18T11:10:09.174070+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:10:09.174070+0000","last_undegraded":"2023-10-18T11:10:09.174070+0000","last_fullsized":"2023-10-18T11:10:09.174070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.654804+0000","last_change":"2023-10-18T11:09:36.896533+0000","last_active":"2023-10-18T11:10:21.654804+0000","last_peered":"2023-10-18T11:10:21.654804+0000","last_clean":"2023-10-18T11:10:21.654804+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:10:21.654804+0000","last_undegraded":"2023-10-18T11:10:21.654804+0000","last_fullsized":"2023-10-18T11:10:21.654804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168970+0000","last_change":"2023-10-18T11:09:46.094196+0000","last_active":"2023-10-18T11:10:09.168970+0000","last_peered":"2023-10-18T11:10:09.168970+0000","last_clean":"2023-10-18T11:10:09.168970+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:10:09.168970+0000","last_undegraded":"2023-10-18T11:10:09.168970+0000","last_fullsized":"2023-10-18T11:10:09.168970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:43.456989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182246+0000","last_change":"2023-10-18T11:09:39.420016+0000","last_active":"2023-10-18T11:10:09.182246+0000","last_peered":"2023-10-18T11:10:09.182246+0000","last_clean":"2023-10-18T11:10:09.182246+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:10:09.182246+0000","last_undegraded":"2023-10-18T11:10:09.182246+0000","last_fullsized":"2023-10-18T11:10:09.182246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163703+0000","last_change":"2023-10-18T11:09:36.913659+0000","last_active":"2023-10-18T11:10:09.163703+0000","last_peered":"2023-10-18T11:10:09.163703+0000","last_clean":"2023-10-18T11:10:09.163703+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:10:09.163703+0000","last_undegraded":"2023-10-18T11:10:09.163703+0000","last_fullsized":"2023-10-18T11:10:09.163703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179764+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:10:09.179764+0000","last_peered":"2023-10-18T11:10:09.179764+0000","last_clean":"2023-10-18T11:10:09.179764+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:10:09.179764+0000","last_undegraded":"2023-10-18T11:10:09.179764+0000","last_fullsized":"2023-10-18T11:10:09.179764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162384+0000","last_change":"2023-10-18T11:09:39.243607+0000","last_active":"2023-10-18T11:10:09.162384+0000","last_peered":"2023-10-18T11:10:09.162384+0000","last_clean":"2023-10-18T11:10:09.162384+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:10:09.162384+0000","last_undegraded":"2023-10-18T11:10:09.162384+0000","last_fullsized":"2023-10-18T11:10:09.162384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.398864+0000","last_change":"2023-10-18T11:09:36.798396+0000","last_active":"2023-10-18T11:10:10.398864+0000","last_peered":"2023-10-18T11:10:10.398864+0000","last_clean":"2023-10-18T11:10:10.398864+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:10:10.398864+0000","last_undegraded":"2023-10-18T11:10:10.398864+0000","last_fullsized":"2023-10-18T11:10:10.398864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:04.311252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177625+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:10:09.177625+0000","last_peered":"2023-10-18T11:10:09.177625+0000","last_clean":"2023-10-18T11:10:09.177625+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:10:09.177625+0000","last_undegraded":"2023-10-18T11:10:09.177625+0000","last_fullsized":"2023-10-18T11:10:09.177625+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.172014+0000","last_change":"2023-10-18T11:09:39.417304+0000","last_active":"2023-10-18T11:10:09.172014+0000","last_peered":"2023-10-18T11:10:09.172014+0000","last_clean":"2023-10-18T11:10:09.172014+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:10:09.172014+0000","last_undegraded":"2023-10-18T11:10:09.172014+0000","last_fullsized":"2023-10-18T11:10:09.172014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162464+0000","last_change":"2023-10-18T11:09:36.909623+0000","last_active":"2023-10-18T11:10:09.162464+0000","last_peered":"2023-10-18T11:10:09.162464+0000","last_clean":"2023-10-18T11:10:09.162464+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:10:09.162464+0000","last_undegraded":"2023-10-18T11:10:09.162464+0000","last_fullsized":"2023-10-18T11:10:09.162464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161364+0000","last_change":"2023-10-18T11:09:46.100735+0000","last_active":"2023-10-18T11:10:09.161364+0000","last_peered":"2023-10-18T11:10:09.161364+0000","last_clean":"2023-10-18T11:10:09.161364+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:10:09.161364+0000","last_undegraded":"2023-10-18T11:10:09.161364+0000","last_fullsized":"2023-10-18T11:10:09.161364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169573+0000","last_change":"2023-10-18T11:09:39.400602+0000","last_active":"2023-10-18T11:10:09.169573+0000","last_peered":"2023-10-18T11:10:09.169573+0000","last_clean":"2023-10-18T11:10:09.169573+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:10:09.169573+0000","last_undegraded":"2023-10-18T11:10:09.169573+0000","last_fullsized":"2023-10-18T11:10:09.169573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:37.020893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171903+0000","last_change":"2023-10-18T11:09:36.915028+0000","last_active":"2023-10-18T11:10:09.171903+0000","last_peered":"2023-10-18T11:10:09.171903+0000","last_clean":"2023-10-18T11:10:09.171903+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:10:09.171903+0000","last_undegraded":"2023-10-18T11:10:09.171903+0000","last_fullsized":"2023-10-18T11:10:09.171903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162244+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:10:09.162244+0000","last_peered":"2023-10-18T11:10:09.162244+0000","last_clean":"2023-10-18T11:10:09.162244+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:10:09.162244+0000","last_undegraded":"2023-10-18T11:10:09.162244+0000","last_fullsized":"2023-10-18T11:10:09.162244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161140+0000","last_change":"2023-10-18T11:09:39.243829+0000","last_active":"2023-10-18T11:10:09.161140+0000","last_peered":"2023-10-18T11:10:09.161140+0000","last_clean":"2023-10-18T11:10:09.161140+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:10:09.161140+0000","last_undegraded":"2023-10-18T11:10:09.161140+0000","last_fullsized":"2023-10-18T11:10:09.161140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.383293+0000","last_change":"2023-10-18T11:09:36.910270+0000","last_active":"2023-10-18T11:10:10.383293+0000","last_peered":"2023-10-18T11:10:10.383293+0000","last_clean":"2023-10-18T11:10:10.383293+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:10:10.383293+0000","last_undegraded":"2023-10-18T11:10:10.383293+0000","last_fullsized":"2023-10-18T11:10:10.383293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163801+0000","last_change":"2023-10-18T11:09:46.114610+0000","last_active":"2023-10-18T11:10:09.163801+0000","last_peered":"2023-10-18T11:10:09.163801+0000","last_clean":"2023-10-18T11:10:09.163801+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:10:09.163801+0000","last_undegraded":"2023-10-18T11:10:09.163801+0000","last_fullsized":"2023-10-18T11:10:09.163801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177327+0000","last_change":"2023-10-18T11:09:39.404210+0000","last_active":"2023-10-18T11:10:09.177327+0000","last_peered":"2023-10-18T11:10:09.177327+0000","last_clean":"2023-10-18T11:10:09.177327+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:10:09.177327+0000","last_undegraded":"2023-10-18T11:10:09.177327+0000","last_fullsized":"2023-10-18T11:10:09.177327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.398728+0000","last_change":"2023-10-18T11:09:36.913804+0000","last_active":"2023-10-18T11:10:10.398728+0000","last_peered":"2023-10-18T11:10:10.398728+0000","last_clean":"2023-10-18T11:10:10.398728+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:10:10.398728+0000","last_undegraded":"2023-10-18T11:10:10.398728+0000","last_fullsized":"2023-10-18T11:10:10.398728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173920+0000","last_change":"2023-10-18T11:09:46.092566+0000","last_active":"2023-10-18T11:10:09.173920+0000","last_peered":"2023-10-18T11:10:09.173920+0000","last_clean":"2023-10-18T11:10:09.173920+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:10:09.173920+0000","last_undegraded":"2023-10-18T11:10:09.173920+0000","last_fullsized":"2023-10-18T11:10:09.173920+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:42.848835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178796+0000","last_change":"2023-10-18T11:09:39.422507+0000","last_active":"2023-10-18T11:10:09.178796+0000","last_peered":"2023-10-18T11:10:09.178796+0000","last_clean":"2023-10-18T11:10:09.178796+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:10:09.178796+0000","last_undegraded":"2023-10-18T11:10:09.178796+0000","last_fullsized":"2023-10-18T11:10:09.178796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.440637+0000","last_change":"2023-10-18T11:09:36.828474+0000","last_active":"2023-10-18T11:10:21.440637+0000","last_peered":"2023-10-18T11:10:21.440637+0000","last_clean":"2023-10-18T11:10:21.440637+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:10:21.440637+0000","last_undegraded":"2023-10-18T11:10:21.440637+0000","last_fullsized":"2023-10-18T11:10:21.440637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166583+0000","last_change":"2023-10-18T11:09:19.365660+0000","last_active":"2023-10-18T11:10:09.166583+0000","last_peered":"2023-10-18T11:10:09.166583+0000","last_clean":"2023-10-18T11:10:09.166583+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:10:09.166583+0000","last_undegraded":"2023-10-18T11:10:09.166583+0000","last_fullsized":"2023-10-18T11:10:09.166583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_clean_scrub_stamp":"2023-10-18T11:09:17.711667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:34:53.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164849+0000","last_change":"2023-10-18T11:09:46.118571+0000","last_active":"2023-10-18T11:10:09.164849+0000","last_peered":"2023-10-18T11:10:09.164849+0000","last_clean":"2023-10-18T11:10:09.164849+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:10:09.164849+0000","last_undegraded":"2023-10-18T11:10:09.164849+0000","last_fullsized":"2023-10-18T11:10:09.164849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:46.781070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166799+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:10:09.166799+0000","last_peered":"2023-10-18T11:10:09.166799+0000","last_clean":"2023-10-18T11:10:09.166799+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:10:09.166799+0000","last_undegraded":"2023-10-18T11:10:09.166799+0000","last_fullsized":"2023-10-18T11:10:09.166799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.145112+0000","last_change":"2023-10-18T11:09:36.829100+0000","last_active":"2023-10-18T11:10:09.145112+0000","last_peered":"2023-10-18T11:10:09.145112+0000","last_clean":"2023-10-18T11:10:09.145112+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:10:09.145112+0000","last_undegraded":"2023-10-18T11:10:09.145112+0000","last_fullsized":"2023-10-18T11:10:09.145112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.418740+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:10:10.418740+0000","last_peered":"2023-10-18T11:10:10.418740+0000","last_clean":"2023-10-18T11:10:10.418740+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:10:10.418740+0000","last_undegraded":"2023-10-18T11:10:10.418740+0000","last_fullsized":"2023-10-18T11:10:10.418740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171728+0000","last_change":"2023-10-18T11:09:39.419862+0000","last_active":"2023-10-18T11:10:09.171728+0000","last_peered":"2023-10-18T11:10:09.171728+0000","last_clean":"2023-10-18T11:10:09.171728+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:10:09.171728+0000","last_undegraded":"2023-10-18T11:10:09.171728+0000","last_fullsized":"2023-10-18T11:10:09.171728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163080+0000","last_change":"2023-10-18T11:09:36.912905+0000","last_active":"2023-10-18T11:10:09.163080+0000","last_peered":"2023-10-18T11:10:09.163080+0000","last_clean":"2023-10-18T11:10:09.163080+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:10:09.163080+0000","last_undegraded":"2023-10-18T11:10:09.163080+0000","last_fullsized":"2023-10-18T11:10:09.163080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177785+0000","last_change":"2023-10-18T11:09:46.097744+0000","last_active":"2023-10-18T11:10:09.177785+0000","last_peered":"2023-10-18T11:10:09.177785+0000","last_clean":"2023-10-18T11:10:09.177785+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:10:09.177785+0000","last_undegraded":"2023-10-18T11:10:09.177785+0000","last_fullsized":"2023-10-18T11:10:09.177785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:20.073279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167753+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:10:09.167753+0000","last_peered":"2023-10-18T11:10:09.167753+0000","last_clean":"2023-10-18T11:10:09.167753+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:10:09.167753+0000","last_undegraded":"2023-10-18T11:10:09.167753+0000","last_fullsized":"2023-10-18T11:10:09.167753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:51.220855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.145622+0000","last_change":"2023-10-18T11:09:36.907280+0000","last_active":"2023-10-18T11:10:09.145622+0000","last_peered":"2023-10-18T11:10:09.145622+0000","last_clean":"2023-10-18T11:10:09.145622+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:10:09.145622+0000","last_undegraded":"2023-10-18T11:10:09.145622+0000","last_fullsized":"2023-10-18T11:10:09.145622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171054+0000","last_change":"2023-10-18T11:09:46.096894+0000","last_active":"2023-10-18T11:10:09.171054+0000","last_peered":"2023-10-18T11:10:09.171054+0000","last_clean":"2023-10-18T11:10:09.171054+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:10:09.171054+0000","last_undegraded":"2023-10-18T11:10:09.171054+0000","last_fullsized":"2023-10-18T11:10:09.171054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167081+0000","last_change":"2023-10-18T11:09:39.399750+0000","last_active":"2023-10-18T11:10:09.167081+0000","last_peered":"2023-10-18T11:10:09.167081+0000","last_clean":"2023-10-18T11:10:09.167081+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:10:09.167081+0000","last_undegraded":"2023-10-18T11:10:09.167081+0000","last_fullsized":"2023-10-18T11:10:09.167081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:35.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169704+0000","last_change":"2023-10-18T11:09:36.897906+0000","last_active":"2023-10-18T11:10:09.169704+0000","last_peered":"2023-10-18T11:10:09.169704+0000","last_clean":"2023-10-18T11:10:09.169704+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:10:09.169704+0000","last_undegraded":"2023-10-18T11:10:09.169704+0000","last_fullsized":"2023-10-18T11:10:09.169704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:41:27.304152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168875+0000","last_change":"2023-10-18T11:09:46.109151+0000","last_active":"2023-10-18T11:10:09.168875+0000","last_peered":"2023-10-18T11:10:09.168875+0000","last_clean":"2023-10-18T11:10:09.168875+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:10:09.168875+0000","last_undegraded":"2023-10-18T11:10:09.168875+0000","last_fullsized":"2023-10-18T11:10:09.168875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:41.785820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166808+0000","last_change":"2023-10-18T11:09:39.397483+0000","last_active":"2023-10-18T11:10:09.166808+0000","last_peered":"2023-10-18T11:10:09.166808+0000","last_clean":"2023-10-18T11:10:09.166808+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:10:09.166808+0000","last_undegraded":"2023-10-18T11:10:09.166808+0000","last_fullsized":"2023-10-18T11:10:09.166808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.672902+0000","last_change":"2023-10-18T11:09:36.916080+0000","last_active":"2023-10-18T11:10:21.672902+0000","last_peered":"2023-10-18T11:10:21.672902+0000","last_clean":"2023-10-18T11:10:21.672902+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:10:21.672902+0000","last_undegraded":"2023-10-18T11:10:21.672902+0000","last_fullsized":"2023-10-18T11:10:21.672902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:22.058134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173831+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:10:09.173831+0000","last_peered":"2023-10-18T11:10:09.173831+0000","last_clean":"2023-10-18T11:10:09.173831+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:10:09.173831+0000","last_undegraded":"2023-10-18T11:10:09.173831+0000","last_fullsized":"2023-10-18T11:10:09.173831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164509+0000","last_change":"2023-10-18T11:09:39.358262+0000","last_active":"2023-10-18T11:10:09.164509+0000","last_peered":"2023-10-18T11:10:09.164509+0000","last_clean":"2023-10-18T11:10:09.164509+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:10:09.164509+0000","last_undegraded":"2023-10-18T11:10:09.164509+0000","last_fullsized":"2023-10-18T11:10:09.164509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164598+0000","last_change":"2023-10-18T11:09:36.893045+0000","last_active":"2023-10-18T11:10:09.164598+0000","last_peered":"2023-10-18T11:10:09.164598+0000","last_clean":"2023-10-18T11:10:09.164598+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:10:09.164598+0000","last_undegraded":"2023-10-18T11:10:09.164598+0000","last_fullsized":"2023-10-18T11:10:09.164598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182137+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:10:09.182137+0000","last_peered":"2023-10-18T11:10:09.182137+0000","last_clean":"2023-10-18T11:10:09.182137+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:10:09.182137+0000","last_undegraded":"2023-10-18T11:10:09.182137+0000","last_fullsized":"2023-10-18T11:10:09.182137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:27.567970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167151+0000","last_change":"2023-10-18T11:09:39.399188+0000","last_active":"2023-10-18T11:10:09.167151+0000","last_peered":"2023-10-18T11:10:09.167151+0000","last_clean":"2023-10-18T11:10:09.167151+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:10:09.167151+0000","last_undegraded":"2023-10-18T11:10:09.167151+0000","last_fullsized":"2023-10-18T11:10:09.167151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.438148+0000","last_change":"2023-10-18T11:09:36.905576+0000","last_active":"2023-10-18T11:10:21.438148+0000","last_peered":"2023-10-18T11:10:21.438148+0000","last_clean":"2023-10-18T11:10:21.438148+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:10:21.438148+0000","last_undegraded":"2023-10-18T11:10:21.438148+0000","last_fullsized":"2023-10-18T11:10:21.438148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179319+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:10:09.179319+0000","last_peered":"2023-10-18T11:10:09.179319+0000","last_clean":"2023-10-18T11:10:09.179319+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:10:09.179319+0000","last_undegraded":"2023-10-18T11:10:09.179319+0000","last_fullsized":"2023-10-18T11:10:09.179319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:47.871773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.174065+0000","last_change":"2023-10-18T11:09:39.361805+0000","last_active":"2023-10-18T11:10:09.174065+0000","last_peered":"2023-10-18T11:10:09.174065+0000","last_clean":"2023-10-18T11:10:09.174065+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:10:09.174065+0000","last_undegraded":"2023-10-18T11:10:09.174065+0000","last_fullsized":"2023-10-18T11:10:09.174065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.437575+0000","last_change":"2023-10-18T11:09:36.894141+0000","last_active":"2023-10-18T11:10:21.437575+0000","last_peered":"2023-10-18T11:10:21.437575+0000","last_clean":"2023-10-18T11:10:21.437575+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:10:21.437575+0000","last_undegraded":"2023-10-18T11:10:21.437575+0000","last_fullsized":"2023-10-18T11:10:21.437575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171913+0000","last_change":"2023-10-18T11:09:46.114944+0000","last_active":"2023-10-18T11:10:09.171913+0000","last_peered":"2023-10-18T11:10:09.171913+0000","last_clean":"2023-10-18T11:10:09.171913+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:10:09.171913+0000","last_undegraded":"2023-10-18T11:10:09.171913+0000","last_fullsized":"2023-10-18T11:10:09.171913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166923+0000","last_change":"2023-10-18T11:09:39.420430+0000","last_active":"2023-10-18T11:10:09.166923+0000","last_peered":"2023-10-18T11:10:09.166923+0000","last_clean":"2023-10-18T11:10:09.166923+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:10:09.166923+0000","last_undegraded":"2023-10-18T11:10:09.166923+0000","last_fullsized":"2023-10-18T11:10:09.166923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:12.994704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.657711+0000","last_change":"2023-10-18T11:09:36.904648+0000","last_active":"2023-10-18T11:10:21.657711+0000","last_peered":"2023-10-18T11:10:21.657711+0000","last_clean":"2023-10-18T11:10:21.657711+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:10:21.657711+0000","last_undegraded":"2023-10-18T11:10:21.657711+0000","last_fullsized":"2023-10-18T11:10:21.657711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161456+0000","last_change":"2023-10-18T11:09:46.101866+0000","last_active":"2023-10-18T11:10:09.161456+0000","last_peered":"2023-10-18T11:10:09.161456+0000","last_clean":"2023-10-18T11:10:09.161456+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:10:09.161456+0000","last_undegraded":"2023-10-18T11:10:09.161456+0000","last_fullsized":"2023-10-18T11:10:09.161456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:41.150485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169443+0000","last_change":"2023-10-18T11:09:39.398597+0000","last_active":"2023-10-18T11:10:09.169443+0000","last_peered":"2023-10-18T11:10:09.169443+0000","last_clean":"2023-10-18T11:10:09.169443+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:10:09.169443+0000","last_undegraded":"2023-10-18T11:10:09.169443+0000","last_fullsized":"2023-10-18T11:10:09.169443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:10.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.411141+0000","last_change":"2023-10-18T11:09:36.913285+0000","last_active":"2023-10-18T11:10:10.411141+0000","last_peered":"2023-10-18T11:10:10.411141+0000","last_clean":"2023-10-18T11:10:10.411141+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:10:10.411141+0000","last_undegraded":"2023-10-18T11:10:10.411141+0000","last_fullsized":"2023-10-18T11:10:10.411141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169273+0000","last_change":"2023-10-18T11:09:46.094205+0000","last_active":"2023-10-18T11:10:09.169273+0000","last_peered":"2023-10-18T11:10:09.169273+0000","last_clean":"2023-10-18T11:10:09.169273+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:10:09.169273+0000","last_undegraded":"2023-10-18T11:10:09.169273+0000","last_fullsized":"2023-10-18T11:10:09.169273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:13.509608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176274+0000","last_change":"2023-10-18T11:09:39.363739+0000","last_active":"2023-10-18T11:10:09.176274+0000","last_peered":"2023-10-18T11:10:09.176274+0000","last_clean":"2023-10-18T11:10:09.176274+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:10:09.176274+0000","last_undegraded":"2023-10-18T11:10:09.176274+0000","last_fullsized":"2023-10-18T11:10:09.176274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:52.069782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.434643+0000","last_change":"2023-10-18T11:09:36.896767+0000","last_active":"2023-10-18T11:10:21.434643+0000","last_peered":"2023-10-18T11:10:21.434643+0000","last_clean":"2023-10-18T11:10:21.434643+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:10:21.434643+0000","last_undegraded":"2023-10-18T11:10:21.434643+0000","last_fullsized":"2023-10-18T11:10:21.434643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178440+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:10:09.178440+0000","last_peered":"2023-10-18T11:10:09.178440+0000","last_clean":"2023-10-18T11:10:09.178440+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:10:09.178440+0000","last_undegraded":"2023-10-18T11:10:09.178440+0000","last_fullsized":"2023-10-18T11:10:09.178440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.172124+0000","last_change":"2023-10-18T11:09:39.351468+0000","last_active":"2023-10-18T11:10:09.172124+0000","last_peered":"2023-10-18T11:10:09.172124+0000","last_clean":"2023-10-18T11:10:09.172124+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:10:09.172124+0000","last_undegraded":"2023-10-18T11:10:09.172124+0000","last_fullsized":"2023-10-18T11:10:09.172124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.664449+0000","last_change":"2023-10-18T11:09:36.896596+0000","last_active":"2023-10-18T11:10:21.664449+0000","last_peered":"2023-10-18T11:10:21.664449+0000","last_clean":"2023-10-18T11:10:21.664449+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:10:21.664449+0000","last_undegraded":"2023-10-18T11:10:21.664449+0000","last_fullsized":"2023-10-18T11:10:21.664449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179254+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:10:09.179254+0000","last_peered":"2023-10-18T11:10:09.179254+0000","last_clean":"2023-10-18T11:10:09.179254+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:10:09.179254+0000","last_undegraded":"2023-10-18T11:10:09.179254+0000","last_fullsized":"2023-10-18T11:10:09.179254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.417214+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:10:10.417214+0000","last_peered":"2023-10-18T11:10:10.417214+0000","last_clean":"2023-10-18T11:10:10.417214+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:10:10.417214+0000","last_undegraded":"2023-10-18T11:10:10.417214+0000","last_fullsized":"2023-10-18T11:10:10.417214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:09.785576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161029+0000","last_change":"2023-10-18T11:09:39.418416+0000","last_active":"2023-10-18T11:10:09.161029+0000","last_peered":"2023-10-18T11:10:09.161029+0000","last_clean":"2023-10-18T11:10:09.161029+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:10:09.161029+0000","last_undegraded":"2023-10-18T11:10:09.161029+0000","last_fullsized":"2023-10-18T11:10:09.161029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.396031+0000","last_change":"2023-10-18T11:09:36.893158+0000","last_active":"2023-10-18T11:10:10.396031+0000","last_peered":"2023-10-18T11:10:10.396031+0000","last_clean":"2023-10-18T11:10:10.396031+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:10:10.396031+0000","last_undegraded":"2023-10-18T11:10:10.396031+0000","last_fullsized":"2023-10-18T11:10:10.396031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164789+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:10:09.164789+0000","last_peered":"2023-10-18T11:10:09.164789+0000","last_clean":"2023-10-18T11:10:09.164789+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:10:09.164789+0000","last_undegraded":"2023-10-18T11:10:09.164789+0000","last_fullsized":"2023-10-18T11:10:09.164789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178550+0000","last_change":"2023-10-18T11:09:39.421160+0000","last_active":"2023-10-18T11:10:09.178550+0000","last_peered":"2023-10-18T11:10:09.178550+0000","last_clean":"2023-10-18T11:10:09.178550+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:10:09.178550+0000","last_undegraded":"2023-10-18T11:10:09.178550+0000","last_fullsized":"2023-10-18T11:10:09.178550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179543+0000","last_change":"2023-10-18T11:09:36.911629+0000","last_active":"2023-10-18T11:10:09.179543+0000","last_peered":"2023-10-18T11:10:09.179543+0000","last_clean":"2023-10-18T11:10:09.179543+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:10:09.179543+0000","last_undegraded":"2023-10-18T11:10:09.179543+0000","last_fullsized":"2023-10-18T11:10:09.179543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:53.929992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165406+0000","last_change":"2023-10-18T11:09:36.894351+0000","last_active":"2023-10-18T11:10:09.165406+0000","last_peered":"2023-10-18T11:10:09.165406+0000","last_clean":"2023-10-18T11:10:09.165406+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:10:09.165406+0000","last_undegraded":"2023-10-18T11:10:09.165406+0000","last_fullsized":"2023-10-18T11:10:09.165406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:11.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.180784+0000","last_change":"2023-10-18T11:09:39.404508+0000","last_active":"2023-10-18T11:10:09.180784+0000","last_peered":"2023-10-18T11:10:09.180784+0000","last_clean":"2023-10-18T11:10:09.180784+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:10:09.180784+0000","last_undegraded":"2023-10-18T11:10:09.180784+0000","last_fullsized":"2023-10-18T11:10:09.180784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144886+0000","last_change":"2023-10-18T11:09:46.117246+0000","last_active":"2023-10-18T11:10:09.144886+0000","last_peered":"2023-10-18T11:10:09.144886+0000","last_clean":"2023-10-18T11:10:09.144886+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:10:09.144886+0000","last_undegraded":"2023-10-18T11:10:09.144886+0000","last_fullsized":"2023-10-18T11:10:09.144886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:59.808082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.474878+0000","last_change":"2023-10-18T11:09:36.912013+0000","last_active":"2023-10-18T11:10:21.474878+0000","last_peered":"2023-10-18T11:10:21.474878+0000","last_clean":"2023-10-18T11:10:21.474878+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:10:21.474878+0000","last_undegraded":"2023-10-18T11:10:21.474878+0000","last_fullsized":"2023-10-18T11:10:21.474878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:49.950001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169156+0000","last_change":"2023-10-18T11:09:39.400362+0000","last_active":"2023-10-18T11:10:09.169156+0000","last_peered":"2023-10-18T11:10:09.169156+0000","last_clean":"2023-10-18T11:10:09.169156+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:10:09.169156+0000","last_undegraded":"2023-10-18T11:10:09.169156+0000","last_fullsized":"2023-10-18T11:10:09.169156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:50.136754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182239+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:10:09.182239+0000","last_peered":"2023-10-18T11:10:09.182239+0000","last_clean":"2023-10-18T11:10:09.182239+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:10:09.182239+0000","last_undegraded":"2023-10-18T11:10:09.182239+0000","last_fullsized":"2023-10-18T11:10:09.182239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:52:09.414015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164430+0000","last_change":"2023-10-18T11:09:39.359747+0000","last_active":"2023-10-18T11:10:09.164430+0000","last_peered":"2023-10-18T11:10:09.164430+0000","last_clean":"2023-10-18T11:10:09.164430+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:10:09.164430+0000","last_undegraded":"2023-10-18T11:10:09.164430+0000","last_fullsized":"2023-10-18T11:10:09.164430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144846+0000","last_change":"2023-10-18T11:09:39.242600+0000","last_active":"2023-10-18T11:10:09.144846+0000","last_peered":"2023-10-18T11:10:09.144846+0000","last_clean":"2023-10-18T11:10:09.144846+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:10:09.144846+0000","last_undegraded":"2023-10-18T11:10:09.144846+0000","last_fullsized":"2023-10-18T11:10:09.144846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:45.076093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.419036+0000","last_change":"2023-10-18T11:10:10.416758+0000","last_active":"2023-10-18T11:10:10.419036+0000","last_peered":"2023-10-18T11:10:10.419036+0000","last_clean":"2023-10-18T11:10:10.419036+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:10:10.419036+0000","last_undegraded":"2023-10-18T11:10:10.419036+0000","last_fullsized":"2023-10-18T11:10:10.419036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177879+0000","last_change":"2023-10-18T11:09:39.425505+0000","last_active":"2023-10-18T11:10:09.177879+0000","last_peered":"2023-10-18T11:10:09.177879+0000","last_clean":"2023-10-18T11:10:09.177879+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:10:09.177879+0000","last_undegraded":"2023-10-18T11:10:09.177879+0000","last_fullsized":"2023-10-18T11:10:09.177879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179456+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:10:09.179456+0000","last_peered":"2023-10-18T11:10:09.179456+0000","last_clean":"2023-10-18T11:10:09.179456+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:10:09.179456+0000","last_undegraded":"2023-10-18T11:10:09.179456+0000","last_fullsized":"2023-10-18T11:10:09.179456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162742+0000","last_change":"2023-10-18T11:09:39.423043+0000","last_active":"2023-10-18T11:10:09.162742+0000","last_peered":"2023-10-18T11:10:09.162742+0000","last_clean":"2023-10-18T11:10:09.162742+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:10:09.162742+0000","last_undegraded":"2023-10-18T11:10:09.162742+0000","last_fullsized":"2023-10-18T11:10:09.162742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165107+0000","last_change":"2023-10-18T11:09:39.351604+0000","last_active":"2023-10-18T11:10:09.165107+0000","last_peered":"2023-10-18T11:10:09.165107+0000","last_clean":"2023-10-18T11:10:09.165107+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:10:09.165107+0000","last_undegraded":"2023-10-18T11:10:09.165107+0000","last_fullsized":"2023-10-18T11:10:09.165107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182241+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:10:09.182241+0000","last_peered":"2023-10-18T11:10:09.182241+0000","last_clean":"2023-10-18T11:10:09.182241+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:10:09.182241+0000","last_undegraded":"2023-10-18T11:10:09.182241+0000","last_fullsized":"2023-10-18T11:10:09.182241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171269+0000","last_change":"2023-10-18T11:09:39.419909+0000","last_active":"2023-10-18T11:10:09.171269+0000","last_peered":"2023-10-18T11:10:09.171269+0000","last_clean":"2023-10-18T11:10:09.171269+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:10:09.171269+0000","last_undegraded":"2023-10-18T11:10:09.171269+0000","last_fullsized":"2023-10-18T11:10:09.171269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179397+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:10:09.179397+0000","last_peered":"2023-10-18T11:10:09.179397+0000","last_clean":"2023-10-18T11:10:09.179397+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:10:09.179397+0000","last_undegraded":"2023-10-18T11:10:09.179397+0000","last_fullsized":"2023-10-18T11:10:09.179397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171348+0000","last_change":"2023-10-18T11:09:39.349250+0000","last_active":"2023-10-18T11:10:09.171348+0000","last_peered":"2023-10-18T11:10:09.171348+0000","last_clean":"2023-10-18T11:10:09.171348+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:10:09.171348+0000","last_undegraded":"2023-10-18T11:10:09.171348+0000","last_fullsized":"2023-10-18T11:10:09.171348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177703+0000","last_change":"2023-10-18T11:09:39.361414+0000","last_active":"2023-10-18T11:10:09.177703+0000","last_peered":"2023-10-18T11:10:09.177703+0000","last_clean":"2023-10-18T11:10:09.177703+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:10:09.177703+0000","last_undegraded":"2023-10-18T11:10:09.177703+0000","last_fullsized":"2023-10-18T11:10:09.177703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164861+0000","last_change":"2023-10-18T11:09:39.399067+0000","last_active":"2023-10-18T11:10:09.164861+0000","last_peered":"2023-10-18T11:10:09.164861+0000","last_clean":"2023-10-18T11:10:09.164861+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:10:09.164861+0000","last_undegraded":"2023-10-18T11:10:09.164861+0000","last_fullsized":"2023-10-18T11:10:09.164861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167183+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:10:09.167183+0000","last_peered":"2023-10-18T11:10:09.167183+0000","last_clean":"2023-10-18T11:10:09.167183+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:10:09.167183+0000","last_undegraded":"2023-10-18T11:10:09.167183+0000","last_fullsized":"2023-10-18T11:10:09.167183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:04.730798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.145690+0000","last_change":"2023-10-18T11:09:39.320727+0000","last_active":"2023-10-18T11:10:09.145690+0000","last_peered":"2023-10-18T11:10:09.145690+0000","last_clean":"2023-10-18T11:10:09.145690+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:10:09.145690+0000","last_undegraded":"2023-10-18T11:10:09.145690+0000","last_fullsized":"2023-10-18T11:10:09.145690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.407850+0000","last_change":"2023-10-18T11:10:10.401580+0000","last_active":"2023-10-18T11:10:10.407850+0000","last_peered":"2023-10-18T11:10:10.407850+0000","last_clean":"2023-10-18T11:10:10.407850+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:10:10.407850+0000","last_undegraded":"2023-10-18T11:10:10.407850+0000","last_fullsized":"2023-10-18T11:10:10.407850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171150+0000","last_change":"2023-10-18T11:09:39.354336+0000","last_active":"2023-10-18T11:10:09.171150+0000","last_peered":"2023-10-18T11:10:09.171150+0000","last_clean":"2023-10-18T11:10:09.171150+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:10:09.171150+0000","last_undegraded":"2023-10-18T11:10:09.171150+0000","last_fullsized":"2023-10-18T11:10:09.171150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161257+0000","last_change":"2023-10-18T11:09:39.401976+0000","last_active":"2023-10-18T11:10:09.161257+0000","last_peered":"2023-10-18T11:10:09.161257+0000","last_clean":"2023-10-18T11:10:09.161257+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:10:09.161257+0000","last_undegraded":"2023-10-18T11:10:09.161257+0000","last_fullsized":"2023-10-18T11:10:09.161257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173957+0000","last_change":"2023-10-18T11:09:39.366222+0000","last_active":"2023-10-18T11:10:09.173957+0000","last_peered":"2023-10-18T11:10:09.173957+0000","last_clean":"2023-10-18T11:10:09.173957+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:10:09.173957+0000","last_undegraded":"2023-10-18T11:10:09.173957+0000","last_fullsized":"2023-10-18T11:10:09.173957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:52.729507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.415418+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:10:10.415418+0000","last_peered":"2023-10-18T11:10:10.415418+0000","last_clean":"2023-10-18T11:10:10.415418+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:10:10.415418+0000","last_undegraded":"2023-10-18T11:10:10.415418+0000","last_fullsized":"2023-10-18T11:10:10.415418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:37:38.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169371+0000","last_change":"2023-10-18T11:09:39.400563+0000","last_active":"2023-10-18T11:10:09.169371+0000","last_peered":"2023-10-18T11:10:09.169371+0000","last_clean":"2023-10-18T11:10:09.169371+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:10:09.169371+0000","last_undegraded":"2023-10-18T11:10:09.169371+0000","last_fullsized":"2023-10-18T11:10:09.169371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:24.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164720+0000","last_change":"2023-10-18T11:09:39.320580+0000","last_active":"2023-10-18T11:10:09.164720+0000","last_peered":"2023-10-18T11:10:09.164720+0000","last_clean":"2023-10-18T11:10:09.164720+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:10:09.164720+0000","last_undegraded":"2023-10-18T11:10:09.164720+0000","last_fullsized":"2023-10-18T11:10:09.164720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165013+0000","last_change":"2023-10-18T11:09:39.320508+0000","last_active":"2023-10-18T11:10:09.165013+0000","last_peered":"2023-10-18T11:10:09.165013+0000","last_clean":"2023-10-18T11:10:09.165013+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:10:09.165013+0000","last_undegraded":"2023-10-18T11:10:09.165013+0000","last_fullsized":"2023-10-18T11:10:09.165013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167124+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:10:09.167124+0000","last_peered":"2023-10-18T11:10:09.167124+0000","last_clean":"2023-10-18T11:10:09.167124+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:10:09.167124+0000","last_undegraded":"2023-10-18T11:10:09.167124+0000","last_fullsized":"2023-10-18T11:10:09.167124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:11.432343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178301+0000","last_change":"2023-10-18T11:09:39.421921+0000","last_active":"2023-10-18T11:10:09.178301+0000","last_peered":"2023-10-18T11:10:09.178301+0000","last_clean":"2023-10-18T11:10:09.178301+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:10:09.178301+0000","last_undegraded":"2023-10-18T11:10:09.178301+0000","last_fullsized":"2023-10-18T11:10:09.178301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166717+0000","last_change":"2023-10-18T11:09:39.360846+0000","last_active":"2023-10-18T11:10:09.166717+0000","last_peered":"2023-10-18T11:10:09.166717+0000","last_clean":"2023-10-18T11:10:09.166717+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:10:09.166717+0000","last_undegraded":"2023-10-18T11:10:09.166717+0000","last_fullsized":"2023-10-18T11:10:09.166717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.417103+0000","last_change":"2023-10-18T11:10:10.413563+0000","last_active":"2023-10-18T11:10:10.417103+0000","last_peered":"2023-10-18T11:10:10.417103+0000","last_clean":"2023-10-18T11:10:10.417103+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:10:10.417103+0000","last_undegraded":"2023-10-18T11:10:10.417103+0000","last_fullsized":"2023-10-18T11:10:10.417103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:43.078216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166677+0000","last_change":"2023-10-18T11:09:39.355047+0000","last_active":"2023-10-18T11:10:09.166677+0000","last_peered":"2023-10-18T11:10:09.166677+0000","last_clean":"2023-10-18T11:10:09.166677+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:10:09.166677+0000","last_undegraded":"2023-10-18T11:10:09.166677+0000","last_fullsized":"2023-10-18T11:10:09.166677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171566+0000","last_change":"2023-10-18T11:09:39.418362+0000","last_active":"2023-10-18T11:10:09.171566+0000","last_peered":"2023-10-18T11:10:09.171566+0000","last_clean":"2023-10-18T11:10:09.171566+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:10:09.171566+0000","last_undegraded":"2023-10-18T11:10:09.171566+0000","last_fullsized":"2023-10-18T11:10:09.171566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.175529+0000","last_change":"2023-10-18T11:09:39.363750+0000","last_active":"2023-10-18T11:10:09.175529+0000","last_peered":"2023-10-18T11:10:09.175529+0000","last_clean":"2023-10-18T11:10:09.175529+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:10:09.175529+0000","last_undegraded":"2023-10-18T11:10:09.175529+0000","last_fullsized":"2023-10-18T11:10:09.175529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:43.536873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163609+0000","last_change":"2023-10-18T11:09:39.363259+0000","last_active":"2023-10-18T11:10:09.163609+0000","last_peered":"2023-10-18T11:10:09.163609+0000","last_clean":"2023-10-18T11:10:09.163609+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:10:09.163609+0000","last_undegraded":"2023-10-18T11:10:09.163609+0000","last_fullsized":"2023-10-18T11:10:09.163609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166784+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:10:09.166784+0000","last_peered":"2023-10-18T11:10:09.166784+0000","last_clean":"2023-10-18T11:10:09.166784+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:10:09.166784+0000","last_undegraded":"2023-10-18T11:10:09.166784+0000","last_fullsized":"2023-10-18T11:10:09.166784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:34.071910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6045,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":726534,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.997},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67700000000000005}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.248},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.624}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.748}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.311},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34200000000000003}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.372}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39000000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":135612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53100000000000003}]},{"osd":1,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.436},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61099999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.624},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.85599999999999998}]},{"osd":4,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48299999999999998}]},{"osd":6,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38500000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.40500000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":134976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.65700000000000003}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.0129999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.79000000000000004}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.34399999999999997}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.375}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41199999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":139313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.5219999999999998,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":1.4370000000000001}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.268}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.151},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.6019999999999999,"5min":3.6019999999999999,"15min":3.6019999999999999},"last":1.514}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.016},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.91100000000000003}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.78}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":3.661,"5min":3.661,"15min":3.661},"last":1.72}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.8580000000000001},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":1.4099999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":134850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.5}]},{"osd":1,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.0289999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.3280000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":1.258},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.556,"5min":3.556,"15min":3.556},"last":1.0880000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.387},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":1.4019999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.7069999999999999,"5min":3.7069999999999999,"15min":3.7069999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":4.0209999999999999,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":1.173}]},{"osd":7,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.94499999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":135682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.4810000000000001}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":1.4430000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.508},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.123}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.754},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.1739999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.008},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.27}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":3.2040000000000002,"5min":3.2040000000000002,"15min":3.2040000000000002},"last":1.306},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.232}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.7330000000000001,"5min":2.7330000000000001,"15min":2.7330000000000001},"last":1.401}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":413696,"data_stored":725878,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.623},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.143}]},{"osd":2,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.26}]},{"osd":3,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.70999999999999996}]},{"osd":4,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.68300000000000005}]},{"osd":5,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.1000000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.181},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.3120000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.2110000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":138781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.78700000000000003}]},{"osd":1,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.89000000000000001}]},{"osd":2,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.90500000000000003}]},{"osd":4,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.378},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.33800000000000002}]},{"osd":5,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.47499999999999998}]},{"osd":7,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.44800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:10:26.296 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-18T11:10:26.297 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-18T11:10:26.297 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-18T11:10:26.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-18T11:10:26.298 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-18T11:10:26.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.555+0000 7f1a5a32c640 1 Processor -- start 2023-10-18T11:10:26.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.555+0000 7f1a5a32c640 1 -- start start 2023-10-18T11:10:26.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.557+0000 7f1a5a32c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a54153430 0x7f1a540ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:26.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.557+0000 7f1a5a32c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a540c1a30 0x7f1a540c5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:26.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.557+0000 7f1a5a32c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1a540c9900 0x7f1a540c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:26.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.557+0000 7f1a5a32c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540c02f0 con 0x7f1a540c1a30 2023-10-18T11:10:26.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.557+0000 7f1a5a32c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540c5bd0 con 0x7f1a540c9900 2023-10-18T11:10:26.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.557+0000 7f1a5a32c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54153810 con 0x7f1a54153430 2023-10-18T11:10:26.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.558+0000 7f1a588c9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1a540c9900 0x7f1a540c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:26.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.558+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a54153430 0x7f1a540ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:26.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.558+0000 7f1a588c9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1a540c9900 0x7f1a540c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36746/0 (socket says 172.21.15.151:36746) 2023-10-18T11:10:26.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.558+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a54153430 0x7f1a540ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:54826/0 (socket says 172.21.15.151:54826) 2023-10-18T11:10:26.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.558+0000 7f1a588c9640 1 -- 172.21.15.151:0/607277730 learned_addr learned my addr 172.21.15.151:0/607277730 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:26.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.560+0000 7f1a53fff640 1 -- 172.21.15.151:0/607277730 >> v2:172.21.15.169:3300/0 conn(0x7f1a540c9900 msgr2=0x7f1a540c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:26.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.560+0000 7f1a53fff640 1 --2- 172.21.15.151:0/607277730 >> v2:172.21.15.169:3300/0 conn(0x7f1a540c9900 0x7f1a540c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.560+0000 7f1a53fff640 1 -- 172.21.15.151:0/607277730 >> v2:172.21.15.151:3300/0 conn(0x7f1a540c1a30 msgr2=0x7f1a540c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:26.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.560+0000 7f1a53fff640 1 --2- 172.21.15.151:0/607277730 >> v2:172.21.15.151:3300/0 conn(0x7f1a540c1a30 0x7f1a540c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.560+0000 7f1a53fff640 1 -- 172.21.15.151:0/607277730 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54159d00 con 0x7f1a54153430 2023-10-18T11:10:26.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.563+0000 7f1a53fff640 1 --2- 172.21.15.151:0/607277730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a54153430 0x7f1a540ca6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a5406f050 tx=0x7f1a4402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3071a6be295ac0c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:26.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.567+0000 7f1a537fe640 1 -- 172.21.15.151:0/607277730 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44031830 con 0x7f1a54153430 2023-10-18T11:10:26.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.567+0000 7f1a537fe640 1 -- 172.21.15.151:0/607277730 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a44031990 con 0x7f1a54153430 2023-10-18T11:10:26.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.567+0000 7f1a537fe640 1 -- 172.21.15.151:0/607277730 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44031d20 con 0x7f1a54153430 2023-10-18T11:10:26.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.567+0000 7f1a5a32c640 1 -- 172.21.15.151:0/607277730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a54153430 msgr2=0x7f1a540ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:26.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.567+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/607277730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a54153430 0x7f1a540ca6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a5406f050 tx=0x7f1a4402b8d0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.568+0000 7f1a5a32c640 1 -- 172.21.15.151:0/607277730 shutdown_connections 2023-10-18T11:10:26.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.568+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/607277730 >> v2:172.21.15.151:3300/0 conn(0x7f1a540c1a30 0x7f1a540c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.568+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/607277730 >> v2:172.21.15.169:3300/0 conn(0x7f1a540c9900 0x7f1a540c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.568+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/607277730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a54153430 0x7f1a540ca6d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.568+0000 7f1a5a32c640 1 -- 172.21.15.151:0/607277730 >> 172.21.15.151:0/607277730 conn(0x7f1a5406e930 msgr2=0x7f1a540cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:26.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.568+0000 7f1a5a32c640 1 -- 172.21.15.151:0/607277730 shutdown_connections 2023-10-18T11:10:26.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.568+0000 7f1a5a32c640 1 -- 172.21.15.151:0/607277730 wait complete. 2023-10-18T11:10:26.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.570+0000 7f1a5a32c640 1 Processor -- start 2023-10-18T11:10:26.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.570+0000 7f1a5a32c640 1 -- start start 2023-10-18T11:10:26.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.571+0000 7f1a5a32c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a540c1a30 0x7f1a54145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:26.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.571+0000 7f1a5a32c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a540c9900 0x7f1a541f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:26.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.571+0000 7f1a5a32c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a54153430 0x7f1a541ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:26.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.571+0000 7f1a5a32c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5415c670 con 0x7f1a540c1a30 2023-10-18T11:10:26.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.571+0000 7f1a5a32c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a541ef010 con 0x7f1a54153430 2023-10-18T11:10:26.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.571+0000 7f1a5a32c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54146b60 con 0x7f1a540c9900 2023-10-18T11:10:26.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.571+0000 7f1a588c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a54153430 0x7f1a541ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:26.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.572+0000 7f1a588c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a54153430 0x7f1a541ef4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36748/0 (socket says 172.21.15.151:36748) 2023-10-18T11:10:26.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.572+0000 7f1a588c9640 1 -- 172.21.15.151:0/2277388771 learned_addr learned my addr 172.21.15.151:0/2277388771 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:26.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.574+0000 7f1a4bfff640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a540c9900 0x7f1a541f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:26.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.575+0000 7f1a588c9640 1 -- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a540c9900 msgr2=0x7f1a541f28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:26.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.575+0000 7f1a588c9640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a540c9900 0x7f1a541f28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.575+0000 7f1a588c9640 1 -- 172.21.15.151:0/2277388771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a540c1a30 msgr2=0x7f1a54145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:26.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.575+0000 7f1a588c9640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a540c1a30 0x7f1a54145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:26.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.575+0000 7f1a588c9640 1 -- 172.21.15.151:0/2277388771 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44009400 con 0x7f1a54153430 2023-10-18T11:10:26.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.578+0000 7f1a588c9640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a54153430 0x7f1a541ef4a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00efc0 tx=0x7f1a4c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:26.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.581+0000 7f1a517fa640 1 -- 172.21.15.151:0/2277388771 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00ccc0 con 0x7f1a54153430 2023-10-18T11:10:26.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.581+0000 7f1a517fa640 1 -- 172.21.15.151:0/2277388771 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c00f040 con 0x7f1a54153430 2023-10-18T11:10:26.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.581+0000 7f1a517fa640 1 -- 172.21.15.151:0/2277388771 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c003bd0 con 0x7f1a54153430 2023-10-18T11:10:26.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.581+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a54146db0 con 0x7f1a54153430 2023-10-18T11:10:26.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.582+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a541eeca0 con 0x7f1a54153430 2023-10-18T11:10:26.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.583+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a540c96e0 con 0x7f1a54153430 2023-10-18T11:10:26.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.839+0000 7f1a517fa640 1 -- 172.21.15.151:0/2277388771 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a4c003d30 con 0x7f1a54153430 2023-10-18T11:10:26.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.841+0000 7f1a517fa640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a3406aef0 0x7f1a3406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:26.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.842+0000 7f1a517fa640 1 -- 172.21.15.151:0/2277388771 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1a4c08ac70 con 0x7f1a54153430 2023-10-18T11:10:26.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.842+0000 7f1a53fff640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a3406aef0 0x7f1a3406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:26.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.843+0000 7f1a53fff640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a3406aef0 0x7f1a3406d3b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a44036000 tx=0x7f1a44030000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:26.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:26.851+0000 7f1a517fa640 1 -- 172.21.15.151:0/2277388771 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a4c0559b0 con 0x7f1a54153430 2023-10-18T11:10:26.980 INFO:tasks.ceph.mds.e.smithi151.stderr:2023-10-18T11:10:26.970+0000 f5b3640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-18T11:10:27.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.128+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1a540c8e60 con 0x7f1a54153430 2023-10-18T11:10:27.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.278+0000 7f1a517fa640 1 -- 172.21.15.151:0/2277388771 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v7) v1 ==== 74+0+171038 (secure 0 0 0) 0x7f1a4c009e60 con 0x7f1a54153430 2023-10-18T11:10:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:27.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.282+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a3406aef0 msgr2=0x7f1a3406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:27.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.282+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a3406aef0 0x7f1a3406d3b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a44036000 tx=0x7f1a44030000 comp rx=0 tx=0).stop 2023-10-18T11:10:27.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.282+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a54153430 msgr2=0x7f1a541ef4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:27.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.282+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a54153430 0x7f1a541ef4a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00efc0 tx=0x7f1a4c00c490 comp rx=0 tx=0).stop 2023-10-18T11:10:27.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.283+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 shutdown_connections 2023-10-18T11:10:27.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.283+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a3406aef0 0x7f1a3406d3b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:27.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.283+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a54153430 0x7f1a541ef4a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:27.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.283+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a540c9900 0x7f1a541f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:27.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.283+0000 7f1a5a32c640 1 --2- 172.21.15.151:0/2277388771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a540c1a30 0x7f1a54145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:27.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.283+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 >> 172.21.15.151:0/2277388771 conn(0x7f1a5406e930 msgr2=0x7f1a54071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:27.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.283+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 shutdown_connections 2023-10-18T11:10:27.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.283+0000 7f1a5a32c640 1 -- 172.21.15.151:0/2277388771 wait complete. 2023-10-18T11:10:27.310 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":7,"active_gid":4153,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3214727900},{"type":"v1","addr":"172.21.15.169:6833","nonce":3214727900}]},"active_addr":"172.21.15.169:6833/3214727900","active_change":"2023-10-18T11:09:07.649489+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":11,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":1458045977}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":1807450125}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":4067808219}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3317715475}]}]} 2023-10-18T11:10:27.314 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-18T11:10:27.314 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-18T11:10:27.315 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:10:27.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.504+0000 7faf9b2c9640 1 Processor -- start 2023-10-18T11:10:27.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.504+0000 7faf9b2c9640 1 -- start start 2023-10-18T11:10:27.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.505+0000 7faf9b2c9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faf940c67b0 0x7faf9406d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:27.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.505+0000 7faf9b2c9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf940c5740 con 0x7faf9414ff40 2023-10-18T11:10:27.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.505+0000 7faf9b2c9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf94150320 con 0x7faf9406dca0 2023-10-18T11:10:27.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.505+0000 7faf9b2c9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9406e0b0 con 0x7faf940c67b0 2023-10-18T11:10:27.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.506+0000 7faf99866640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7faf9406dca0 0x7faf94159170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:38512/0 (socket says 172.21.15.151:38512) 2023-10-18T11:10:27.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.506+0000 7faf99866640 1 -- 172.21.15.151:0/1229500795 learned_addr learned my addr 172.21.15.151:0/1229500795 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:27.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.506+0000 7faf98864640 1 --2- 172.21.15.151:0/1229500795 >> v2:172.21.15.151:3300/0 conn(0x7faf940c67b0 0x7faf9406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:27.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.509+0000 7faf8bfff640 1 -- 172.21.15.151:0/1229500795 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407469108 0 0) 0x7faf94150320 con 0x7faf9406dca0 2023-10-18T11:10:27.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.509+0000 7faf8bfff640 1 -- 172.21.15.151:0/1229500795 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf80003520 con 0x7faf9406dca0 2023-10-18T11:10:27.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.511+0000 7faf98864640 1 -- 172.21.15.151:0/1229500795 >> v1:172.21.15.169:6789/0 conn(0x7faf9406dca0 legacy=0x7faf94159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:27.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.511+0000 7faf98864640 1 -- 172.21.15.151:0/1229500795 >> v1:172.21.15.151:6789/0 conn(0x7faf9414ff40 legacy=0x7faf940c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:27.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.511+0000 7faf98864640 1 -- 172.21.15.151:0/1229500795 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94159d00 con 0x7faf940c67b0 2023-10-18T11:10:27.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.516+0000 7faf98864640 1 --2- 172.21.15.151:0/1229500795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf940c67b0 0x7faf9406d760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf840097a0 tx=0x7faf8402db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8229cf550567e11 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:27.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.521+0000 7faf8bfff640 1 -- 172.21.15.151:0/1229500795 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8402e920 con 0x7faf940c67b0 2023-10-18T11:10:27.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.521+0000 7faf8bfff640 1 -- 172.21.15.151:0/1229500795 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8402ea80 con 0x7faf940c67b0 2023-10-18T11:10:27.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.521+0000 7faf8bfff640 1 -- 172.21.15.151:0/1229500795 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8402ee10 con 0x7faf940c67b0 2023-10-18T11:10:27.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.522+0000 7faf9b2c9640 1 -- 172.21.15.151:0/1229500795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf940c67b0 msgr2=0x7faf9406d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:27.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.522+0000 7faf9b2c9640 1 --2- 172.21.15.151:0/1229500795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf940c67b0 0x7faf9406d760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf840097a0 tx=0x7faf8402db70 comp rx=0 tx=0).stop 2023-10-18T11:10:27.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.522+0000 7faf9b2c9640 1 -- 172.21.15.151:0/1229500795 shutdown_connections 2023-10-18T11:10:27.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.522+0000 7faf9b2c9640 1 --2- 172.21.15.151:0/1229500795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf940c67b0 0x7faf9406d760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:27.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.522+0000 7faf9b2c9640 1 -- 172.21.15.151:0/1229500795 >> 172.21.15.151:0/1229500795 conn(0x7faf940c6f10 msgr2=0x7faf940c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:27.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.522+0000 7faf9b2c9640 1 -- 172.21.15.151:0/1229500795 shutdown_connections 2023-10-18T11:10:27.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.522+0000 7faf9b2c9640 1 -- 172.21.15.151:0/1229500795 wait complete. 2023-10-18T11:10:27.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.525+0000 7faf9b2c9640 1 Processor -- start 2023-10-18T11:10:27.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.525+0000 7faf9b2c9640 1 -- start start 2023-10-18T11:10:27.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.526+0000 7faf9b2c9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9406dca0 0x7faf9414a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:27.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.526+0000 7faf9b2c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf940c67b0 0x7faf9414b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:27.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.526+0000 7faf9b2c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9414ff40 0x7faf9414d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:27.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.526+0000 7faf9b2c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9414ca40 con 0x7faf9414ff40 2023-10-18T11:10:27.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.526+0000 7faf9b2c9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9414b070 con 0x7faf940c67b0 2023-10-18T11:10:27.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.526+0000 7faf9b2c9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9414a750 con 0x7faf9406dca0 2023-10-18T11:10:27.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.527+0000 7faf98864640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf940c67b0 0x7faf9414b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:27.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.527+0000 7faf99866640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9414ff40 0x7faf9414d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:27.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.527+0000 7faf99065640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9406dca0 0x7faf9414a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:27.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.528+0000 7faf98864640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf940c67b0 0x7faf9414b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:36760/0 (socket says 172.21.15.151:36760) 2023-10-18T11:10:27.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.528+0000 7faf98864640 1 -- 172.21.15.151:0/3793637217 learned_addr learned my addr 172.21.15.151:0/3793637217 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:27.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.531+0000 7faf99065640 1 -- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf940c67b0 msgr2=0x7faf9414b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:27.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.531+0000 7faf99065640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf940c67b0 0x7faf9414b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:27.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.531+0000 7faf99065640 1 -- 172.21.15.151:0/3793637217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9414ff40 msgr2=0x7faf9414d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:27.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.531+0000 7faf99065640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9414ff40 0x7faf9414d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:27.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.531+0000 7faf99065640 1 -- 172.21.15.151:0/3793637217 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84009400 con 0x7faf9406dca0 2023-10-18T11:10:27.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.531+0000 7faf98864640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf940c67b0 0x7faf9414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:27.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.533+0000 7faf99065640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9406dca0 0x7faf9414a210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faf9000c3f0 tx=0x7faf9000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:27.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.537+0000 7faf89ffb640 1 -- 172.21.15.151:0/3793637217 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900052d0 con 0x7faf9406dca0 2023-10-18T11:10:27.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.537+0000 7faf89ffb640 1 -- 172.21.15.151:0/3793637217 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf90005450 con 0x7faf9406dca0 2023-10-18T11:10:27.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.537+0000 7faf89ffb640 1 -- 172.21.15.151:0/3793637217 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90007260 con 0x7faf9406dca0 2023-10-18T11:10:27.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.537+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf94157630 con 0x7faf9406dca0 2023-10-18T11:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.537+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf94155760 con 0x7faf9406dca0 2023-10-18T11:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.539+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9414bf50 con 0x7faf9406dca0 2023-10-18T11:10:27.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.560+0000 7faf89ffb640 1 -- 172.21.15.151:0/3793637217 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf900073c0 con 0x7faf9406dca0 2023-10-18T11:10:27.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.561+0000 7faf89ffb640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faf7806aec0 0x7faf7806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:27.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.562+0000 7faf98864640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faf7806aec0 0x7faf7806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:27.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.562+0000 7faf89ffb640 1 -- 172.21.15.151:0/3793637217 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf900579d0 con 0x7faf9406dca0 2023-10-18T11:10:27.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.562+0000 7faf98864640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faf7806aec0 0x7faf7806d380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf8402dbb0 tx=0x7faf84032000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:27.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:27.794+0000 7faf89ffb640 1 -- 172.21.15.151:0/3793637217 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf90053d10 con 0x7faf9406dca0 2023-10-18T11:10:28.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.006+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf94155760 con 0x7faf9406dca0 2023-10-18T11:10:28.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.044+0000 7faf89ffb640 1 -- 172.21.15.151:0/3793637217 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7faf94155760 con 0x7faf9406dca0 2023-10-18T11:10:28.047 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:28.047 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:28.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faf7806aec0 msgr2=0x7faf7806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:28.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faf7806aec0 0x7faf7806d380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf8402dbb0 tx=0x7faf84032000 comp rx=0 tx=0).stop 2023-10-18T11:10:28.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9406dca0 msgr2=0x7faf9414a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:28.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9406dca0 0x7faf9414a210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faf9000c3f0 tx=0x7faf9000c8b0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 shutdown_connections 2023-10-18T11:10:28.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9414ff40 0x7faf9414d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faf7806aec0 0x7faf7806d380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf940c67b0 0x7faf9414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 --2- 172.21.15.151:0/3793637217 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9406dca0 0x7faf9414a210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 >> 172.21.15.151:0/3793637217 conn(0x7faf940c6f10 msgr2=0x7faf9406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:28.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 shutdown_connections 2023-10-18T11:10:28.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.047+0000 7faf9b2c9640 1 -- 172.21.15.151:0/3793637217 wait complete. 2023-10-18T11:10:28.068 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-18T11:10:28.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:10:28.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.283+0000 7f07e4832640 1 Processor -- start 2023-10-18T11:10:28.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.283+0000 7f07e4832640 1 -- start start 2023-10-18T11:10:28.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.284+0000 7f07e4832640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e014f940 0x7f07e00c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:28.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.285+0000 7f07e4832640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f07e0159380 0x7f07e006b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:28.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.285+0000 7f07e4832640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e00c3810 con 0x7f07e006b6e0 2023-10-18T11:10:28.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.285+0000 7f07e4832640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00705c0 con 0x7f07e0159380 2023-10-18T11:10:28.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.285+0000 7f07e4832640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00c3200 con 0x7f07e014f940 2023-10-18T11:10:28.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.285+0000 7f07de59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e014f940 0x7f07e00c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:28.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.286+0000 7f07de59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e014f940 0x7f07e00c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57178/0 (socket says 172.21.15.151:57178) 2023-10-18T11:10:28.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.286+0000 7f07de59c640 1 -- 172.21.15.151:0/52117606 learned_addr learned my addr 172.21.15.151:0/52117606 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:28.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.286+0000 7f07ddd9b640 1 --2- 172.21.15.151:0/52117606 >> v2:172.21.15.151:3300/0 conn(0x7f07e0159380 0x7f07e006b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:28.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.288+0000 7f07de59c640 1 -- 172.21.15.151:0/52117606 >> v2:172.21.15.151:3300/0 conn(0x7f07e0159380 msgr2=0x7f07e006b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:28.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.288+0000 7f07de59c640 1 --2- 172.21.15.151:0/52117606 >> v2:172.21.15.151:3300/0 conn(0x7f07e0159380 0x7f07e006b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.288+0000 7f07de59c640 1 -- 172.21.15.151:0/52117606 >> v1:172.21.15.151:6789/0 conn(0x7f07e006b6e0 legacy=0x7f07e00c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:28.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.288+0000 7f07de59c640 1 -- 172.21.15.151:0/52117606 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e006fd40 con 0x7f07e014f940 2023-10-18T11:10:28.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.290+0000 7f07de59c640 1 --2- 172.21.15.151:0/52117606 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e014f940 0x7f07e00c4e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07d000aa10 tx=0x7f07d002dff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8f52404c8995a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:28.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.293+0000 7f07dd59a640 1 -- 172.21.15.151:0/52117606 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d002eda0 con 0x7f07e014f940 2023-10-18T11:10:28.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.294+0000 7f07dd59a640 1 -- 172.21.15.151:0/52117606 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0036440 con 0x7f07e014f940 2023-10-18T11:10:28.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.294+0000 7f07dd59a640 1 -- 172.21.15.151:0/52117606 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00367d0 con 0x7f07e014f940 2023-10-18T11:10:28.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.295+0000 7f07e4832640 1 -- 172.21.15.151:0/52117606 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e014f940 msgr2=0x7f07e00c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:28.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.295+0000 7f07e4832640 1 --2- 172.21.15.151:0/52117606 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e014f940 0x7f07e00c4e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07d000aa10 tx=0x7f07d002dff0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.295+0000 7f07e4832640 1 -- 172.21.15.151:0/52117606 shutdown_connections 2023-10-18T11:10:28.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.295+0000 7f07e4832640 1 --2- 172.21.15.151:0/52117606 >> v2:172.21.15.151:3300/0 conn(0x7f07e0159380 0x7f07e006b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.295+0000 7f07e4832640 1 --2- 172.21.15.151:0/52117606 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e014f940 0x7f07e00c4e10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.295+0000 7f07e4832640 1 -- 172.21.15.151:0/52117606 >> 172.21.15.151:0/52117606 conn(0x7f07e00c6f10 msgr2=0x7f07e00c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:28.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.295+0000 7f07e4832640 1 -- 172.21.15.151:0/52117606 shutdown_connections 2023-10-18T11:10:28.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.295+0000 7f07e4832640 1 -- 172.21.15.151:0/52117606 wait complete. 2023-10-18T11:10:28.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.297+0000 7f07e4832640 1 Processor -- start 2023-10-18T11:10:28.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.297+0000 7f07e4832640 1 -- start start 2023-10-18T11:10:28.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.298+0000 7f07e4832640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07e006b6e0 0x7f07e01549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:28.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.298+0000 7f07e4832640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07e014f940 0x7f07e0154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:28.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.298+0000 7f07e4832640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e0159380 0x7f07e0152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:28.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.298+0000 7f07e4832640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01ee9b0 con 0x7f07e014f940 2023-10-18T11:10:28.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.298+0000 7f07e4832640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00720a0 con 0x7f07e006b6e0 2023-10-18T11:10:28.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.298+0000 7f07e4832640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0154560 con 0x7f07e0159380 2023-10-18T11:10:28.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.299+0000 7f07de59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07e006b6e0 0x7f07e01549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:28.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.299+0000 7f07ded9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e0159380 0x7f07e0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:28.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.299+0000 7f07ddd9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07e014f940 0x7f07e0154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:28.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.299+0000 7f07ded9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e0159380 0x7f07e0152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57192/0 (socket says 172.21.15.151:57192) 2023-10-18T11:10:28.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.299+0000 7f07ded9d640 1 -- 172.21.15.151:0/3545054438 learned_addr learned my addr 172.21.15.151:0/3545054438 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:28.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.302+0000 7f07ded9d640 1 -- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07e006b6e0 msgr2=0x7f07e01549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:28.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.302+0000 7f07ded9d640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07e006b6e0 0x7f07e01549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.302+0000 7f07ded9d640 1 -- 172.21.15.151:0/3545054438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07e014f940 msgr2=0x7f07e0154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:28.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.302+0000 7f07ded9d640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07e014f940 0x7f07e0154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.302+0000 7f07ded9d640 1 -- 172.21.15.151:0/3545054438 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d000a670 con 0x7f07e0159380 2023-10-18T11:10:28.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.304+0000 7f07ded9d640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e0159380 0x7f07e0152110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c7a0 tx=0x7f07d800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:28.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.308+0000 7f07ceffd640 1 -- 172.21.15.151:0/3545054438 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8003b70 con 0x7f07e0159380 2023-10-18T11:10:28.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.308+0000 7f07ceffd640 1 -- 172.21.15.151:0/3545054438 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8003cf0 con 0x7f07e0159380 2023-10-18T11:10:28.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.308+0000 7f07ceffd640 1 -- 172.21.15.151:0/3545054438 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8003ea0 con 0x7f07e0159380 2023-10-18T11:10:28.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.308+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e01ee6d0 con 0x7f07e0159380 2023-10-18T11:10:28.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.308+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e0153f10 con 0x7f07e0159380 2023-10-18T11:10:28.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.310+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e004e1d0 con 0x7f07e0159380 2023-10-18T11:10:28.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.328+0000 7f07ceffd640 1 -- 172.21.15.151:0/3545054438 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f07d800aa90 con 0x7f07e0159380 2023-10-18T11:10:28.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.329+0000 7f07ceffd640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f07c006aec0 0x7f07c006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:28.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.330+0000 7f07de59c640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f07c006aec0 0x7f07c006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:28.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.330+0000 7f07de59c640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f07c006aec0 0x7f07c006d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07d0038000 tx=0x7f07d0032000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:28.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.561+0000 7f07ceffd640 1 -- 172.21.15.151:0/3545054438 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f07d8058bd0 con 0x7f07e0159380 2023-10-18T11:10:28.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.573+0000 7f07ceffd640 1 -- 172.21.15.151:0/3545054438 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07d8054f10 con 0x7f07e0159380 2023-10-18T11:10:28.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.773+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07e01546a0 con 0x7f07e0159380 2023-10-18T11:10:28.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.813+0000 7f07ceffd640 1 -- 172.21.15.151:0/3545054438 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f07d8058530 con 0x7f07e0159380 2023-10-18T11:10:28.816 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:28.816 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:28.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f07c006aec0 msgr2=0x7f07c006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:28.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f07c006aec0 0x7f07c006d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07d0038000 tx=0x7f07d0032000 comp rx=0 tx=0).stop 2023-10-18T11:10:28.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e0159380 msgr2=0x7f07e0152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:28.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e0159380 0x7f07e0152110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c7a0 tx=0x7f07d800cc60 comp rx=0 tx=0).stop 2023-10-18T11:10:28.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 shutdown_connections 2023-10-18T11:10:28.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07e0159380 0x7f07e0152110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07e014f940 0x7f07e0154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f07c006aec0 0x7f07c006d380 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 --2- 172.21.15.151:0/3545054438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07e006b6e0 0x7f07e01549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:28.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 >> 172.21.15.151:0/3545054438 conn(0x7f07e00c6f10 msgr2=0x7f07e00c3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:28.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 shutdown_connections 2023-10-18T11:10:28.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:28.816+0000 7f07e4832640 1 -- 172.21.15.151:0/3545054438 wait complete. 2023-10-18T11:10:28.839 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-18T11:10:28.840 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-18T11:10:28.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-18T11:10:28.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-18T11:10:28.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-18T11:10:28.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-18T11:10:28.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-18T11:10:28.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-18T11:10:29.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.184+0000 7f0967e75640 1 Processor -- start 2023-10-18T11:10:29.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.185+0000 7f0967e75640 1 -- start start 2023-10-18T11:10:29.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.187+0000 7f0967e75640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f095804ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.187+0000 7f0967e75640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f095804c350 0x7f095804b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.187+0000 7f0967e75640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0958034790 con 0x7f095800e200 2023-10-18T11:10:29.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.187+0000 7f0967e75640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0958034c20 con 0x7f095804c350 2023-10-18T11:10:29.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.187+0000 7f0967e75640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095804c890 con 0x7f09580d6ba0 2023-10-18T11:10:29.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.188+0000 7f0965c11640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f095804ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.194+0000 7f0965c11640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f095804ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57206/0 (socket says 172.21.15.151:57206) 2023-10-18T11:10:29.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.194+0000 7f0965c11640 1 -- 172.21.15.151:0/1493694236 learned_addr learned my addr 172.21.15.151:0/1493694236 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.195+0000 7f0965410640 1 --2- 172.21.15.151:0/1493694236 >> v2:172.21.15.169:3300/0 conn(0x7f095804c350 0x7f095804b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.207+0000 7f26b156e640 1 Processor -- start 2023-10-18T11:10:29.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.208+0000 7f26b156e640 1 -- start start 2023-10-18T11:10:29.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.210+0000 7f26b156e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f26ac0c6cc0 0x7f26ac15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.210+0000 7f26b156e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f26ac0c70a0 0x7f26ac0c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.210+0000 7f26b156e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ac15da30 con 0x7f26ac06da40 2023-10-18T11:10:29.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.211+0000 7f26b156e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ac0c77e0 con 0x7f26ac0c6cc0 2023-10-18T11:10:29.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.211+0000 7f26b156e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ac0c56f0 con 0x7f26ac0c70a0 2023-10-18T11:10:29.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.209+0000 7f7438a9b640 1 Processor -- start 2023-10-18T11:10:29.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.210+0000 7f7438a9b640 1 -- start start 2023-10-18T11:10:29.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.212+0000 7f7438a9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7434165da0 0x7f74340c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.212+0000 7f7438a9b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74340701b0 con 0x7f74341633b0 2023-10-18T11:10:29.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.212+0000 7f7438a9b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743406d0c0 con 0x7f74340c51b0 2023-10-18T11:10:29.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.212+0000 7f7438a9b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743406d3a0 con 0x7f7434165da0 2023-10-18T11:10:29.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.219+0000 7f1cf2a10640 1 Processor -- start 2023-10-18T11:10:29.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.219+0000 7f1cf2a10640 1 -- start start 2023-10-18T11:10:29.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.220+0000 7f1cf2a10640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec15d170 0x7f1cec0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.221+0000 7f1cf2a10640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1cec0c9650 0x7f1cec0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.221+0000 7f1cf2a10640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec15d590 con 0x7f1cec0cbe20 2023-10-18T11:10:29.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.221+0000 7f1cf2a10640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec153870 con 0x7f1cec0c9650 2023-10-18T11:10:29.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.221+0000 7f1cf2a10640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0cc200 con 0x7f1cec15d170 2023-10-18T11:10:29.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.226+0000 7f8b264b4640 1 Processor -- start 2023-10-18T11:10:29.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.227+0000 7f8b264b4640 1 -- start start 2023-10-18T11:10:29.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.228+0000 7f8b264b4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8b20153510 0x7f8b200ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.228+0000 7f8b264b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b200b1440 0x7f8b200cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.228+0000 7f8b264b4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8b200cb820 0x7f8b20159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.228+0000 7f8b264b4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b20159300 con 0x7f8b20153510 2023-10-18T11:10:29.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.228+0000 7f8b264b4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2015c740 con 0x7f8b200cb820 2023-10-18T11:10:29.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.228+0000 7f8b264b4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2015ca00 con 0x7f8b200b1440 2023-10-18T11:10:29.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.240+0000 7fabaaf97640 1 Processor -- start 2023-10-18T11:10:29.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.241+0000 7fabaaf97640 1 -- start start 2023-10-18T11:10:29.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.242+0000 7fabaaf97640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faba40c2180 0x7faba406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.242+0000 7fabaaf97640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faba406de00 0x7faba40c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.242+0000 7fabaaf97640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba406d430 con 0x7faba41510a0 2023-10-18T11:10:29.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.242+0000 7fabaaf97640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40c25d0 con 0x7faba40c2180 2023-10-18T11:10:29.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.242+0000 7fabaaf97640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba4151480 con 0x7faba406de00 2023-10-18T11:10:29.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.246+0000 7f8b1f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b200b1440 0x7f8b200cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.248+0000 7f8b1f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b200b1440 0x7f8b200cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57218/0 (socket says 172.21.15.151:57218) 2023-10-18T11:10:29.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.248+0000 7f8b1f7fe640 1 -- 172.21.15.151:0/690911700 learned_addr learned my addr 172.21.15.151:0/690911700 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.248+0000 7f1ceb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec15d170 0x7f1cec0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.248+0000 7f1ceb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec15d170 0x7f1cec0cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57214/0 (socket says 172.21.15.151:57214) 2023-10-18T11:10:29.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.248+0000 7f1ceb7fe640 1 -- 172.21.15.151:0/1751256958 learned_addr learned my addr 172.21.15.151:0/1751256958 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.249+0000 7f0965c11640 1 -- 172.21.15.151:0/1493694236 >> v2:172.21.15.169:3300/0 conn(0x7f095804c350 msgr2=0x7f095804b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.249+0000 7f0965c11640 1 --2- 172.21.15.151:0/1493694236 >> v2:172.21.15.169:3300/0 conn(0x7f095804c350 0x7f095804b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.249+0000 7f0965c11640 1 -- 172.21.15.151:0/1493694236 >> v1:172.21.15.169:6789/0 conn(0x7f095800e200 legacy=0x7f09580dca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.249+0000 7f0965c11640 1 -- 172.21.15.151:0/1493694236 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958047170 con 0x7f09580d6ba0 2023-10-18T11:10:29.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.252+0000 7f0965c11640 1 --2- 172.21.15.151:0/1493694236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f095804ab40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09600639b0 tx=0x7f09600a5fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f53a8631d5a5b85 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.254+0000 7f1ceb7fe640 1 -- 172.21.15.151:0/1751256958 >> v2:172.21.15.169:3300/0 conn(0x7f1cec0c9650 msgr2=0x7f1cec0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.254+0000 7f1ceb7fe640 1 --2- 172.21.15.151:0/1751256958 >> v2:172.21.15.169:3300/0 conn(0x7f1cec0c9650 0x7f1cec0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.254+0000 7f1ceb7fe640 1 -- 172.21.15.151:0/1751256958 >> v1:172.21.15.151:6789/0 conn(0x7f1cec0cbe20 legacy=0x7f1cec0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.254+0000 7f1ceb7fe640 1 -- 172.21.15.151:0/1751256958 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0b1e30 con 0x7f1cec15d170 2023-10-18T11:10:29.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.254+0000 7f26aa7fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f26ac0c70a0 0x7f26ac0c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.255+0000 7f26aa7fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f26ac0c70a0 0x7f26ac0c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38712/0 (socket says 172.21.15.151:38712) 2023-10-18T11:10:29.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.255+0000 7f26aa7fc640 1 -- 172.21.15.151:0/4063509021 learned_addr learned my addr 172.21.15.151:0/4063509021 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.255+0000 7f8b24a51640 1 --2- 172.21.15.151:0/690911700 >> v2:172.21.15.169:3300/0 conn(0x7f8b200cb820 0x7f8b20159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.255+0000 7f8b1f7fe640 1 -- 172.21.15.151:0/690911700 >> v2:172.21.15.169:3300/0 conn(0x7f8b200cb820 msgr2=0x7f8b20159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.255+0000 7f8b1f7fe640 1 --2- 172.21.15.151:0/690911700 >> v2:172.21.15.169:3300/0 conn(0x7f8b200cb820 0x7f8b20159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.255+0000 7f8b1f7fe640 1 -- 172.21.15.151:0/690911700 >> v2:172.21.15.151:3300/0 conn(0x7f8b20153510 msgr2=0x7f8b200ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.255+0000 7f8b1f7fe640 1 --2- 172.21.15.151:0/690911700 >> v2:172.21.15.151:3300/0 conn(0x7f8b20153510 0x7f8b200ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.255+0000 7f8b1f7fe640 1 -- 172.21.15.151:0/690911700 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2015cce0 con 0x7f8b200b1440 2023-10-18T11:10:29.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.258+0000 7f26aa7fc640 1 -- 172.21.15.151:0/4063509021 >> v2:172.21.15.151:3300/0 conn(0x7f26ac0c6cc0 msgr2=0x7f26ac15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.258+0000 7f26aa7fc640 1 --2- 172.21.15.151:0/4063509021 >> v2:172.21.15.151:3300/0 conn(0x7f26ac0c6cc0 0x7f26ac15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.258+0000 7f26aa7fc640 1 -- 172.21.15.151:0/4063509021 >> v1:172.21.15.151:6789/0 conn(0x7f26ac06da40 legacy=0x7f26ac157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.258+0000 7f26aa7fc640 1 -- 172.21.15.151:0/4063509021 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac15dcc0 con 0x7f26ac0c70a0 2023-10-18T11:10:29.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.260+0000 7faba9534640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faba406de00 0x7faba40c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.261+0000 7faba9534640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faba406de00 0x7faba40c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38738/0 (socket says 172.21.15.151:38738) 2023-10-18T11:10:29.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.261+0000 7faba9534640 1 -- 172.21.15.151:0/1924348683 learned_addr learned my addr 172.21.15.151:0/1924348683 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.262+0000 7f1ceb7fe640 1 --2- 172.21.15.151:0/1751256958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec15d170 0x7f1cec0cac40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009870 tx=0x7f1cd402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35cb3d5d8d275001 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.262+0000 7f8b1f7fe640 1 --2- 172.21.15.151:0/690911700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b200b1440 0x7f8b200cb2e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b200b1b40 tx=0x7f8b1402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abe82deb009f4474 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.263+0000 7f7431d9b640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f74340c51b0 0x7f743406d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50006/0 (socket says 172.21.15.151:50006) 2023-10-18T11:10:29.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.263+0000 7f7431d9b640 1 -- 172.21.15.151:0/3758127467 learned_addr learned my addr 172.21.15.151:0/3758127467 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:29.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.264+0000 7f0964c0f640 1 -- 172.21.15.151:0/1493694236 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600a6e20 con 0x7f09580d6ba0 2023-10-18T11:10:29.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.264+0000 7f0964c0f640 1 -- 172.21.15.151:0/1493694236 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09600ae440 con 0x7f09580d6ba0 2023-10-18T11:10:29.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.264+0000 7f0964c0f640 1 -- 172.21.15.151:0/1493694236 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600a6e20 con 0x7f09580d6ba0 2023-10-18T11:10:29.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.265+0000 7faba9534640 1 -- 172.21.15.151:0/1924348683 >> v2:172.21.15.151:3300/0 conn(0x7faba40c2180 msgr2=0x7faba406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.265+0000 7faba9534640 1 --2- 172.21.15.151:0/1924348683 >> v2:172.21.15.151:3300/0 conn(0x7faba40c2180 0x7faba406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.265+0000 7faba9534640 1 -- 172.21.15.151:0/1924348683 >> v1:172.21.15.151:6789/0 conn(0x7faba41510a0 legacy=0x7faba4157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.265+0000 7faba9534640 1 -- 172.21.15.151:0/1924348683 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40c27d0 con 0x7faba406de00 2023-10-18T11:10:29.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.265+0000 7f0967e75640 1 -- 172.21.15.151:0/1493694236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 msgr2=0x7f095804ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.265+0000 7f0967e75640 1 --2- 172.21.15.151:0/1493694236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f095804ab40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09600639b0 tx=0x7f09600a5fb0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.266+0000 7f0967e75640 1 -- 172.21.15.151:0/1493694236 shutdown_connections 2023-10-18T11:10:29.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.266+0000 7f0967e75640 1 --2- 172.21.15.151:0/1493694236 >> v2:172.21.15.169:3300/0 conn(0x7f095804c350 0x7f095804b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.266+0000 7f0967e75640 1 --2- 172.21.15.151:0/1493694236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f095804ab40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.266+0000 7f0967e75640 1 -- 172.21.15.151:0/1493694236 >> 172.21.15.151:0/1493694236 conn(0x7f09580501c0 msgr2=0x7f09580505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.266+0000 7f0967e75640 1 -- 172.21.15.151:0/1493694236 shutdown_connections 2023-10-18T11:10:29.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.266+0000 7f0967e75640 1 -- 172.21.15.151:0/1493694236 wait complete. 2023-10-18T11:10:29.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.269+0000 7f0967e75640 1 Processor -- start 2023-10-18T11:10:29.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.269+0000 7f0967e75640 1 -- start start 2023-10-18T11:10:29.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.270+0000 7f26aa7fc640 1 --2- 172.21.15.151:0/4063509021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac0c70a0 0x7f26ac0c51b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0725a0 tx=0x7f269402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7a776c468317ab server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.271+0000 7f0967e75640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f095800e200 0x7f09580d9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.271+0000 7f0967e75640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f095804c350 0x7f09580d7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.271+0000 7f0967e75640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f09580d85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.271+0000 7f0967e75640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580e0a40 con 0x7f095804c350 2023-10-18T11:10:29.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.271+0000 7f0967e75640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580df8e0 con 0x7f095800e200 2023-10-18T11:10:29.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.271+0000 7f0967e75640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580df360 con 0x7f09580d6ba0 2023-10-18T11:10:29.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.271+0000 7faba9534640 1 --2- 172.21.15.151:0/1924348683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba406de00 0x7faba40c4e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faba40c4ac0 tx=0x7fab9c02bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd3e0e49f543d54a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.271+0000 7f1ceaffd640 1 -- 172.21.15.151:0/1751256958 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4030840 con 0x7f1cec15d170 2023-10-18T11:10:29.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.272+0000 7f1ceaffd640 1 -- 172.21.15.151:0/1751256958 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd40309a0 con 0x7f1cec15d170 2023-10-18T11:10:29.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.272+0000 7f1ceaffd640 1 -- 172.21.15.151:0/1751256958 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4030d30 con 0x7f1cec15d170 2023-10-18T11:10:29.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.272+0000 7f0965c11640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f095800e200 0x7f09580d9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f8b1effd640 1 -- 172.21.15.151:0/690911700 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b140317e0 con 0x7f8b200b1440 2023-10-18T11:10:29.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f8b1effd640 1 -- 172.21.15.151:0/690911700 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b14031940 con 0x7f8b200b1440 2023-10-18T11:10:29.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f8b1effd640 1 -- 172.21.15.151:0/690911700 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14031cd0 con 0x7f8b200b1440 2023-10-18T11:10:29.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f1cf2a10640 1 -- 172.21.15.151:0/1751256958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec15d170 msgr2=0x7f1cec0cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f1cf2a10640 1 --2- 172.21.15.151:0/1751256958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec15d170 0x7f1cec0cac40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009870 tx=0x7f1cd402b980 comp rx=0 tx=0).stop 2023-10-18T11:10:29.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f1cf2a10640 1 -- 172.21.15.151:0/1751256958 shutdown_connections 2023-10-18T11:10:29.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f1cf2a10640 1 --2- 172.21.15.151:0/1751256958 >> v2:172.21.15.169:3300/0 conn(0x7f1cec0c9650 0x7f1cec0c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f8b264b4640 1 -- 172.21.15.151:0/690911700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b200b1440 msgr2=0x7f8b200cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f8b264b4640 1 --2- 172.21.15.151:0/690911700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b200b1440 0x7f8b200cb2e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b200b1b40 tx=0x7f8b1402b880 comp rx=0 tx=0).stop 2023-10-18T11:10:29.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f1cf2a10640 1 --2- 172.21.15.151:0/1751256958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec15d170 0x7f1cec0cac40 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009870 tx=0x7f1cd402b980 comp rx=0 tx=0).stop 2023-10-18T11:10:29.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f1cf2a10640 1 -- 172.21.15.151:0/1751256958 >> 172.21.15.151:0/1751256958 conn(0x7f1cec0659d0 msgr2=0x7f1cec065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f1cf2a10640 1 -- 172.21.15.151:0/1751256958 shutdown_connections 2023-10-18T11:10:29.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f0965c11640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f095800e200 0x7f09580d9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38742/0 (socket says 172.21.15.151:38742) 2023-10-18T11:10:29.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.273+0000 7f0965c11640 1 -- 172.21.15.151:0/401210150 learned_addr learned my addr 172.21.15.151:0/401210150 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f1cf2a10640 1 -- 172.21.15.151:0/1751256958 wait complete. 2023-10-18T11:10:29.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f8b264b4640 1 -- 172.21.15.151:0/690911700 shutdown_connections 2023-10-18T11:10:29.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f8b264b4640 1 --2- 172.21.15.151:0/690911700 >> v2:172.21.15.169:3300/0 conn(0x7f8b200cb820 0x7f8b20159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f8b264b4640 1 --2- 172.21.15.151:0/690911700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b200b1440 0x7f8b200cb2e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f8b264b4640 1 --2- 172.21.15.151:0/690911700 >> v2:172.21.15.151:3300/0 conn(0x7f8b20153510 0x7f8b200ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f8b264b4640 1 -- 172.21.15.151:0/690911700 >> 172.21.15.151:0/690911700 conn(0x7f8b200659d0 msgr2=0x7f8b20065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.275+0000 7f743259c640 1 --2- 172.21.15.151:0/3758127467 >> v2:172.21.15.151:3300/0 conn(0x7f7434165da0 0x7f74340c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.274+0000 7f8b264b4640 1 -- 172.21.15.151:0/690911700 shutdown_connections 2023-10-18T11:10:29.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.275+0000 7f8b264b4640 1 -- 172.21.15.151:0/690911700 wait complete. 2023-10-18T11:10:29.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.277+0000 7f1cf2a10640 1 Processor -- start 2023-10-18T11:10:29.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.277+0000 7f0966412640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f09580d85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.278+0000 7f62758bb640 1 Processor -- start 2023-10-18T11:10:29.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.278+0000 7f8b264b4640 1 Processor -- start 2023-10-18T11:10:29.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.277+0000 7f1cf2a10640 1 -- start start 2023-10-18T11:10:29.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.279+0000 7f26a9ffb640 1 -- 172.21.15.151:0/4063509021 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694030860 con 0x7f26ac0c70a0 2023-10-18T11:10:29.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.279+0000 7f1cf2a10640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cec0c9650 0x7f1cec14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f1cf2a10640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec0cbe20 0x7f1cec1ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.279+0000 7f26a9ffb640 1 -- 172.21.15.151:0/4063509021 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26940309c0 con 0x7f26ac0c70a0 2023-10-18T11:10:29.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.278+0000 7f8b264b4640 1 -- start start 2023-10-18T11:10:29.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f1cf2a10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cec1e61d0 0x7f1cec1ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f1cf2a10640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec1531e0 con 0x7f1cec1e61d0 2023-10-18T11:10:29.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f1cf2a10640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec150da0 con 0x7f1cec0c9650 2023-10-18T11:10:29.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f26a9ffb640 1 -- 172.21.15.151:0/4063509021 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694030d50 con 0x7f26ac0c70a0 2023-10-18T11:10:29.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f1cf2a10640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0ce4c0 con 0x7f1cec0cbe20 2023-10-18T11:10:29.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f8b264b4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b200b1440 0x7f8b2014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f8b264b4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b200cb820 0x7f8b20154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7faba37fe640 1 -- 172.21.15.151:0/1924348683 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c02cb10 con 0x7faba406de00 2023-10-18T11:10:29.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7faba37fe640 1 -- 172.21.15.151:0/1924348683 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c02cc70 con 0x7faba406de00 2023-10-18T11:10:29.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f8b264b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b20153510 0x7f8b201560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.278+0000 7f62758bb640 1 -- start start 2023-10-18T11:10:29.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7f62758bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62701501d0 0x7f62701565b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f62758bb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f62700c5f70 0x7f62700c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f62758bb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6270156af0 0x7f62700c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f62758bb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6270156190 con 0x7f62700c5f70 2023-10-18T11:10:29.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f62758bb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62701593c0 con 0x7f6270156af0 2023-10-18T11:10:29.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f62758bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6270155dd0 con 0x7f62701501d0 2023-10-18T11:10:29.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f8b264b4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20155c40 con 0x7f8b200cb820 2023-10-18T11:10:29.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f8b264b4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20155660 con 0x7f8b200b1440 2023-10-18T11:10:29.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.280+0000 7faba37fe640 1 -- 172.21.15.151:0/1924348683 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0343f0 con 0x7faba406de00 2023-10-18T11:10:29.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f8b264b4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200cf6f0 con 0x7f8b20153510 2023-10-18T11:10:29.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f26b156e640 1 -- 172.21.15.151:0/4063509021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac0c70a0 msgr2=0x7f26ac0c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f26b156e640 1 --2- 172.21.15.151:0/4063509021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac0c70a0 0x7f26ac0c51b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0725a0 tx=0x7f269402b9a0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f26b156e640 1 -- 172.21.15.151:0/4063509021 shutdown_connections 2023-10-18T11:10:29.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f26b156e640 1 --2- 172.21.15.151:0/4063509021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac0c70a0 0x7f26ac0c51b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f26b156e640 1 --2- 172.21.15.151:0/4063509021 >> v2:172.21.15.151:3300/0 conn(0x7f26ac0c6cc0 0x7f26ac15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7fabaaf97640 1 -- 172.21.15.151:0/1924348683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba406de00 msgr2=0x7faba40c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7fabaaf97640 1 --2- 172.21.15.151:0/1924348683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba406de00 0x7faba40c4e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faba40c4ac0 tx=0x7fab9c02bf70 comp rx=0 tx=0).stop 2023-10-18T11:10:29.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7fabaaf97640 1 -- 172.21.15.151:0/1924348683 shutdown_connections 2023-10-18T11:10:29.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7fabaaf97640 1 --2- 172.21.15.151:0/1924348683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba406de00 0x7faba40c4e60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7fabaaf97640 1 --2- 172.21.15.151:0/1924348683 >> v2:172.21.15.151:3300/0 conn(0x7faba40c2180 0x7faba406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7fabaaf97640 1 -- 172.21.15.151:0/1924348683 >> 172.21.15.151:0/1924348683 conn(0x7faba4069f70 msgr2=0x7faba406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7f0966412640 1 -- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f095800e200 msgr2=0x7f09580d9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7f0966412640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f095800e200 0x7f09580d9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7f0966412640 1 -- 172.21.15.151:0/401210150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f095804c350 msgr2=0x7f09580d7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7f0966412640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f095804c350 0x7f09580d7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7f0966412640 1 -- 172.21.15.151:0/401210150 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580df600 con 0x7f09580d6ba0 2023-10-18T11:10:29.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7fabaaf97640 1 -- 172.21.15.151:0/1924348683 shutdown_connections 2023-10-18T11:10:29.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.281+0000 7f26b156e640 1 -- 172.21.15.151:0/4063509021 >> 172.21.15.151:0/4063509021 conn(0x7f26ac069f70 msgr2=0x7f26ac06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7f26b156e640 1 -- 172.21.15.151:0/4063509021 shutdown_connections 2023-10-18T11:10:29.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7f26b156e640 1 -- 172.21.15.151:0/4063509021 wait complete. 2023-10-18T11:10:29.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.282+0000 7fabaaf97640 1 -- 172.21.15.151:0/1924348683 wait complete. 2023-10-18T11:10:29.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.284+0000 7f26b156e640 1 Processor -- start 2023-10-18T11:10:29.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.284+0000 7f26b156e640 1 -- start start 2023-10-18T11:10:29.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.285+0000 7f0966412640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f09580d85b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f095000c340 tx=0x7f095000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.285+0000 7fabaaf97640 1 Processor -- start 2023-10-18T11:10:29.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.285+0000 7f8b24a51640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b20153510 0x7f8b201560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.285+0000 7fabaaf97640 1 -- start start 2023-10-18T11:10:29.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7f1ceb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec0cbe20 0x7f1cec1ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7f26b156e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac06da40 0x7f26ac15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7f26b156e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26ac0c6cc0 0x7f26ac1f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7f26b156e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26ac0c70a0 0x7f26ac1f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7f26b156e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac1605d0 con 0x7f26ac0c70a0 2023-10-18T11:10:29.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7f26b156e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac160890 con 0x7f26ac06da40 2023-10-18T11:10:29.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7f26b156e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac160b70 con 0x7f26ac0c6cc0 2023-10-18T11:10:29.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7fabaaf97640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba406de00 0x7faba41f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7f8b24a51640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b20153510 0x7f8b201560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57236/0 (socket says 172.21.15.151:57236) 2023-10-18T11:10:29.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.286+0000 7f8b24a51640 1 -- 172.21.15.151:0/280815533 learned_addr learned my addr 172.21.15.151:0/280815533 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.287+0000 7fabaaf97640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba40c2180 0x7faba4151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.287+0000 7fabaaf97640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba41510a0 0x7faba414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.287+0000 7fabaaf97640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba41f6ca0 con 0x7faba406de00 2023-10-18T11:10:29.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.287+0000 7fabaaf97640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba414c460 con 0x7faba40c2180 2023-10-18T11:10:29.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.287+0000 7fabaaf97640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba414c740 con 0x7faba41510a0 2023-10-18T11:10:29.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.287+0000 7f626effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62701501d0 0x7f62701565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.287+0000 7f8b1ffff640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b200b1440 0x7f8b2014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.287+0000 7f1ceb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec0cbe20 0x7f1cec1ef1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57230/0 (socket says 172.21.15.151:57230) 2023-10-18T11:10:29.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.287+0000 7f1ceb7fe640 1 -- 172.21.15.151:0/944528924 learned_addr learned my addr 172.21.15.151:0/944528924 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.288+0000 7f626effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62701501d0 0x7f62701565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57244/0 (socket says 172.21.15.151:57244) 2023-10-18T11:10:29.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.288+0000 7f626effd640 1 -- 172.21.15.151:0/3345828009 learned_addr learned my addr 172.21.15.151:0/3345828009 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.288+0000 7f626f7fe640 1 --2- 172.21.15.151:0/3345828009 >> v2:172.21.15.169:3300/0 conn(0x7f6270156af0 0x7f62700c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.288+0000 7efdb6da9640 1 Processor -- start 2023-10-18T11:10:29.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.289+0000 7efdb6da9640 1 -- start start 2023-10-18T11:10:29.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.290+0000 7f1cebfff640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cec0c9650 0x7f1cec14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.290+0000 7efdb6da9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdb015af50 0x7efdb00c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.290+0000 7efdb6da9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efdb00cd190 0x7efdb00659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.290+0000 7efdb6da9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb0151470 con 0x7efdb0151090 2023-10-18T11:10:29.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.290+0000 7efdb6da9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb00c8f00 con 0x7efdb00cd190 2023-10-18T11:10:29.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.290+0000 7efdb6da9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb015aac0 con 0x7efdb015af50 2023-10-18T11:10:29.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.292+0000 7f1cf0fad640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cec1e61d0 0x7f1cec1ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f626f7fe640 1 -- 172.21.15.151:0/3345828009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62701501d0 msgr2=0x7f62701565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f626f7fe640 1 --2- 172.21.15.151:0/3345828009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62701501d0 0x7f62701565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f626f7fe640 1 -- 172.21.15.151:0/3345828009 >> v2:172.21.15.151:3300/0 conn(0x7f62700c5f70 msgr2=0x7f62700c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f626f7fe640 1 --2- 172.21.15.151:0/3345828009 >> v2:172.21.15.151:3300/0 conn(0x7f62700c5f70 0x7f62700c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f626f7fe640 1 -- 172.21.15.151:0/3345828009 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700c7250 con 0x7f6270156af0 2023-10-18T11:10:29.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f8b24a51640 1 -- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b200b1440 msgr2=0x7f8b2014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f8b24a51640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b200b1440 0x7f8b2014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f8b24a51640 1 -- 172.21.15.151:0/280815533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b200cb820 msgr2=0x7f8b20154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f8b24a51640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b200cb820 0x7f8b20154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.293+0000 7f8b24a51640 1 -- 172.21.15.151:0/280815533 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b140094d0 con 0x7f8b20153510 2023-10-18T11:10:29.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.297+0000 7f1ceb7fe640 1 -- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cec0c9650 msgr2=0x7f1cec14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.297+0000 7f1ceb7fe640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cec0c9650 0x7f1cec14df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.297+0000 7f1ceb7fe640 1 -- 172.21.15.151:0/944528924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cec1e61d0 msgr2=0x7f1cec1ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.297+0000 7f1ceb7fe640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cec1e61d0 0x7f1cec1ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.297+0000 7f1ceb7fe640 1 -- 172.21.15.151:0/944528924 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd40094d0 con 0x7f1cec0cbe20 2023-10-18T11:10:29.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.297+0000 7f743259c640 1 -- 172.21.15.151:0/3758127467 >> v1:172.21.15.169:6789/0 conn(0x7f74340c51b0 legacy=0x7f743406d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.297+0000 7f743259c640 1 -- 172.21.15.151:0/3758127467 >> v1:172.21.15.151:6789/0 conn(0x7f74341633b0 legacy=0x7f74340c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.297+0000 7f743259c640 1 -- 172.21.15.151:0/3758127467 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74340c4f80 con 0x7f7434165da0 2023-10-18T11:10:29.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.302+0000 7f743259c640 1 --2- 172.21.15.151:0/3758127467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7434165da0 0x7f74340c7460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74280097a0 tx=0x7f742802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354acaa3ad51395f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.303+0000 7f8b24a51640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b20153510 0x7f8b201560d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800cc30 tx=0x7f8b1800a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.303+0000 7faba3fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba40c2180 0x7faba4151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.303+0000 7f626f7fe640 1 --2- 172.21.15.151:0/3345828009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6270156af0 0x7f62700c4c40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f627006c5c0 tx=0x7f626802bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=106721ff8435e4d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.304+0000 7faba3fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba40c2180 0x7faba4151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38792/0 (socket says 172.21.15.151:38792) 2023-10-18T11:10:29.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.304+0000 7faba3fff640 1 -- 172.21.15.151:0/2791133949 learned_addr learned my addr 172.21.15.151:0/2791133949 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.305+0000 7f1ceb7fe640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec0cbe20 0x7f1cec1ef1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009870 tx=0x7f1cd4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.305+0000 7efdb4b45640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7efdb0151090 0x7efdb0156ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50012/0 (socket says 172.21.15.151:50012) 2023-10-18T11:10:29.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.305+0000 7efdb4b45640 1 -- 172.21.15.151:0/3954975724 learned_addr learned my addr 172.21.15.151:0/3954975724 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:29.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.308+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26ac0c70a0 0x7f26ac1f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.310+0000 7f09567fc640 1 -- 172.21.15.151:0/401210150 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09500052d0 con 0x7f09580d6ba0 2023-10-18T11:10:29.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.310+0000 7f09567fc640 1 -- 172.21.15.151:0/401210150 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0950005430 con 0x7f09580d6ba0 2023-10-18T11:10:29.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.310+0000 7f09567fc640 1 -- 172.21.15.151:0/401210150 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950003830 con 0x7f09580d6ba0 2023-10-18T11:10:29.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.310+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09580d74d0 con 0x7f09580d6ba0 2023-10-18T11:10:29.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.310+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26ac0c70a0 0x7f26ac1f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44778/0 (socket says 172.21.15.151:44778) 2023-10-18T11:10:29.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.310+0000 7f26ab7fe640 1 -- 172.21.15.151:0/3744074382 learned_addr learned my addr 172.21.15.151:0/3744074382 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.310+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09580d7a90 con 0x7f09580d6ba0 2023-10-18T11:10:29.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.310+0000 7faba8d33640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba406de00 0x7faba41f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.311+0000 7efdb5346640 1 --2- 172.21.15.151:0/3954975724 >> v2:172.21.15.151:3300/0 conn(0x7efdb00cd190 0x7efdb00659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.311+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0958034140 con 0x7f09580d6ba0 2023-10-18T11:10:29.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7f8b1cff9640 1 -- 172.21.15.151:0/280815533 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1800cc60 con 0x7f8b20153510 2023-10-18T11:10:29.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7f8b1cff9640 1 -- 172.21.15.151:0/280815533 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1800cdc0 con 0x7f8b20153510 2023-10-18T11:10:29.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7f8b1cff9640 1 -- 172.21.15.151:0/280815533 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18003bb0 con 0x7f8b20153510 2023-10-18T11:10:29.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b20153c10 con 0x7f8b20153510 2023-10-18T11:10:29.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b201558d0 con 0x7f8b20153510 2023-10-18T11:10:29.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7faba3fff640 1 -- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba41510a0 msgr2=0x7faba414b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7faba3fff640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faba41510a0 0x7faba414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7faba3fff640 1 -- 172.21.15.151:0/2791133949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba406de00 msgr2=0x7faba41f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7faba3fff640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba406de00 0x7faba41f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.313+0000 7faba3fff640 1 -- 172.21.15.151:0/2791133949 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c009b30 con 0x7faba40c2180 2023-10-18T11:10:29.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.314+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b00000fc0 con 0x7f8b20153510 2023-10-18T11:10:29.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.314+0000 7f26aaffd640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac06da40 0x7f26ac15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.315+0000 7f26aa7fc640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26ac0c6cc0 0x7f26ac1f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.315+0000 7efdb5346640 1 -- 172.21.15.151:0/3954975724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdb015af50 msgr2=0x7efdb00c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.315+0000 7efdb5346640 1 --2- 172.21.15.151:0/3954975724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdb015af50 0x7efdb00c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.315+0000 7efdb5346640 1 -- 172.21.15.151:0/3954975724 >> v1:172.21.15.169:6789/0 conn(0x7efdb0151090 legacy=0x7efdb0156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.315+0000 7efdb5346640 1 -- 172.21.15.151:0/3954975724 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00c8940 con 0x7efdb00cd190 2023-10-18T11:10:29.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.317+0000 7faba3fff640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba40c2180 0x7faba4151dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fab9000b4a0 tx=0x7fab9000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.321+0000 7f743159a640 1 -- 172.21.15.151:0/3758127467 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428030610 con 0x7f7434165da0 2023-10-18T11:10:29.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.322+0000 7f743159a640 1 -- 172.21.15.151:0/3758127467 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428030770 con 0x7f7434165da0 2023-10-18T11:10:29.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.322+0000 7f743159a640 1 -- 172.21.15.151:0/3758127467 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428030b00 con 0x7f7434165da0 2023-10-18T11:10:29.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.322+0000 7f7438a9b640 1 -- 172.21.15.151:0/3758127467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7434165da0 msgr2=0x7f74340c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.322+0000 7f7438a9b640 1 --2- 172.21.15.151:0/3758127467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7434165da0 0x7f74340c7460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74280097a0 tx=0x7f742802b960 comp rx=0 tx=0).stop 2023-10-18T11:10:29.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.322+0000 7f7438a9b640 1 -- 172.21.15.151:0/3758127467 shutdown_connections 2023-10-18T11:10:29.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.322+0000 7f7438a9b640 1 --2- 172.21.15.151:0/3758127467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7434165da0 0x7f74340c7460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.322+0000 7f7438a9b640 1 -- 172.21.15.151:0/3758127467 >> 172.21.15.151:0/3758127467 conn(0x7f7434069f70 msgr2=0x7f743406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.323+0000 7f7438a9b640 1 -- 172.21.15.151:0/3758127467 shutdown_connections 2023-10-18T11:10:29.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.323+0000 7f7438a9b640 1 -- 172.21.15.151:0/3758127467 wait complete. 2023-10-18T11:10:29.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.324+0000 7efdb5346640 1 --2- 172.21.15.151:0/3954975724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdb00cd190 0x7efdb00659d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efda8009d90 tx=0x7efda802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d83f3d84ded087b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.324+0000 7f7438a9b640 1 Processor -- start 2023-10-18T11:10:29.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.325+0000 7f7438a9b640 1 -- start start 2023-10-18T11:10:29.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.325+0000 7f26aaffd640 1 -- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26ac0c6cc0 msgr2=0x7f26ac1f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.325+0000 7f26aaffd640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26ac0c6cc0 0x7f26ac1f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.326+0000 7f7438a9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74340c51b0 0x7f743416b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.326+0000 7f7438a9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74341633b0 0x7f7434203000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.326+0000 7f7438a9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7434165da0 0x7f74340c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.326+0000 7f7438a9b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340c3220 con 0x7f74340c51b0 2023-10-18T11:10:29.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.326+0000 7f7438a9b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743416d2b0 con 0x7f7434165da0 2023-10-18T11:10:29.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.326+0000 7f7438a9b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743416ba60 con 0x7f74341633b0 2023-10-18T11:10:29.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.326+0000 7f26aaffd640 1 -- 172.21.15.151:0/3744074382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26ac0c70a0 msgr2=0x7f26ac1f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.326+0000 7f26aaffd640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26ac0c70a0 0x7f26ac1f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.326+0000 7f26aaffd640 1 -- 172.21.15.151:0/3744074382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26940094d0 con 0x7f26ac06da40 2023-10-18T11:10:29.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.328+0000 7faba17fa640 1 -- 172.21.15.151:0/2791133949 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90010610 con 0x7faba40c2180 2023-10-18T11:10:29.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.328+0000 7faba17fa640 1 -- 172.21.15.151:0/2791133949 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab90010790 con 0x7faba40c2180 2023-10-18T11:10:29.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.328+0000 7faba17fa640 1 -- 172.21.15.151:0/2791133949 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90010b40 con 0x7faba40c2180 2023-10-18T11:10:29.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.328+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40bf600 con 0x7faba40c2180 2023-10-18T11:10:29.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.328+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba40bfbc0 con 0x7faba40c2180 2023-10-18T11:10:29.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.329+0000 7f7432d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7434165da0 0x7f74340c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.329+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faba40c2d70 con 0x7faba40c2180 2023-10-18T11:10:29.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.330+0000 7f7432d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7434165da0 0x7f74340c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38798/0 (socket says 172.21.15.151:38798) 2023-10-18T11:10:29.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.330+0000 7f7432d9d640 1 -- 172.21.15.151:0/993971295 learned_addr learned my addr 172.21.15.151:0/993971295 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.332+0000 7f743259c640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74340c51b0 0x7f743416b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.336+0000 7f626e7fc640 1 -- 172.21.15.151:0/3345828009 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626802cab0 con 0x7f6270156af0 2023-10-18T11:10:29.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.337+0000 7f626e7fc640 1 -- 172.21.15.151:0/3345828009 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626802cc10 con 0x7f6270156af0 2023-10-18T11:10:29.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.337+0000 7f626e7fc640 1 -- 172.21.15.151:0/3345828009 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268034440 con 0x7f6270156af0 2023-10-18T11:10:29.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.337+0000 7f62758bb640 1 -- 172.21.15.151:0/3345828009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6270156af0 msgr2=0x7f62700c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.337+0000 7f62758bb640 1 --2- 172.21.15.151:0/3345828009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6270156af0 0x7f62700c4c40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f627006c5c0 tx=0x7f626802bd00 comp rx=0 tx=0).stop 2023-10-18T11:10:29.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.337+0000 7f62758bb640 1 -- 172.21.15.151:0/3345828009 shutdown_connections 2023-10-18T11:10:29.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.337+0000 7f62758bb640 1 --2- 172.21.15.151:0/3345828009 >> v2:172.21.15.151:3300/0 conn(0x7f62700c5f70 0x7f62700c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.337+0000 7f62758bb640 1 --2- 172.21.15.151:0/3345828009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6270156af0 0x7f62700c4c40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.337+0000 7f62758bb640 1 --2- 172.21.15.151:0/3345828009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62701501d0 0x7f62701565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.337+0000 7f62758bb640 1 -- 172.21.15.151:0/3345828009 >> 172.21.15.151:0/3345828009 conn(0x7f627006b080 msgr2=0x7f627006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.338+0000 7f62758bb640 1 -- 172.21.15.151:0/3345828009 shutdown_connections 2023-10-18T11:10:29.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.338+0000 7f62758bb640 1 -- 172.21.15.151:0/3345828009 wait complete. 2023-10-18T11:10:29.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.338+0000 7f743259c640 1 -- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74341633b0 msgr2=0x7f7434203000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.338+0000 7f743259c640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74341633b0 0x7f7434203000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.338+0000 7f743259c640 1 -- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7434165da0 msgr2=0x7f74340c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.338+0000 7f743259c640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7434165da0 0x7f74340c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.338+0000 7f743259c640 1 -- 172.21.15.151:0/993971295 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009400 con 0x7f74340c51b0 2023-10-18T11:10:29.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.338+0000 7f7432d9d640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7434165da0 0x7f74340c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T11:10:29.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.340+0000 7f62758bb640 1 Processor -- start 2023-10-18T11:10:29.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.340+0000 7f62758bb640 1 -- start start 2023-10-18T11:10:29.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.341+0000 7f743259c640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74340c51b0 0x7f743416b520 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7428033000 tx=0x7f7428004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.341+0000 7f62758bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62700c5f70 0x7f6270153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.342+0000 7f62758bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62701501d0 0x7f62701f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.342+0000 7f62758bb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270156af0 0x7f6270150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.342+0000 7f62758bb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6270152ee0 con 0x7f6270156af0 2023-10-18T11:10:29.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.342+0000 7f62758bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627014ae80 con 0x7f62700c5f70 2023-10-18T11:10:29.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.342+0000 7f62758bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6270152890 con 0x7f62701501d0 2023-10-18T11:10:29.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.347+0000 7f09567fc640 1 -- 172.21.15.151:0/401210150 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0950003990 con 0x7f09580d6ba0 2023-10-18T11:10:29.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.347+0000 7f626f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270156af0 0x7f6270150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.348+0000 7f09567fc640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f094406aec0 0x7f094406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.348+0000 7efdaf7fe640 1 -- 172.21.15.151:0/3954975724 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda802cc60 con 0x7efdb00cd190 2023-10-18T11:10:29.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.348+0000 7efdaf7fe640 1 -- 172.21.15.151:0/3954975724 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda802cdc0 con 0x7efdb00cd190 2023-10-18T11:10:29.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.348+0000 7f626f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270156af0 0x7f6270150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44808/0 (socket says 172.21.15.151:44808) 2023-10-18T11:10:29.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.348+0000 7f626f7fe640 1 -- 172.21.15.151:0/3184279232 learned_addr learned my addr 172.21.15.151:0/3184279232 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.348+0000 7efdaf7fe640 1 -- 172.21.15.151:0/3954975724 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8034660 con 0x7efdb00cd190 2023-10-18T11:10:29.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.348+0000 7f0965c11640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f094406aec0 0x7f094406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7f0965c11640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f094406aec0 0x7f094406d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0960068ac0 tx=0x7f09600b0040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7efdb6da9640 1 -- 172.21.15.151:0/3954975724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdb00cd190 msgr2=0x7efdb00659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7efdb6da9640 1 --2- 172.21.15.151:0/3954975724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdb00cd190 0x7efdb00659d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efda8009d90 tx=0x7efda802beb0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7efdb6da9640 1 -- 172.21.15.151:0/3954975724 shutdown_connections 2023-10-18T11:10:29.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7efdb6da9640 1 --2- 172.21.15.151:0/3954975724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdb00cd190 0x7efdb00659d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7efdb6da9640 1 --2- 172.21.15.151:0/3954975724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdb015af50 0x7efdb00c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7efdb6da9640 1 -- 172.21.15.151:0/3954975724 >> 172.21.15.151:0/3954975724 conn(0x7efdb006e210 msgr2=0x7efdb006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7f09567fc640 1 -- 172.21.15.151:0/401210150 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0950058070 con 0x7f09580d6ba0 2023-10-18T11:10:29.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7efdb6da9640 1 -- 172.21.15.151:0/3954975724 shutdown_connections 2023-10-18T11:10:29.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.349+0000 7efdb6da9640 1 -- 172.21.15.151:0/3954975724 wait complete. 2023-10-18T11:10:29.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.350+0000 7f09567fc640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f0944074720 0x7f0944076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.350+0000 7f09567fc640 1 -- 172.21.15.151:0/401210150 --> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0944077290 con 0x7f0944074720 2023-10-18T11:10:29.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.350+0000 7f0965410640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f0944074720 0x7f0944076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.350+0000 7f7422ffd640 1 -- 172.21.15.151:0/993971295 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742803e040 con 0x7f74340c51b0 2023-10-18T11:10:29.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.350+0000 7f7422ffd640 1 -- 172.21.15.151:0/993971295 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428039cb0 con 0x7f74340c51b0 2023-10-18T11:10:29.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.350+0000 7f7422ffd640 1 -- 172.21.15.151:0/993971295 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428044630 con 0x7f74340c51b0 2023-10-18T11:10:29.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.350+0000 7f7438a9b640 1 -- 172.21.15.151:0/993971295 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7434203540 con 0x7f74340c51b0 2023-10-18T11:10:29.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.351+0000 7f0965410640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f0944074720 0x7f0944076bc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.351+0000 7f7438a9b640 1 -- 172.21.15.151:0/993971295 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743416cfd0 con 0x7f74340c51b0 2023-10-18T11:10:29.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.352+0000 7f09567fc640 1 -- 172.21.15.151:0/401210150 <== osd.2 v2:172.21.15.151:6808/2359515345 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0944077290 con 0x7f0944074720 2023-10-18T11:10:29.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.351+0000 7efdb6da9640 1 Processor -- start 2023-10-18T11:10:29.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.352+0000 7efdb6da9640 1 -- start start 2023-10-18T11:10:29.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.353+0000 7f7420ff9640 1 -- 172.21.15.151:0/993971295 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f740c000fc0 con 0x7f74340c51b0 2023-10-18T11:10:29.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.353+0000 7faba17fa640 1 -- 172.21.15.151:0/2791133949 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fab90010ca0 con 0x7faba40c2180 2023-10-18T11:10:29.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.353+0000 7efdb6da9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdb00cd190 0x7efdb01f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.353+0000 7efdb6da9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdb0151090 0x7efdb014c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.353+0000 7efdb6da9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdb015af50 0x7efdb01f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.353+0000 7efdb6da9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb0152670 con 0x7efdb0151090 2023-10-18T11:10:29.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.353+0000 7efdb6da9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01f6610 con 0x7efdb015af50 2023-10-18T11:10:29.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.353+0000 7efdb6da9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01528c0 con 0x7efdb00cd190 2023-10-18T11:10:29.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.353+0000 7f09567fc640 1 -- 172.21.15.151:0/401210150 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09500543b0 con 0x7f09580d6ba0 2023-10-18T11:10:29.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.354+0000 7faba17fa640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fab8806aef0 0x7fab8806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.355+0000 7faba8d33640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fab8806aef0 0x7fab8806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.355+0000 7faba8d33640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fab8806aef0 0x7fab8806d3b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab98006fd0 tx=0x7fab98009060 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7f626f7fe640 1 -- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62701501d0 msgr2=0x7f62701f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7f626f7fe640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62701501d0 0x7f62701f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7f626f7fe640 1 -- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62700c5f70 msgr2=0x7f6270153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7f626f7fe640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62700c5f70 0x7f6270153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7f626f7fe640 1 -- 172.21.15.151:0/3184279232 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268009a70 con 0x7f6270156af0 2023-10-18T11:10:29.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7faba17fa640 1 -- 172.21.15.151:0/2791133949 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fab90058410 con 0x7faba40c2180 2023-10-18T11:10:29.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7f1ce8ff9640 1 -- 172.21.15.151:0/944528924 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40307f0 con 0x7f1cec0cbe20 2023-10-18T11:10:29.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7f1ce8ff9640 1 -- 172.21.15.151:0/944528924 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd4043400 con 0x7f1cec0cbe20 2023-10-18T11:10:29.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7faba17fa640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7fab88074750 0x7fab88076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7faba17fa640 1 -- 172.21.15.151:0/2791133949 --> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab880772c0 con 0x7fab88074750 2023-10-18T11:10:29.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7f1ce8ff9640 1 -- 172.21.15.151:0/944528924 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40437b0 con 0x7f1cec0cbe20 2023-10-18T11:10:29.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7f1cf2a10640 1 -- 172.21.15.151:0/944528924 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec0ce220 con 0x7f1cec0cbe20 2023-10-18T11:10:29.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7faba17fa640 1 -- 172.21.15.151:0/2791133949 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab90054750 con 0x7faba40c2180 2023-10-18T11:10:29.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.356+0000 7faba9534640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7fab88074750 0x7fab88076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.357+0000 7f1cf2a10640 1 -- 172.21.15.151:0/944528924 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec152f00 con 0x7f1cec0cbe20 2023-10-18T11:10:29.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.357+0000 7f26aaffd640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac06da40 0x7f26ac15e920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f269c00b3f0 tx=0x7f269c00b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.357+0000 7faba9534640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7fab88074750 0x7fab88076bf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.358+0000 7f1cf2a10640 1 -- 172.21.15.151:0/944528924 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cec152aa0 con 0x7f1cec0cbe20 2023-10-18T11:10:29.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.358+0000 7faba17fa640 1 -- 172.21.15.151:0/2791133949 <== osd.5 v2:172.21.15.169:6808/2415009442 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fab880772c0 con 0x7fab88074750 2023-10-18T11:10:29.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.360+0000 7efdaffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdb0151090 0x7efdb014c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.361+0000 7f626f7fe640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270156af0 0x7f6270150910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f626802c310 tx=0x7f6268004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.363+0000 7f26a37fe640 1 -- 172.21.15.151:0/3744074382 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c011830 con 0x7f26ac06da40 2023-10-18T11:10:29.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.364+0000 7f26a37fe640 1 -- 172.21.15.151:0/3744074382 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c011990 con 0x7f26ac06da40 2023-10-18T11:10:29.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.364+0000 7f26a37fe640 1 -- 172.21.15.151:0/3744074382 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c011d40 con 0x7f26ac06da40 2023-10-18T11:10:29.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.365+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac160e50 con 0x7f26ac06da40 2023-10-18T11:10:29.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.365+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac15ee60 con 0x7f26ac06da40 2023-10-18T11:10:29.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.365+0000 7efdb5346640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdb015af50 0x7efdb01f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.366+0000 7efdb5346640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdb015af50 0x7efdb01f59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38814/0 (socket says 172.21.15.151:38814) 2023-10-18T11:10:29.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.366+0000 7efdb5346640 1 -- 172.21.15.151:0/4069258748 learned_addr learned my addr 172.21.15.151:0/4069258748 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.366+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f26ac15e280 con 0x7f26ac06da40 2023-10-18T11:10:29.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.370+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 --> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0958033e60 con 0x7f0944074720 2023-10-18T11:10:29.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.371+0000 7f09567fc640 1 -- 172.21.15.151:0/401210150 <== osd.2 v2:172.21.15.151:6808/2359515345 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f095c0096c0 con 0x7f0944074720 2023-10-18T11:10:29.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.371+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f0944074720 msgr2=0x7f0944076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.371+0000 7f0967e75640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f0944074720 0x7f0944076bc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.371+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f094406aec0 msgr2=0x7f094406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.371+0000 7f0967e75640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f094406aec0 0x7f094406d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0960068ac0 tx=0x7f09600b0040 comp rx=0 tx=0).stop 2023-10-18T11:10:29.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.372+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 msgr2=0x7f09580d85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.372+0000 7f0967e75640 1 --2- 172.21.15.151:0/401210150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09580d6ba0 0x7f09580d85b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f095000c340 tx=0x7f095000c800 comp rx=0 tx=0).stop 2023-10-18T11:10:29.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.371+0000 7f8b1cff9640 1 -- 172.21.15.151:0/280815533 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8b1800f3f0 con 0x7f8b20153510 2023-10-18T11:10:29.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.372+0000 7f0966412640 1 -- 172.21.15.151:0/401210150 reap_dead start 2023-10-18T11:10:29.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.372+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 shutdown_connections 2023-10-18T11:10:29.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.372+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 >> 172.21.15.151:0/401210150 conn(0x7f09580501c0 msgr2=0x7f0958046310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.372+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 shutdown_connections 2023-10-18T11:10:29.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.372+0000 7f0967e75640 1 -- 172.21.15.151:0/401210150 wait complete. 2023-10-18T11:10:29.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.373+0000 7f8b1cff9640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8b0c06aec0 0x7f8b0c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.373+0000 7f8b1ffff640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8b0c06aec0 0x7f8b0c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.374+0000 7f8b1ffff640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8b0c06aec0 0x7f8b0c06d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009990 tx=0x7f8b10009110 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.375+0000 7f8b1cff9640 1 -- 172.21.15.151:0/280815533 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8b18059340 con 0x7f8b20153510 2023-10-18T11:10:29.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.375+0000 7f8b1cff9640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f8b0c074720 0x7f8b0c076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.375+0000 7f8b1cff9640 1 -- 172.21.15.151:0/280815533 --> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b0c077290 con 0x7f8b0c074720 2023-10-18T11:10:29.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.375+0000 7f8b1cff9640 1 -- 172.21.15.151:0/280815533 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b18054f80 con 0x7f8b20153510 2023-10-18T11:10:29.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.375+0000 7f8b1f7fe640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f8b0c074720 0x7f8b0c076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.376+0000 7f8b1f7fe640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f8b0c074720 0x7f8b0c076bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.376+0000 7efdaffff640 1 -- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdb00cd190 msgr2=0x7efdb01f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.376+0000 7efdaffff640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdb00cd190 0x7efdb01f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.377+0000 7efdaffff640 1 -- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdb015af50 msgr2=0x7efdb01f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.377+0000 7efdaffff640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdb015af50 0x7efdb01f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.377+0000 7efdaffff640 1 -- 172.21.15.151:0/4069258748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8009a70 con 0x7efdb0151090 2023-10-18T11:10:29.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.377+0000 7f8b1cff9640 1 -- 172.21.15.151:0/280815533 <== osd.4 v2:172.21.15.169:6800/2104783334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8b0c077290 con 0x7f8b0c074720 2023-10-18T11:10:29.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.377+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 --> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faba40c2a90 con 0x7fab88074750 2023-10-18T11:10:29.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.378+0000 7faba17fa640 1 -- 172.21.15.151:0/2791133949 <== osd.5 v2:172.21.15.169:6808/2415009442 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fab9c02ca90 con 0x7fab88074750 2023-10-18T11:10:29.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.379+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7fab88074750 msgr2=0x7fab88076bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.379+0000 7fabaaf97640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7fab88074750 0x7fab88076bf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.379+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fab8806aef0 msgr2=0x7fab8806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.379+0000 7fabaaf97640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fab8806aef0 0x7fab8806d3b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab98006fd0 tx=0x7fab98009060 comp rx=0 tx=0).stop 2023-10-18T11:10:29.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.379+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba40c2180 msgr2=0x7faba4151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.379+0000 7fabaaf97640 1 --2- 172.21.15.151:0/2791133949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faba40c2180 0x7faba4151dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fab9000b4a0 tx=0x7fab9000b960 comp rx=0 tx=0).stop 2023-10-18T11:10:29.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.379+0000 7faba9534640 1 -- 172.21.15.151:0/2791133949 reap_dead start 2023-10-18T11:10:29.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.379+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 shutdown_connections 2023-10-18T11:10:29.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.379+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 >> 172.21.15.151:0/2791133949 conn(0x7faba4069f70 msgr2=0x7faba40c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.380+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 shutdown_connections 2023-10-18T11:10:29.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.380+0000 7fabaaf97640 1 -- 172.21.15.151:0/2791133949 wait complete. 2023-10-18T11:10:29.393 INFO:teuthology.orchestra.run.smithi151.stdout:64424509458 2023-10-18T11:10:29.394 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-18T11:10:29.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.395+0000 7f26a37fe640 1 -- 172.21.15.151:0/3744074382 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f269c01a400 con 0x7f26ac06da40 2023-10-18T11:10:29.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.396+0000 7f26a37fe640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f268c06aec0 0x7f268c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.397+0000 7f26aa7fc640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f268c06aec0 0x7f268c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.397+0000 7f26a37fe640 1 -- 172.21.15.151:0/3744074382 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f269c059140 con 0x7f26ac06da40 2023-10-18T11:10:29.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.398+0000 7f26aa7fc640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f268c06aec0 0x7f268c06d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2694036000 tx=0x7f2694008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.398+0000 7f26a37fe640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f268c0747a0 0x7f268c076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.398+0000 7f26a37fe640 1 -- 172.21.15.151:0/3744074382 --> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f268c077310 con 0x7f268c0747a0 2023-10-18T11:10:29.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.398+0000 7f26ab7fe640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f268c0747a0 0x7f268c076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f26a37fe640 1 -- 172.21.15.151:0/3744074382 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f269c011ea0 con 0x7f26ac06da40 2023-10-18T11:10:29.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f26ab7fe640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f268c0747a0 0x7f268c076c40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.396+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 --> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b00002cb0 con 0x7f8b0c074720 2023-10-18T11:10:29.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.397+0000 7f8b1cff9640 1 -- 172.21.15.151:0/280815533 <== osd.4 v2:172.21.15.169:6800/2104783334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8b00002cb0 con 0x7f8b0c074720 2023-10-18T11:10:29.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.398+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f8b0c074720 msgr2=0x7f8b0c076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.398+0000 7f8b264b4640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f8b0c074720 0x7f8b0c076bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8b0c06aec0 msgr2=0x7f8b0c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f8b264b4640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8b0c06aec0 0x7f8b0c06d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009990 tx=0x7f8b10009110 comp rx=0 tx=0).stop 2023-10-18T11:10:29.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b20153510 msgr2=0x7f8b201560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f8b264b4640 1 --2- 172.21.15.151:0/280815533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b20153510 0x7f8b201560d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800cc30 tx=0x7f8b1800a5c0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f8b24a51640 1 -- 172.21.15.151:0/280815533 reap_dead start 2023-10-18T11:10:29.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 shutdown_connections 2023-10-18T11:10:29.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 >> 172.21.15.151:0/280815533 conn(0x7f8b200659d0 msgr2=0x7f8b20151210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 shutdown_connections 2023-10-18T11:10:29.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.399+0000 7f8b264b4640 1 -- 172.21.15.151:0/280815533 wait complete. 2023-10-18T11:10:29.408 INFO:teuthology.orchestra.run.smithi151.stdout:64424509458 2023-10-18T11:10:29.408 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-18T11:10:29.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.400+0000 7f26a37fe640 1 -- 172.21.15.151:0/3744074382 <== osd.1 v2:172.21.15.151:6800/3389651909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f268c077310 con 0x7f268c0747a0 2023-10-18T11:10:29.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.401+0000 7f7422ffd640 1 -- 172.21.15.151:0/993971295 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f742804d3b0 con 0x7f74340c51b0 2023-10-18T11:10:29.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.403+0000 7f7422ffd640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aef0 0x7f741406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.403+0000 7f7431d9b640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aef0 0x7f741406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.404+0000 7f7431d9b640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aef0 0x7f741406d3b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f74341fcd00 tx=0x7f7424007a40 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.409+0000 7f7422ffd640 1 -- 172.21.15.151:0/993971295 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7428039e20 con 0x7f74340c51b0 2023-10-18T11:10:29.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.409+0000 7f7422ffd640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f74140747d0 0x7f7414076c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.409+0000 7f7422ffd640 1 -- 172.21.15.151:0/993971295 --> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7414077340 con 0x7f74140747d0 2023-10-18T11:10:29.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.409+0000 7f7422ffd640 1 -- 172.21.15.151:0/993971295 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7428077430 con 0x7f74340c51b0 2023-10-18T11:10:29.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.410+0000 7f7432d9d640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f74140747d0 0x7f7414076c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.410+0000 7f626cff9640 1 -- 172.21.15.151:0/3184279232 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626803e610 con 0x7f6270156af0 2023-10-18T11:10:29.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.410+0000 7f626cff9640 1 -- 172.21.15.151:0/3184279232 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626803e770 con 0x7f6270156af0 2023-10-18T11:10:29.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.410+0000 7f626cff9640 1 -- 172.21.15.151:0/3184279232 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626803eb20 con 0x7f6270156af0 2023-10-18T11:10:29.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.410+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6270071850 con 0x7f6270156af0 2023-10-18T11:10:29.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.410+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6270152b00 con 0x7f6270156af0 2023-10-18T11:10:29.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.410+0000 7efdaffff640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdb0151090 0x7efdb014c210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00b410 tx=0x7efd9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.411+0000 7f7432d9d640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f74140747d0 0x7f7414076c70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.412+0000 7f7422ffd640 1 -- 172.21.15.151:0/993971295 <== osd.3 v2:172.21.15.151:6816/2813876037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7414077340 con 0x7f74140747d0 2023-10-18T11:10:29.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.412+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62700c2cd0 con 0x7f6270156af0 2023-10-18T11:10:29.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.421+0000 7f1ce8ff9640 1 -- 172.21.15.151:0/944528924 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1cd4043910 con 0x7f1cec0cbe20 2023-10-18T11:10:29.424 INFO:teuthology.orchestra.run.smithi151.stdout:64424509459 2023-10-18T11:10:29.425 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-18T11:10:29.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.422+0000 7f1ce8ff9640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1ccc06ae90 0x7f1ccc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.423+0000 7f1cebfff640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1ccc06ae90 0x7f1ccc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.423+0000 7f1ce8ff9640 1 -- 172.21.15.151:0/944528924 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1cd403e070 con 0x7f1cec0cbe20 2023-10-18T11:10:29.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.423+0000 7f1ce8ff9640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1ccc074770 0x7f1ccc076c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.423+0000 7f1ce8ff9640 1 -- 172.21.15.151:0/944528924 --> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ccc0772e0 con 0x7f1ccc074770 2023-10-18T11:10:29.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.424+0000 7efdad7fa640 1 -- 172.21.15.151:0/4069258748 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c011830 con 0x7efdb0151090 2023-10-18T11:10:29.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.424+0000 7f1cf0fad640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1ccc074770 0x7f1ccc076c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.424+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb0152ba0 con 0x7efdb0151090 2023-10-18T11:10:29.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.424+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb0153160 con 0x7efdb0151090 2023-10-18T11:10:29.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.425+0000 7f1cebfff640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1ccc06ae90 0x7f1ccc06d350 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc006fd0 tx=0x7f1cdc008040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.425+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efdb015a470 con 0x7efdb0151090 2023-10-18T11:10:29.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.425+0000 7f1cf0fad640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1ccc074770 0x7f1ccc076c10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.426+0000 7f1ce8ff9640 1 -- 172.21.15.151:0/944528924 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cd40780d0 con 0x7f1cec0cbe20 2023-10-18T11:10:29.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.427+0000 7f1ce8ff9640 1 -- 172.21.15.151:0/944528924 <== osd.0 v2:172.21.15.151:6824/4132618362 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1ccc0772e0 con 0x7f1ccc074770 2023-10-18T11:10:29.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.433+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 --> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f26ac15dfa0 con 0x7f268c0747a0 2023-10-18T11:10:29.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.433+0000 7f26a37fe640 1 -- 172.21.15.151:0/3744074382 <== osd.1 v2:172.21.15.151:6800/3389651909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f26a400f040 con 0x7f268c0747a0 2023-10-18T11:10:29.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.437+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f268c0747a0 msgr2=0x7f268c076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.437+0000 7f26b156e640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f268c0747a0 0x7f268c076c40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.438+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f268c06aec0 msgr2=0x7f268c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.438+0000 7f26b156e640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f268c06aec0 0x7f268c06d380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2694036000 tx=0x7f2694008030 comp rx=0 tx=0).stop 2023-10-18T11:10:29.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.438+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac06da40 msgr2=0x7f26ac15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.438+0000 7f26b156e640 1 --2- 172.21.15.151:0/3744074382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac06da40 0x7f26ac15e920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f269c00b3f0 tx=0x7f269c00b8b0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.438+0000 7f26ab7fe640 1 -- 172.21.15.151:0/3744074382 reap_dead start 2023-10-18T11:10:29.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.439+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 shutdown_connections 2023-10-18T11:10:29.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.439+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 >> 172.21.15.151:0/3744074382 conn(0x7f26ac069f70 msgr2=0x7f26ac155e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.439+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 shutdown_connections 2023-10-18T11:10:29.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.439+0000 7f26b156e640 1 -- 172.21.15.151:0/3744074382 wait complete. 2023-10-18T11:10:29.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.448+0000 7f7420ff9640 1 -- 172.21.15.151:0/993971295 --> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f740c002cb0 con 0x7f74140747d0 2023-10-18T11:10:29.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.449+0000 7f7422ffd640 1 -- 172.21.15.151:0/993971295 <== osd.3 v2:172.21.15.151:6816/2813876037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f740c002cb0 con 0x7f74140747d0 2023-10-18T11:10:29.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.450+0000 7f7438a9b640 1 -- 172.21.15.151:0/993971295 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f74140747d0 msgr2=0x7f7414076c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.450+0000 7f7438a9b640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f74140747d0 0x7f7414076c70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.451+0000 7f7438a9b640 1 -- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aef0 msgr2=0x7f741406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.451+0000 7f7438a9b640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aef0 0x7f741406d3b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f74341fcd00 tx=0x7f7424007a40 comp rx=0 tx=0).stop 2023-10-18T11:10:29.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.451+0000 7f7438a9b640 1 -- 172.21.15.151:0/993971295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74340c51b0 msgr2=0x7f743416b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.451+0000 7f7438a9b640 1 --2- 172.21.15.151:0/993971295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74340c51b0 0x7f743416b520 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7428033000 tx=0x7f7428004730 comp rx=0 tx=0).stop 2023-10-18T11:10:29.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.451+0000 7f7432d9d640 1 -- 172.21.15.151:0/993971295 reap_dead start 2023-10-18T11:10:29.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.452+0000 7f7438a9b640 1 -- 172.21.15.151:0/993971295 shutdown_connections 2023-10-18T11:10:29.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.452+0000 7f7438a9b640 1 -- 172.21.15.151:0/993971295 >> 172.21.15.151:0/993971295 conn(0x7f7434069f70 msgr2=0x7f743415f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.454+0000 7f7438a9b640 1 -- 172.21.15.151:0/993971295 shutdown_connections 2023-10-18T11:10:29.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.454+0000 7f7438a9b640 1 -- 172.21.15.151:0/993971295 wait complete. 2023-10-18T11:10:29.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.457+0000 7f1cf2a10640 1 -- 172.21.15.151:0/944528924 --> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1cec0ca5e0 con 0x7f1ccc074770 2023-10-18T11:10:29.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.458+0000 7f1ce8ff9640 1 -- 172.21.15.151:0/944528924 <== osd.0 v2:172.21.15.151:6824/4132618362 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ce4009a70 con 0x7f1ccc074770 2023-10-18T11:10:29.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.459+0000 7f1ce27fc640 1 -- 172.21.15.151:0/944528924 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1ccc074770 msgr2=0x7f1ccc076c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.459+0000 7f1ce27fc640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1ccc074770 0x7f1ccc076c10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.459+0000 7f1ce27fc640 1 -- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1ccc06ae90 msgr2=0x7f1ccc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.459+0000 7f1ce27fc640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1ccc06ae90 0x7f1ccc06d350 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc006fd0 tx=0x7f1cdc008040 comp rx=0 tx=0).stop 2023-10-18T11:10:29.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.459+0000 7f1ce27fc640 1 -- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec0cbe20 msgr2=0x7f1cec1ef1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.459+0000 7f1ce27fc640 1 --2- 172.21.15.151:0/944528924 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1cec0cbe20 0x7f1cec1ef1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009870 tx=0x7f1cd4004730 comp rx=0 tx=0).stop 2023-10-18T11:10:29.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.460+0000 7f1cf0fad640 1 -- 172.21.15.151:0/944528924 reap_dead start 2023-10-18T11:10:29.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.460+0000 7f1ce27fc640 1 -- 172.21.15.151:0/944528924 shutdown_connections 2023-10-18T11:10:29.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.460+0000 7f1ce27fc640 1 -- 172.21.15.151:0/944528924 >> 172.21.15.151:0/944528924 conn(0x7f1cec0659d0 msgr2=0x7f1cec0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.460+0000 7f1ce27fc640 1 -- 172.21.15.151:0/944528924 shutdown_connections 2023-10-18T11:10:29.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.461+0000 7f1ce27fc640 1 -- 172.21.15.151:0/944528924 wait complete. 2023-10-18T11:10:29.469 INFO:teuthology.orchestra.run.smithi151.stdout:64424509459 2023-10-18T11:10:29.469 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-18T11:10:29.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.468+0000 7f626cff9640 1 -- 172.21.15.151:0/3184279232 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f626803b050 con 0x7f6270156af0 2023-10-18T11:10:29.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.469+0000 7f626cff9640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f625006ae70 0x7f625006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.470+0000 7f626effd640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f625006ae70 0x7f625006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.472+0000 7f626effd640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f625006ae70 0x7f625006d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f62600094a0 tx=0x7f62600093f0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.475+0000 7f626cff9640 1 -- 172.21.15.151:0/3184279232 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f626807b8d0 con 0x7f6270156af0 2023-10-18T11:10:29.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.476+0000 7f626cff9640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f6250074650 0x7f6250076af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.476+0000 7f626cff9640 1 -- 172.21.15.151:0/3184279232 --> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62500771c0 con 0x7f6250074650 2023-10-18T11:10:29.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.476+0000 7f626cff9640 1 -- 172.21.15.151:0/3184279232 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6268054eb0 con 0x7f6270156af0 2023-10-18T11:10:29.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.476+0000 7f6267fff640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f6250074650 0x7f6250076af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.477+0000 7f6267fff640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f6250074650 0x7f6250076af0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.479+0000 7f626cff9640 1 -- 172.21.15.151:0/3184279232 <== osd.7 v2:172.21.15.169:6824/3969633295 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f62500771c0 con 0x7f6250074650 2023-10-18T11:10:29.484 INFO:teuthology.orchestra.run.smithi151.stdout:64424509458 2023-10-18T11:10:29.484 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-18T11:10:29.490 INFO:teuthology.orchestra.run.smithi151.stdout:64424509459 2023-10-18T11:10:29.491 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T11:10:29.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.498+0000 7efdad7fa640 1 -- 172.21.15.151:0/4069258748 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c009170 con 0x7efdb0151090 2023-10-18T11:10:29.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.498+0000 7efdad7fa640 1 -- 172.21.15.151:0/4069258748 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c011b90 con 0x7efdb0151090 2023-10-18T11:10:29.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.503+0000 7efdad7fa640 1 -- 172.21.15.151:0/4069258748 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efd9c01a400 con 0x7efdb0151090 2023-10-18T11:10:29.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.505+0000 7efdad7fa640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7efd9406aed0 0x7efd9406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.508+0000 7efdb4b45640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7efd9406aed0 0x7efd9406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.510+0000 7efdad7fa640 1 -- 172.21.15.151:0/4069258748 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efd9c0590f0 con 0x7efdb0151090 2023-10-18T11:10:29.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.510+0000 7efdad7fa640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7efd940754b0 0x7efd94077950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.510+0000 7efdad7fa640 1 -- 172.21.15.151:0/4069258748 --> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd94078020 con 0x7efd940754b0 2023-10-18T11:10:29.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.510+0000 7efdad7fa640 1 -- 172.21.15.151:0/4069258748 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd9c011b90 con 0x7efdb0151090 2023-10-18T11:10:29.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.510+0000 7efdb5346640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7efd940754b0 0x7efd94077950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.514+0000 7efdb5346640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7efd940754b0 0x7efd94077950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.514+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 --> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62700c29f0 con 0x7f6250074650 2023-10-18T11:10:29.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.514+0000 7efdb4b45640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7efd9406aed0 0x7efd9406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efda40015f0 tx=0x7efda4007a40 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.514+0000 7f626cff9640 1 -- 172.21.15.151:0/3184279232 <== osd.7 v2:172.21.15.169:6824/3969633295 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6258009840 con 0x7f6250074650 2023-10-18T11:10:29.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.515+0000 7efdad7fa640 1 -- 172.21.15.151:0/4069258748 <== osd.6 v2:172.21.15.169:6809/1118238952 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7efd94078020 con 0x7efd940754b0 2023-10-18T11:10:29.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.515+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f6250074650 msgr2=0x7f6250076af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.515+0000 7f62758bb640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f6250074650 0x7f6250076af0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.518+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f625006ae70 msgr2=0x7f625006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.518+0000 7f62758bb640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f625006ae70 0x7f625006d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f62600094a0 tx=0x7f62600093f0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.518+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270156af0 msgr2=0x7f6270150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.518+0000 7f62758bb640 1 --2- 172.21.15.151:0/3184279232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6270156af0 0x7f6270150910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f626802c310 tx=0x7f6268004a40 comp rx=0 tx=0).stop 2023-10-18T11:10:29.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.518+0000 7f626f7fe640 1 -- 172.21.15.151:0/3184279232 reap_dead start 2023-10-18T11:10:29.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.519+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 shutdown_connections 2023-10-18T11:10:29.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.519+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 >> 172.21.15.151:0/3184279232 conn(0x7f627006b080 msgr2=0x7f6270070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.519+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 shutdown_connections 2023-10-18T11:10:29.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.520+0000 7f62758bb640 1 -- 172.21.15.151:0/3184279232 wait complete. 2023-10-18T11:10:29.546 INFO:teuthology.orchestra.run.smithi151.stdout:64424509460 2023-10-18T11:10:29.547 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-18T11:10:29.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.551+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 --> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efdb00c8c20 con 0x7efd940754b0 2023-10-18T11:10:29.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.553+0000 7efdad7fa640 1 -- 172.21.15.151:0/4069258748 <== osd.6 v2:172.21.15.169:6809/1118238952 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efda80344c0 con 0x7efd940754b0 2023-10-18T11:10:29.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.553+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7efd940754b0 msgr2=0x7efd94077950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.553+0000 7efdb6da9640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7efd940754b0 0x7efd94077950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.554+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7efd9406aed0 msgr2=0x7efd9406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.554+0000 7efdb6da9640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7efd9406aed0 0x7efd9406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efda40015f0 tx=0x7efda4007a40 comp rx=0 tx=0).stop 2023-10-18T11:10:29.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.554+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdb0151090 msgr2=0x7efdb014c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.554+0000 7efdb6da9640 1 --2- 172.21.15.151:0/4069258748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdb0151090 0x7efdb014c210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00b410 tx=0x7efd9c00b8d0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.554+0000 7efdb5346640 1 -- 172.21.15.151:0/4069258748 reap_dead start 2023-10-18T11:10:29.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.554+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 shutdown_connections 2023-10-18T11:10:29.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.554+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 >> 172.21.15.151:0/4069258748 conn(0x7efdb006e210 msgr2=0x7efdb00659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.554+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 shutdown_connections 2023-10-18T11:10:29.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.554+0000 7efdb6da9640 1 -- 172.21.15.151:0/4069258748 wait complete. 2023-10-18T11:10:29.585 INFO:teuthology.orchestra.run.smithi151.stdout:60129542162 2023-10-18T11:10:29.585 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-18T11:10:29.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.704+0000 7fc0af10c640 1 Processor -- start 2023-10-18T11:10:29.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.704+0000 7fc0af10c640 1 -- start start 2023-10-18T11:10:29.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.706+0000 7fc0af10c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc0a815af50 0x7fc0a80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.706+0000 7fc0af10c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0a80cd190 0x7fc0a80659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.706+0000 7fc0af10c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a8151470 con 0x7fc0a8151090 2023-10-18T11:10:29.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.706+0000 7fc0af10c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a80c8f00 con 0x7fc0a80cd190 2023-10-18T11:10:29.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.706+0000 7fc0af10c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a815aac0 con 0x7fc0a815af50 2023-10-18T11:10:29.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.708+0000 7fe7d129a640 1 Processor -- start 2023-10-18T11:10:29.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.708+0000 7fe7d129a640 1 -- start start 2023-10-18T11:10:29.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.708+0000 7fc0a7fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc0a815af50 0x7fc0a80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.708+0000 7fc0ad6a9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0a80cd190 0x7fc0a80659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.709+0000 7fc0ad6a9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0a80cd190 0x7fc0a80659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44814/0 (socket says 172.21.15.151:44814) 2023-10-18T11:10:29.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.709+0000 7fc0ad6a9640 1 -- 172.21.15.151:0/604696852 learned_addr learned my addr 172.21.15.151:0/604696852 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.709+0000 7fc0acea8640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fc0a8151090 0x7fc0a8156ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50026/0 (socket says 172.21.15.151:50026) 2023-10-18T11:10:29.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.710+0000 7fe7d129a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc0c5380 0x7fe7cc163d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.710+0000 7fe7d129a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe7cc0c5760 0x7fe7cc1642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.711+0000 7fe7d129a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc16ab60 con 0x7fe7cc06fbd0 2023-10-18T11:10:29.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.711+0000 7fe7d129a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7cc169fc0 con 0x7fe7cc0c5760 2023-10-18T11:10:29.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.711+0000 7fe7d129a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc16a230 con 0x7fe7cc0c5380 2023-10-18T11:10:29.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.712+0000 7fe7cbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc0c5380 0x7fe7cc163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.712+0000 7fe7cbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc0c5380 0x7fe7cc163d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57298/0 (socket says 172.21.15.151:57298) 2023-10-18T11:10:29.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.712+0000 7fe7cbfff640 1 -- 172.21.15.151:0/3243622078 learned_addr learned my addr 172.21.15.151:0/3243622078 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.712+0000 7fc0a77fe640 1 -- 172.21.15.151:0/604696852 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213308066 0 0) 0x7fc09c001110 con 0x7fc0a8151090 2023-10-18T11:10:29.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.713+0000 7fc0a77fe640 1 -- 172.21.15.151:0/604696852 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc098003520 con 0x7fc0a8151090 2023-10-18T11:10:29.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.713+0000 7fe7cb7fe640 1 --2- 172.21.15.151:0/3243622078 >> v2:172.21.15.151:3300/0 conn(0x7fe7cc0c5760 0x7fe7cc1642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.714+0000 7fe7cbfff640 1 -- 172.21.15.151:0/3243622078 >> v2:172.21.15.151:3300/0 conn(0x7fe7cc0c5760 msgr2=0x7fe7cc1642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.714+0000 7fe7cbfff640 1 --2- 172.21.15.151:0/3243622078 >> v2:172.21.15.151:3300/0 conn(0x7fe7cc0c5760 0x7fe7cc1642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.714+0000 7fe7cbfff640 1 -- 172.21.15.151:0/3243622078 >> v1:172.21.15.169:6789/0 conn(0x7fe7cc06fbd0 legacy=0x7fe7cc16d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.714+0000 7fe7cbfff640 1 -- 172.21.15.151:0/3243622078 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc16a510 con 0x7fe7cc0c5380 2023-10-18T11:10:29.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.716+0000 7fc0ad6a9640 1 -- 172.21.15.151:0/604696852 >> v2:172.21.15.169:3300/0 conn(0x7fc0a815af50 msgr2=0x7fc0a80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.716+0000 7fc0ad6a9640 1 --2- 172.21.15.151:0/604696852 >> v2:172.21.15.169:3300/0 conn(0x7fc0a815af50 0x7fc0a80c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.718+0000 7f425496b640 1 Processor -- start 2023-10-18T11:10:29.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.717+0000 7fe7cbfff640 1 --2- 172.21.15.151:0/3243622078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc0c5380 0x7fe7cc163d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00098a0 tx=0x7fe7c002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3110fadfdf85dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.718+0000 7f425496b640 1 -- start start 2023-10-18T11:10:29.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.716+0000 7fc0ad6a9640 1 -- 172.21.15.151:0/604696852 >> v1:172.21.15.169:6789/0 conn(0x7fc0a8151090 legacy=0x7fc0a8156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.717+0000 7fc0ad6a9640 1 -- 172.21.15.151:0/604696852 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80c8940 con 0x7fc0a80cd190 2023-10-18T11:10:29.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.720+0000 7f425496b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4248045980 0x7f42480de390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.721+0000 7fe7caffd640 1 -- 172.21.15.151:0/3243622078 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0030860 con 0x7fe7cc0c5380 2023-10-18T11:10:29.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.721+0000 7fe7caffd640 1 -- 172.21.15.151:0/3243622078 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c00309c0 con 0x7fe7cc0c5380 2023-10-18T11:10:29.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.721+0000 7fe7caffd640 1 -- 172.21.15.151:0/3243622078 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0030d90 con 0x7fe7cc0c5380 2023-10-18T11:10:29.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.720+0000 7f425496b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42480075c0 con 0x7f424800e3f0 2023-10-18T11:10:29.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.720+0000 7f425496b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424804cad0 con 0x7f424804b250 2023-10-18T11:10:29.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.720+0000 7f425496b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424804b720 con 0x7f4248045980 2023-10-18T11:10:29.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.722+0000 7fe7d129a640 1 -- 172.21.15.151:0/3243622078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc0c5380 msgr2=0x7fe7cc163d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.722+0000 7fe7d129a640 1 --2- 172.21.15.151:0/3243622078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc0c5380 0x7fe7cc163d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00098a0 tx=0x7fe7c002b9a0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.722+0000 7fe7d129a640 1 -- 172.21.15.151:0/3243622078 shutdown_connections 2023-10-18T11:10:29.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.722+0000 7fe7d129a640 1 --2- 172.21.15.151:0/3243622078 >> v2:172.21.15.151:3300/0 conn(0x7fe7cc0c5760 0x7fe7cc1642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.722+0000 7fe7d129a640 1 --2- 172.21.15.151:0/3243622078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc0c5380 0x7fe7cc163d60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.722+0000 7fe7d129a640 1 -- 172.21.15.151:0/3243622078 >> 172.21.15.151:0/3243622078 conn(0x7fe7cc0c6da0 msgr2=0x7fe7cc0c7180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.723+0000 7fe7d129a640 1 -- 172.21.15.151:0/3243622078 shutdown_connections 2023-10-18T11:10:29.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.723+0000 7fe7d129a640 1 -- 172.21.15.151:0/3243622078 wait complete. 2023-10-18T11:10:29.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.723+0000 7fc0ad6a9640 1 --2- 172.21.15.151:0/604696852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a80cd190 0x7fc0a80659d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8066480 tx=0x7fc0a002bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bec85e41ae50d09 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.725+0000 7f424f59e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4248045980 0x7f42480de390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.725+0000 7f424f59e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4248045980 0x7f42480de390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38830/0 (socket says 172.21.15.151:38830) 2023-10-18T11:10:29.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.725+0000 7f424f59e640 1 -- 172.21.15.151:0/662490457 learned_addr learned my addr 172.21.15.151:0/662490457 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.726+0000 7fe7d129a640 1 Processor -- start 2023-10-18T11:10:29.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.726+0000 7fe7d129a640 1 -- start start 2023-10-18T11:10:29.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.728+0000 7fe7d129a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc06fbd0 0x7fe7cc0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.728+0000 7fe7d129a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7cc0c5380 0x7fe7cc200250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.728+0000 7f424f59e640 1 -- 172.21.15.151:0/662490457 >> v1:172.21.15.169:6789/0 conn(0x7f424804b250 legacy=0x7f42480d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:29.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.728+0000 7f424f59e640 1 -- 172.21.15.151:0/662490457 >> v1:172.21.15.151:6789/0 conn(0x7f424800e3f0 legacy=0x7f4248045270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.728+0000 7f424f59e640 1 -- 172.21.15.151:0/662490457 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480069f0 con 0x7f4248045980 2023-10-18T11:10:29.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.728+0000 7fe7d129a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7cc0c5760 0x7fe7cc0c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.729+0000 7fe7d129a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc1ffdc0 con 0x7fe7cc0c5380 2023-10-18T11:10:29.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.729+0000 7fe7d129a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc15da00 con 0x7fe7cc0c5760 2023-10-18T11:10:29.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.729+0000 7fe7d129a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc15dce0 con 0x7fe7cc06fbd0 2023-10-18T11:10:29.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.729+0000 7fe7cbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc06fbd0 0x7fe7cc0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.729+0000 7fe7cbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc06fbd0 0x7fe7cc0c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57302/0 (socket says 172.21.15.151:57302) 2023-10-18T11:10:29.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.729+0000 7fe7cbfff640 1 -- 172.21.15.151:0/1701840563 learned_addr learned my addr 172.21.15.151:0/1701840563 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.732+0000 7fc0a77fe640 1 -- 172.21.15.151:0/604696852 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a002cb50 con 0x7fc0a80cd190 2023-10-18T11:10:29.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.732+0000 7fc0a77fe640 1 -- 172.21.15.151:0/604696852 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a002ccb0 con 0x7fc0a80cd190 2023-10-18T11:10:29.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.732+0000 7fc0a77fe640 1 -- 172.21.15.151:0/604696852 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0034610 con 0x7fc0a80cd190 2023-10-18T11:10:29.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.733+0000 7f424f59e640 1 --2- 172.21.15.151:0/662490457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4248045980 0x7f42480de390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4250067fc0 tx=0x7f42500a5e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a173c7e96ac6b726 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.733+0000 7fc0af10c640 1 -- 172.21.15.151:0/604696852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a80cd190 msgr2=0x7fc0a80659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.733+0000 7fe7cbfff640 1 -- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7cc0c5760 msgr2=0x7fe7cc0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.733+0000 7fe7cbfff640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7cc0c5760 0x7fe7cc0c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.733+0000 7fe7cbfff640 1 -- 172.21.15.151:0/1701840563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7cc0c5380 msgr2=0x7fe7cc200250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.733+0000 7fe7cbfff640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7cc0c5380 0x7fe7cc200250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.733+0000 7fe7cbfff640 1 -- 172.21.15.151:0/1701840563 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00094d0 con 0x7fe7cc06fbd0 2023-10-18T11:10:29.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.733+0000 7fc0af10c640 1 --2- 172.21.15.151:0/604696852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a80cd190 0x7fc0a80659d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8066480 tx=0x7fc0a002bfb0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.734+0000 7fc0af10c640 1 -- 172.21.15.151:0/604696852 shutdown_connections 2023-10-18T11:10:29.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.734+0000 7fc0af10c640 1 --2- 172.21.15.151:0/604696852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a80cd190 0x7fc0a80659d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.734+0000 7fc0af10c640 1 --2- 172.21.15.151:0/604696852 >> v2:172.21.15.169:3300/0 conn(0x7fc0a815af50 0x7fc0a80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.734+0000 7fc0af10c640 1 -- 172.21.15.151:0/604696852 >> 172.21.15.151:0/604696852 conn(0x7fc0a806e210 msgr2=0x7fc0a806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.734+0000 7fc0af10c640 1 -- 172.21.15.151:0/604696852 shutdown_connections 2023-10-18T11:10:29.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.734+0000 7fc0af10c640 1 -- 172.21.15.151:0/604696852 wait complete. 2023-10-18T11:10:29.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.737+0000 7fc0af10c640 1 Processor -- start 2023-10-18T11:10:29.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.738+0000 7fc0af10c640 1 -- start start 2023-10-18T11:10:29.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.738+0000 7fe7cbfff640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc06fbd0 0x7fe7cc0c80a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00098a0 tx=0x7fe7c0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.739+0000 7f424dd9b640 1 -- 172.21.15.151:0/662490457 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500a6c70 con 0x7f4248045980 2023-10-18T11:10:29.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.739+0000 7f424dd9b640 1 -- 172.21.15.151:0/662490457 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42500a6e10 con 0x7f4248045980 2023-10-18T11:10:29.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.739+0000 7f424dd9b640 1 -- 172.21.15.151:0/662490457 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500ae640 con 0x7f4248045980 2023-10-18T11:10:29.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.739+0000 7fc0af10c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a80cd190 0x7fc0a806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.739+0000 7fc0af10c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0a8151090 0x7fc0a806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.739+0000 7fc0af10c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0a815af50 0x7fc0a8138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.740+0000 7fc0af10c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a813a800 con 0x7fc0a80cd190 2023-10-18T11:10:29.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.740+0000 7fc0af10c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a81576c0 con 0x7fc0a815af50 2023-10-18T11:10:29.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.740+0000 7fc0af10c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a8138600 con 0x7fc0a8151090 2023-10-18T11:10:29.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.741+0000 7fc0ad6a9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0a815af50 0x7fc0a8138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.741+0000 7fc0ad6a9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0a815af50 0x7fc0a8138ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38854/0 (socket says 172.21.15.151:38854) 2023-10-18T11:10:29.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.741+0000 7fc0ad6a9640 1 -- 172.21.15.151:0/2950908345 learned_addr learned my addr 172.21.15.151:0/2950908345 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.741+0000 7f425496b640 1 -- 172.21.15.151:0/662490457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4248045980 msgr2=0x7f42480de390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.741+0000 7f425496b640 1 --2- 172.21.15.151:0/662490457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4248045980 0x7f42480de390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4250067fc0 tx=0x7f42500a5e00 comp rx=0 tx=0).stop 2023-10-18T11:10:29.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.742+0000 7fc0acea8640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a80cd190 0x7fc0a806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.742+0000 7f425496b640 1 -- 172.21.15.151:0/662490457 shutdown_connections 2023-10-18T11:10:29.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.742+0000 7f425496b640 1 --2- 172.21.15.151:0/662490457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4248045980 0x7f42480de390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.742+0000 7f425496b640 1 -- 172.21.15.151:0/662490457 >> 172.21.15.151:0/662490457 conn(0x7f42480502d0 msgr2=0x7f42480506e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:29.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.742+0000 7f425496b640 1 -- 172.21.15.151:0/662490457 shutdown_connections 2023-10-18T11:10:29.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.743+0000 7fe7c8ff9640 1 -- 172.21.15.151:0/1701840563 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0039e20 con 0x7fe7cc06fbd0 2023-10-18T11:10:29.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.743+0000 7fe7c8ff9640 1 -- 172.21.15.151:0/1701840563 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0043400 con 0x7fe7cc06fbd0 2023-10-18T11:10:29.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.743+0000 7fe7c8ff9640 1 -- 172.21.15.151:0/1701840563 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00437b0 con 0x7fe7cc06fbd0 2023-10-18T11:10:29.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.743+0000 7f425496b640 1 -- 172.21.15.151:0/662490457 wait complete. 2023-10-18T11:10:29.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.743+0000 7fc0a7fff640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0a8151090 0x7fc0a806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.744+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7cc1ffa50 con 0x7fe7cc06fbd0 2023-10-18T11:10:29.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.744+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc1ff740 con 0x7fe7cc06fbd0 2023-10-18T11:10:29.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.745+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7cc06e670 con 0x7fe7cc06fbd0 2023-10-18T11:10:29.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.746+0000 7fc0ad6a9640 1 -- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0a8151090 msgr2=0x7fc0a806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.746+0000 7fc0ad6a9640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0a8151090 0x7fc0a806cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.746+0000 7fc0ad6a9640 1 -- 172.21.15.151:0/2950908345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a80cd190 msgr2=0x7fc0a806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.746+0000 7fc0ad6a9640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a80cd190 0x7fc0a806c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.746+0000 7fc0ad6a9640 1 -- 172.21.15.151:0/2950908345 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a0009b30 con 0x7fc0a815af50 2023-10-18T11:10:29.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.748+0000 7f425496b640 1 Processor -- start 2023-10-18T11:10:29.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.748+0000 7f425496b640 1 -- start start 2023-10-18T11:10:29.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.750+0000 7f425496b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f424800e3f0 0x7f42480346f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.750+0000 7fc0ad6a9640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0a815af50 0x7fc0a8138ae0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009f40 tx=0x7fc0a0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.751+0000 7f425496b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4248045980 0x7f42480bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.751+0000 7f425496b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f424804b250 0x7f42481794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.751+0000 7f425496b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424804f830 con 0x7f424804b250 2023-10-18T11:10:29.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.751+0000 7f425496b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480bf040 con 0x7f4248045980 2023-10-18T11:10:29.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.751+0000 7f425496b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4248178de0 con 0x7f424800e3f0 2023-10-18T11:10:29.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.755+0000 7f424f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f424804b250 0x7f42481794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.755+0000 7fc0a57fa640 1 -- 172.21.15.151:0/2950908345 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00099b0 con 0x7fc0a815af50 2023-10-18T11:10:29.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.755+0000 7fc0a57fa640 1 -- 172.21.15.151:0/2950908345 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a003e450 con 0x7fc0a815af50 2023-10-18T11:10:29.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.755+0000 7fc0a57fa640 1 -- 172.21.15.151:0/2950908345 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a003e7e0 con 0x7fc0a815af50 2023-10-18T11:10:29.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.755+0000 7f424f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f424804b250 0x7f42481794d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44848/0 (socket says 172.21.15.151:44848) 2023-10-18T11:10:29.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.755+0000 7f424e59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4248045980 0x7f42480bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:29.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.756+0000 7f424f59e640 1 -- 172.21.15.151:0/1458115366 learned_addr learned my addr 172.21.15.151:0/1458115366 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:29.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.755+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a813a520 con 0x7fc0a815af50 2023-10-18T11:10:29.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.755+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a80c3de0 con 0x7fc0a815af50 2023-10-18T11:10:29.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.757+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a8138800 con 0x7fc0a815af50 2023-10-18T11:10:29.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.761+0000 7f424f59e640 1 -- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f424800e3f0 msgr2=0x7f42480346f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.761+0000 7f424f59e640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f424800e3f0 0x7f42480346f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.761+0000 7f424f59e640 1 -- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4248045980 msgr2=0x7f42480bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:29.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.761+0000 7f424f59e640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4248045980 0x7f42480bfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:29.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.761+0000 7f424f59e640 1 -- 172.21.15.151:0/1458115366 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480ccb10 con 0x7f424804b250 2023-10-18T11:10:29.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.763+0000 7f424f59e640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f424804b250 0x7f42481794d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f425004ef10 tx=0x7f4250068a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:29.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.769+0000 7f42377fe640 1 -- 172.21.15.151:0/1458115366 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500b8610 con 0x7f424804b250 2023-10-18T11:10:29.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.769+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42480c06e0 con 0x7f424804b250 2023-10-18T11:10:29.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.770+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42480bf530 con 0x7f424804b250 2023-10-18T11:10:29.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.770+0000 7f42377fe640 1 -- 172.21.15.151:0/1458115366 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42500b8770 con 0x7f424804b250 2023-10-18T11:10:29.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.770+0000 7f42377fe640 1 -- 172.21.15.151:0/1458115366 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500b8610 con 0x7f424804b250 2023-10-18T11:10:29.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.771+0000 7f37ec8e7640 1 Processor -- start 2023-10-18T11:10:29.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.771+0000 7f37ec8e7640 1 -- start start 2023-10-18T11:10:29.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.772+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4230005250 con 0x7f424804b250 2023-10-18T11:10:29.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.772+0000 7f37ec8e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c66d0 0x7f37e80c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.773+0000 7f37ec8e7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e80ca770 con 0x7f37e81600c0 2023-10-18T11:10:29.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.773+0000 7f37ec8e7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e80caa30 con 0x7f37e80c62f0 2023-10-18T11:10:29.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.773+0000 7f37ec8e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80c71d0 con 0x7f37e80c66d0 2023-10-18T11:10:29.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.786+0000 7f57bffe9640 1 Processor -- start 2023-10-18T11:10:29.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.786+0000 7f57bffe9640 1 -- start start 2023-10-18T11:10:29.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.786+0000 7fc75f15e640 1 Processor -- start 2023-10-18T11:10:29.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.787+0000 7fc75f15e640 1 -- start start 2023-10-18T11:10:29.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.788+0000 7f57bffe9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f57b815d170 0x7f57b80cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.788+0000 7f57bffe9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b8153870 con 0x7f57b80cbe20 2023-10-18T11:10:29.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.788+0000 7f57bffe9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b80cc200 con 0x7f57b80c9650 2023-10-18T11:10:29.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.788+0000 7f57bffe9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b815d5c0 con 0x7f57b815d170 2023-10-18T11:10:29.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.789+0000 7fc75f15e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.789+0000 7fc75f15e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7580c60f0 con 0x7fc7581511c0 2023-10-18T11:10:29.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.789+0000 7fc75f15e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7580c63d0 con 0x7fc7580c8bc0 2023-10-18T11:10:29.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.789+0000 7fc75f15e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c7410 con 0x7fc758157a30 2023-10-18T11:10:29.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.837+0000 7fbe7c67c640 1 Processor -- start 2023-10-18T11:10:29.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.837+0000 7fbe7c67c640 1 -- start start 2023-10-18T11:10:29.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.839+0000 7fbe7c67c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 0x7fbe740c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.839+0000 7fbe7c67c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbe74157770 0x7fbe7406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.839+0000 7fbe7c67c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbe7406de00 0x7fbe740c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.840+0000 7fbe7c67c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7406d430 con 0x7fbe74157770 2023-10-18T11:10:29.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.840+0000 7fbe7c67c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe74151480 con 0x7fbe7406de00 2023-10-18T11:10:29.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.840+0000 7fbe7c67c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740c27d0 con 0x7fbe741510a0 2023-10-18T11:10:29.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.889+0000 7faa86bfc640 1 Processor -- start 2023-10-18T11:10:29.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.889+0000 7faa86bfc640 1 -- start start 2023-10-18T11:10:29.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.890+0000 7faa86bfc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faa801510a0 0x7faa800c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.890+0000 7faa86bfc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa80157770 0x7faa8006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:29.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.890+0000 7faa86bfc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8006d430 con 0x7faa8006de00 2023-10-18T11:10:29.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.890+0000 7faa86bfc640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa80151480 con 0x7faa801510a0 2023-10-18T11:10:29.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:29.890+0000 7faa86bfc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa800c27d0 con 0x7faa80157770 2023-10-18T11:10:30.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.026+0000 7f37ddd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c66d0 0x7f37e80c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.026+0000 7fe7c8ff9640 1 -- 172.21.15.151:0/1701840563 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe7c0043910 con 0x7fe7cc06fbd0 2023-10-18T11:10:30.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.027+0000 7fbe79c17640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbe74157770 0x7fbe7406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.027+0000 7fe7c8ff9640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe7b806aec0 0x7fe7b806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.027+0000 7fe7cb7fe640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe7b806aec0 0x7fe7b806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.028+0000 7fe7cb7fe640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe7b806aec0 0x7fe7b806d380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc006fd0 tx=0x7fe7bc008040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.032+0000 7fe7c8ff9640 1 -- 172.21.15.151:0/1701840563 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe7c003e070 con 0x7fe7cc06fbd0 2023-10-18T11:10:30.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.032+0000 7f37ddd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c66d0 0x7f37e80c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57346/0 (socket says 172.21.15.151:57346) 2023-10-18T11:10:30.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.032+0000 7f37ddd9b640 1 -- 172.21.15.151:0/3538357309 learned_addr learned my addr 172.21.15.151:0/3538357309 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:30.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.044+0000 7f57bdd85640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f57b80cbe20 0x7f57b80b1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54860/0 (socket says 172.21.15.151:54860) 2023-10-18T11:10:30.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.045+0000 7f57bdd85640 1 -- 172.21.15.151:0/2768074413 learned_addr learned my addr 172.21.15.151:0/2768074413 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:30.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.048+0000 7fe7c8ff9640 1 -- 172.21.15.151:0/1701840563 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7c00784d0 con 0x7fe7cc06fbd0 2023-10-18T11:10:30.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.051+0000 7f37ddd9b640 1 -- 172.21.15.151:0/3538357309 >> v1:172.21.15.169:6789/0 conn(0x7f37e80c62f0 legacy=0x7f37e80c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:30.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.051+0000 7f37ddd9b640 1 -- 172.21.15.151:0/3538357309 >> v1:172.21.15.151:6789/0 conn(0x7f37e81600c0 legacy=0x7f37e806abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:30.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.051+0000 7f37ddd9b640 1 -- 172.21.15.151:0/3538357309 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e8069e30 con 0x7f37e80c66d0 2023-10-18T11:10:30.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.057+0000 7fc75d6fb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.059+0000 7fbe7a418640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 0x7fbe740c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.064+0000 7fc0a57fa640 1 -- 172.21.15.151:0/2950908345 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc0a003e940 con 0x7fc0a815af50 2023-10-18T11:10:30.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.065+0000 7fbe79c17640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbe74157770 0x7fbe7406d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44856/0 (socket says 172.21.15.151:44856) 2023-10-18T11:10:30.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.065+0000 7fbe79c17640 1 -- 172.21.15.151:0/1083926344 learned_addr learned my addr 172.21.15.151:0/1083926344 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:30.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.066+0000 7fc0a57fa640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc08c06aec0 0x7fc08c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.067+0000 7fc0a57fa640 1 -- 172.21.15.151:0/2950908345 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc0a007b1b0 con 0x7fc0a815af50 2023-10-18T11:10:30.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.067+0000 7fc0acea8640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc08c06aec0 0x7fc08c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.068+0000 7f42377fe640 1 -- 172.21.15.151:0/1458115366 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f42500b5050 con 0x7f424804b250 2023-10-18T11:10:30.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.068+0000 7fc0acea8640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc08c06aec0 0x7fc08c06d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc09c001370 tx=0x7fc09c007bb0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.068+0000 7f42377fe640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f423c06af00 0x7f423c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.069+0000 7f424ed9d640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f423c06af00 0x7f423c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.070+0000 7f424ed9d640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f423c06af00 0x7f423c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4240006fd0 tx=0x7f4240006bc0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.077+0000 7fc75d6fb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57350/0 (socket says 172.21.15.151:57350) 2023-10-18T11:10:30.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.077+0000 7fc75d6fb640 1 -- 172.21.15.151:0/735406109 learned_addr learned my addr 172.21.15.151:0/735406109 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:30.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.077+0000 7fc0a57fa640 1 -- 172.21.15.151:0/2950908345 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0a00774f0 con 0x7fc0a815af50 2023-10-18T11:10:30.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.080+0000 7f57bd584640 1 --2- 172.21.15.151:0/2768074413 >> v2:172.21.15.169:3300/0 conn(0x7f57b815d170 0x7f57b80cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.080+0000 7fbe7ac19640 1 --2- 172.21.15.151:0/1083926344 >> v2:172.21.15.169:3300/0 conn(0x7fbe7406de00 0x7fbe740c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.083+0000 7f57bd584640 1 -- 172.21.15.151:0/2768074413 >> v1:172.21.15.169:6789/0 conn(0x7f57b80c9650 legacy=0x7f57b8163970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:30.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.083+0000 7f57bd584640 1 -- 172.21.15.151:0/2768074413 >> v1:172.21.15.151:6789/0 conn(0x7f57b80cbe20 legacy=0x7f57b80b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.083+0000 7f57bd584640 1 -- 172.21.15.151:0/2768074413 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80b1e30 con 0x7f57b815d170 2023-10-18T11:10:30.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.085+0000 7faa84998640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faa801510a0 0x7faa800c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.088+0000 7fbe7ac19640 1 -- 172.21.15.151:0/1083926344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 msgr2=0x7fbe740c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:30.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.088+0000 7fbe7ac19640 1 --2- 172.21.15.151:0/1083926344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 0x7fbe740c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.088+0000 7fbe7ac19640 1 -- 172.21.15.151:0/1083926344 >> v2:172.21.15.151:3300/0 conn(0x7fbe74157770 msgr2=0x7fbe7406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:30.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.088+0000 7fbe7ac19640 1 --2- 172.21.15.151:0/1083926344 >> v2:172.21.15.151:3300/0 conn(0x7fbe74157770 0x7fbe7406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.088+0000 7faa84998640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faa801510a0 0x7faa800c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38898/0 (socket says 172.21.15.151:38898) 2023-10-18T11:10:30.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.088+0000 7fbe7ac19640 1 -- 172.21.15.151:0/1083926344 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe740c2a90 con 0x7fbe7406de00 2023-10-18T11:10:30.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.088+0000 7faa84998640 1 -- 172.21.15.151:0/2724626031 learned_addr learned my addr 172.21.15.151:0/2724626031 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:30.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.092+0000 7f42377fe640 1 -- 172.21.15.151:0/1458115366 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f42500f4280 con 0x7f424804b250 2023-10-18T11:10:30.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.093+0000 7f42377fe640 1 -- 172.21.15.151:0/1458115366 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42500efec0 con 0x7f424804b250 2023-10-18T11:10:30.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.094+0000 7faa84998640 1 -- 172.21.15.151:0/2724626031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa80157770 msgr2=0x7faa8006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:30.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.094+0000 7faa84998640 1 --2- 172.21.15.151:0/2724626031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa80157770 0x7faa8006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.094+0000 7fc75d6fb640 1 -- 172.21.15.151:0/735406109 >> v1:172.21.15.169:6789/0 conn(0x7fc7580c8bc0 legacy=0x7fc75815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:30.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.094+0000 7fc75d6fb640 1 -- 172.21.15.151:0/735406109 >> v1:172.21.15.151:6789/0 conn(0x7fc7581511c0 legacy=0x7fc7580c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:30.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.094+0000 7fc75d6fb640 1 -- 172.21.15.151:0/735406109 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758156f50 con 0x7fc758157a30 2023-10-18T11:10:30.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.094+0000 7faa84998640 1 -- 172.21.15.151:0/2724626031 >> v1:172.21.15.151:6789/0 conn(0x7faa8006de00 legacy=0x7faa800c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:30.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.094+0000 7faa84998640 1 -- 172.21.15.151:0/2724626031 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa800c2a90 con 0x7faa801510a0 2023-10-18T11:10:30.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.094+0000 7f37ddd9b640 1 --2- 172.21.15.151:0/3538357309 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c66d0 0x7f37e80c5670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37d00098a0 tx=0x7f37d002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3c484f506db9a00 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.098+0000 7fbe7ac19640 1 --2- 172.21.15.151:0/1083926344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 0x7fbe740c4e60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe74066ac0 tx=0x7fbe6c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=640eb2de71c93eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.100+0000 7f57bd584640 1 --2- 172.21.15.151:0/2768074413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b815d170 0x7f57b80cac40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57a80097a0 tx=0x7f57a802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdaf220013093778 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.102+0000 7faa84998640 1 --2- 172.21.15.151:0/2724626031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa801510a0 0x7faa800c2180 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa74009870 tx=0x7faa7402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d24ac04e0a06e8be server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.103+0000 7fc75d6fb640 1 --2- 172.21.15.151:0/735406109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758070e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7480098a0 tx=0x7fc74802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ed173f316e18027 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.103+0000 7fbe79416640 1 -- 172.21.15.151:0/1083926344 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c02cc60 con 0x7fbe7406de00 2023-10-18T11:10:30.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.106+0000 7fbe79416640 1 -- 172.21.15.151:0/1083926344 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c02cdc0 con 0x7fbe7406de00 2023-10-18T11:10:30.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.106+0000 7fbe79416640 1 -- 172.21.15.151:0/1083926344 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c034660 con 0x7fbe7406de00 2023-10-18T11:10:30.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.107+0000 7fbe7c67c640 1 -- 172.21.15.151:0/1083926344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 msgr2=0x7fbe740c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.107+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/1083926344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 0x7fbe740c4e60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe74066ac0 tx=0x7fbe6c02beb0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7fbe7c67c640 1 -- 172.21.15.151:0/1083926344 shutdown_connections 2023-10-18T11:10:30.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/1083926344 >> v2:172.21.15.151:3300/0 conn(0x7fbe74157770 0x7fbe7406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/1083926344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 0x7fbe740c4e60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/1083926344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 0x7fbe740c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7fbe7c67c640 1 -- 172.21.15.151:0/1083926344 >> 172.21.15.151:0/1083926344 conn(0x7fbe74069f70 msgr2=0x7fbe7406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7fbe7c67c640 1 -- 172.21.15.151:0/1083926344 shutdown_connections 2023-10-18T11:10:30.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7fbe7c67c640 1 -- 172.21.15.151:0/1083926344 wait complete. 2023-10-18T11:10:30.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7f37e5d9b640 1 -- 172.21.15.151:0/3538357309 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0031640 con 0x7f37e80c66d0 2023-10-18T11:10:30.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7f37e5d9b640 1 -- 172.21.15.151:0/3538357309 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d00317a0 con 0x7f37e80c66d0 2023-10-18T11:10:30.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.108+0000 7f37e5d9b640 1 -- 172.21.15.151:0/3538357309 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0031b30 con 0x7f37e80c66d0 2023-10-18T11:10:30.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.109+0000 7f37ec8e7640 1 -- 172.21.15.151:0/3538357309 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c66d0 msgr2=0x7f37e80c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.109+0000 7f37ec8e7640 1 --2- 172.21.15.151:0/3538357309 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c66d0 0x7f37e80c5670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37d00098a0 tx=0x7f37d002b8f0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.109+0000 7f37ec8e7640 1 -- 172.21.15.151:0/3538357309 shutdown_connections 2023-10-18T11:10:30.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.109+0000 7f37ec8e7640 1 --2- 172.21.15.151:0/3538357309 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c66d0 0x7f37e80c5670 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.109+0000 7f37ec8e7640 1 -- 172.21.15.151:0/3538357309 >> 172.21.15.151:0/3538357309 conn(0x7f37e80cb320 msgr2=0x7f37e80c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.110+0000 7f37ec8e7640 1 -- 172.21.15.151:0/3538357309 shutdown_connections 2023-10-18T11:10:30.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.110+0000 7f37ec8e7640 1 -- 172.21.15.151:0/3538357309 wait complete. 2023-10-18T11:10:30.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.111+0000 7fbe7c67c640 1 Processor -- start 2023-10-18T11:10:30.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.111+0000 7fbe7c67c640 1 -- start start 2023-10-18T11:10:30.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.112+0000 7f37ec8e7640 1 Processor -- start 2023-10-18T11:10:30.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.112+0000 7f37ec8e7640 1 -- start start 2023-10-18T11:10:30.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.113+0000 7fbe7c67c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 0x7fbe7414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.113+0000 7fbe7c67c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 0x7fbe74159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.113+0000 7fbe7c67c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe74157770 0x7fbe741595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.113+0000 7fbe7c67c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741f2a10 con 0x7fbe74157770 2023-10-18T11:10:30.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.113+0000 7fbe7c67c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe74158be0 con 0x7fbe7406de00 2023-10-18T11:10:30.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.113+0000 7fbe7c67c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741e30d0 con 0x7fbe741510a0 2023-10-18T11:10:30.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.114+0000 7f57bcd83640 1 -- 172.21.15.151:0/2768074413 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8030610 con 0x7f57b815d170 2023-10-18T11:10:30.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.114+0000 7f57bcd83640 1 -- 172.21.15.151:0/2768074413 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a8030770 con 0x7f57b815d170 2023-10-18T11:10:30.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.114+0000 7f57bcd83640 1 -- 172.21.15.151:0/2768074413 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8030b00 con 0x7f57b815d170 2023-10-18T11:10:30.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.114+0000 7f37ec8e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c62f0 0x7f37e81559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.114+0000 7f37ec8e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e80c66d0 0x7f37e80c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.114+0000 7f37ec8e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37e81600c0 0x7f37e815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.114+0000 7f37ec8e7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8156160 con 0x7f37e80c66d0 2023-10-18T11:10:30.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.114+0000 7f37ec8e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8156700 con 0x7f37e81600c0 2023-10-18T11:10:30.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.114+0000 7f37ec8e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80c2e40 con 0x7f37e80c62f0 2023-10-18T11:10:30.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7f57bffe9640 1 -- 172.21.15.151:0/2768074413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b815d170 msgr2=0x7f57b80cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7f57bffe9640 1 --2- 172.21.15.151:0/2768074413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b815d170 0x7f57b80cac40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57a80097a0 tx=0x7f57a802b960 comp rx=0 tx=0).stop 2023-10-18T11:10:30.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7faa7f7fe640 1 -- 172.21.15.151:0/2724626031 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74030840 con 0x7faa801510a0 2023-10-18T11:10:30.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7faa7f7fe640 1 -- 172.21.15.151:0/2724626031 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa740309a0 con 0x7faa801510a0 2023-10-18T11:10:30.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7faa7f7fe640 1 -- 172.21.15.151:0/2724626031 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74030d30 con 0x7faa801510a0 2023-10-18T11:10:30.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7f57bffe9640 1 -- 172.21.15.151:0/2768074413 shutdown_connections 2023-10-18T11:10:30.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7f57bffe9640 1 --2- 172.21.15.151:0/2768074413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b815d170 0x7f57b80cac40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7f57bffe9640 1 -- 172.21.15.151:0/2768074413 >> 172.21.15.151:0/2768074413 conn(0x7f57b80659d0 msgr2=0x7f57b8065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7fbe7a418640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 0x7fbe7414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.115+0000 7f57bffe9640 1 -- 172.21.15.151:0/2768074413 shutdown_connections 2023-10-18T11:10:30.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.116+0000 7f57bffe9640 1 -- 172.21.15.151:0/2768074413 wait complete. 2023-10-18T11:10:30.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.116+0000 7faa86bfc640 1 -- 172.21.15.151:0/2724626031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa801510a0 msgr2=0x7faa800c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.116+0000 7faa86bfc640 1 --2- 172.21.15.151:0/2724626031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa801510a0 0x7faa800c2180 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa74009870 tx=0x7faa7402b980 comp rx=0 tx=0).stop 2023-10-18T11:10:30.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.116+0000 7f37e6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37e81600c0 0x7f37e815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.116+0000 7fbe7a418640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 0x7fbe7414f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38912/0 (socket says 172.21.15.151:38912) 2023-10-18T11:10:30.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.116+0000 7fbe7a418640 1 -- 172.21.15.151:0/3946540651 learned_addr learned my addr 172.21.15.151:0/3946540651 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:30.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.117+0000 7faa86bfc640 1 -- 172.21.15.151:0/2724626031 shutdown_connections 2023-10-18T11:10:30.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.117+0000 7faa86bfc640 1 --2- 172.21.15.151:0/2724626031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa80157770 0x7faa8006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.117+0000 7faa86bfc640 1 --2- 172.21.15.151:0/2724626031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa801510a0 0x7faa800c2180 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.117+0000 7faa86bfc640 1 -- 172.21.15.151:0/2724626031 >> 172.21.15.151:0/2724626031 conn(0x7faa80069f70 msgr2=0x7faa8006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.117+0000 7faa86bfc640 1 -- 172.21.15.151:0/2724626031 shutdown_connections 2023-10-18T11:10:30.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.118+0000 7f57bffe9640 1 Processor -- start 2023-10-18T11:10:30.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.118+0000 7f57bffe9640 1 -- start start 2023-10-18T11:10:30.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.117+0000 7f37e6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37e81600c0 0x7f37e815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38916/0 (socket says 172.21.15.151:38916) 2023-10-18T11:10:30.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.117+0000 7f37e6d9d640 1 -- 172.21.15.151:0/2140794454 learned_addr learned my addr 172.21.15.151:0/2140794454 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:30.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.117+0000 7faa86bfc640 1 -- 172.21.15.151:0/2724626031 wait complete. 2023-10-18T11:10:30.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.119+0000 7f37e659c640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c62f0 0x7f37e81559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.119+0000 7fbe79c17640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 0x7fbe74159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7f57bffe9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57b80c9650 0x7f57b81500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7f57bffe9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b80cbe20 0x7f57b8151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7f57bffe9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b815d170 0x7f57b80cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7f57bffe9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b814dcd0 con 0x7f57b815d170 2023-10-18T11:10:30.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7f57bffe9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b814fc70 con 0x7f57b80cbe20 2023-10-18T11:10:30.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7f57bffe9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b81e64d0 con 0x7f57b80c9650 2023-10-18T11:10:30.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7faa86bfc640 1 Processor -- start 2023-10-18T11:10:30.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7fbe7a418640 1 -- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 msgr2=0x7fbe74159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7fbe7a418640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 0x7fbe74159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7fbe7a418640 1 -- 172.21.15.151:0/3946540651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe74157770 msgr2=0x7fbe741595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7fbe7a418640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe74157770 0x7fbe741595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7fbe7a418640 1 -- 172.21.15.151:0/3946540651 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c009a70 con 0x7fbe7406de00 2023-10-18T11:10:30.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.120+0000 7faa86bfc640 1 -- start start 2023-10-18T11:10:30.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.123+0000 7faa86bfc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa8006de00 0x7faa800c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.123+0000 7faa86bfc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa801510a0 0x7faa801f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.123+0000 7faa86bfc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa80157770 0x7faa800713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.123+0000 7faa86bfc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa80146a50 con 0x7faa8006de00 2023-10-18T11:10:30.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.123+0000 7faa86bfc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa80147690 con 0x7faa80157770 2023-10-18T11:10:30.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.123+0000 7faa86bfc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa80145060 con 0x7faa801510a0 2023-10-18T11:10:30.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.124+0000 7f57bd584640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b80cbe20 0x7f57b8151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.125+0000 7fbe7a418640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 0x7fbe7414f7e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000d830 tx=0x7fbe7000dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.125+0000 7f57bd584640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b80cbe20 0x7f57b8151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38920/0 (socket says 172.21.15.151:38920) 2023-10-18T11:10:30.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.125+0000 7f57bd584640 1 -- 172.21.15.151:0/280152705 learned_addr learned my addr 172.21.15.151:0/280152705 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:30.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.127+0000 7f37e659c640 1 -- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37e81600c0 msgr2=0x7f37e815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.127+0000 7f37e659c640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37e81600c0 0x7f37e815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.127+0000 7f37e659c640 1 -- 172.21.15.151:0/2140794454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e80c66d0 msgr2=0x7f37e80c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.127+0000 7f37e659c640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e80c66d0 0x7f37e80c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.128+0000 7f37e659c640 1 -- 172.21.15.151:0/2140794454 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00094d0 con 0x7f37e80c62f0 2023-10-18T11:10:30.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.132+0000 7f57bdd85640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57b80c9650 0x7f57b81500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.134+0000 7f57bd584640 1 -- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57b80c9650 msgr2=0x7f57b81500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.134+0000 7f57bd584640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57b80c9650 0x7f57b81500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.134+0000 7f57bd584640 1 -- 172.21.15.151:0/280152705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b815d170 msgr2=0x7f57b80cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.134+0000 7f57bd584640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b815d170 0x7f57b80cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.134+0000 7f57bd584640 1 -- 172.21.15.151:0/280152705 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a8009400 con 0x7f57b80cbe20 2023-10-18T11:10:30.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.135+0000 7f37e659c640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c62f0 0x7f37e81559f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c6d0 tx=0x7f37d800cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.139+0000 7fbe6affd640 1 -- 172.21.15.151:0/3946540651 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000b6c0 con 0x7fbe7406de00 2023-10-18T11:10:30.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.139+0000 7fbe6affd640 1 -- 172.21.15.151:0/3946540651 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7000b820 con 0x7fbe7406de00 2023-10-18T11:10:30.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.139+0000 7fbe6affd640 1 -- 172.21.15.151:0/3946540651 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000bbb0 con 0x7fbe7406de00 2023-10-18T11:10:30.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.139+0000 7f57bd584640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b80cbe20 0x7f57b8151250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57a802bf70 tx=0x7f57a8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.139+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe741f2490 con 0x7fbe7406de00 2023-10-18T11:10:30.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.139+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe74071170 con 0x7fbe7406de00 2023-10-18T11:10:30.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.140+0000 7faa7ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa801510a0 0x7faa801f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.141+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe74157b90 con 0x7fbe7406de00 2023-10-18T11:10:30.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.143+0000 7faa84998640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa8006de00 0x7faa800c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.144+0000 7f37df7fe640 1 -- 172.21.15.151:0/2140794454 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8003b70 con 0x7f37e80c62f0 2023-10-18T11:10:30.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.144+0000 7f37df7fe640 1 -- 172.21.15.151:0/2140794454 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d8003cf0 con 0x7f37e80c62f0 2023-10-18T11:10:30.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.144+0000 7f37df7fe640 1 -- 172.21.15.151:0/2140794454 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8003ea0 con 0x7f37e80c62f0 2023-10-18T11:10:30.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.144+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e80c4140 con 0x7f37e80c62f0 2023-10-18T11:10:30.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.144+0000 7faa7ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa801510a0 0x7faa801f68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57402/0 (socket says 172.21.15.151:57402) 2023-10-18T11:10:30.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.144+0000 7faa7ffff640 1 -- 172.21.15.151:0/3132483656 learned_addr learned my addr 172.21.15.151:0/3132483656 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:30.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.144+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e80c4700 con 0x7f37e80c62f0 2023-10-18T11:10:30.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.145+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e80c48f0 con 0x7f37e80c62f0 2023-10-18T11:10:30.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.149+0000 7faa85199640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa80157770 0x7faa800713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.152+0000 7faa84998640 1 -- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa801510a0 msgr2=0x7faa801f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.152+0000 7faa84998640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa801510a0 0x7faa801f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.152+0000 7faa84998640 1 -- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa80157770 msgr2=0x7faa800713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.152+0000 7faa84998640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa80157770 0x7faa800713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.152+0000 7faa84998640 1 -- 172.21.15.151:0/3132483656 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa740094d0 con 0x7faa8006de00 2023-10-18T11:10:30.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.157+0000 7faa84998640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa8006de00 0x7faa800c0890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa74033000 tx=0x7faa74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.162+0000 7faa7d7fa640 1 -- 172.21.15.151:0/3132483656 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74047070 con 0x7faa8006de00 2023-10-18T11:10:30.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.162+0000 7faa7d7fa640 1 -- 172.21.15.151:0/3132483656 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa74039c40 con 0x7faa8006de00 2023-10-18T11:10:30.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.162+0000 7faa7d7fa640 1 -- 172.21.15.151:0/3132483656 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74043400 con 0x7faa8006de00 2023-10-18T11:10:30.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.162+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa800c0dd0 con 0x7faa8006de00 2023-10-18T11:10:30.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.162+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa801473b0 con 0x7faa8006de00 2023-10-18T11:10:30.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.164+0000 7fbe6affd640 1 -- 172.21.15.151:0/3946540651 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe7001e460 con 0x7fbe7406de00 2023-10-18T11:10:30.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.164+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa800c2d50 con 0x7faa8006de00 2023-10-18T11:10:30.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.165+0000 7fbe6affd640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe5806aec0 0x7fbe5806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.166+0000 7fbe79c17640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe5806aec0 0x7fbe5806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.166+0000 7fbe79c17640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe5806aec0 0x7fbe5806d380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe740cb4f0 tx=0x7fbe64008040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.166+0000 7fbe6affd640 1 -- 172.21.15.151:0/3946540651 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe70059cd0 con 0x7fbe7406de00 2023-10-18T11:10:30.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.169+0000 7f57ae7fc640 1 -- 172.21.15.151:0/280152705 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a803e040 con 0x7f57b80cbe20 2023-10-18T11:10:30.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.169+0000 7f57ae7fc640 1 -- 172.21.15.151:0/280152705 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a8039c90 con 0x7f57b80cbe20 2023-10-18T11:10:30.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.169+0000 7f57ae7fc640 1 -- 172.21.15.151:0/280152705 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8043440 con 0x7f57b80cbe20 2023-10-18T11:10:30.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.169+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b8152fc0 con 0x7f57b80cbe20 2023-10-18T11:10:30.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.169+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b814e1c0 con 0x7f57b80cbe20 2023-10-18T11:10:30.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.171+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b80c2270 con 0x7f57b80cbe20 2023-10-18T11:10:30.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.266+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe7cc15de20 con 0x7fe7cc06fbd0 2023-10-18T11:10:30.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.284+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0a8138800 con 0x7fc0a815af50 2023-10-18T11:10:30.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.292+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f42300057d0 con 0x7f424804b250 2023-10-18T11:10:30.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.417+0000 7fc7577fe640 1 -- 172.21.15.151:0/735406109 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748031640 con 0x7fc758157a30 2023-10-18T11:10:30.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.418+0000 7fc7577fe640 1 -- 172.21.15.151:0/735406109 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7480317a0 con 0x7fc758157a30 2023-10-18T11:10:30.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.418+0000 7fc7577fe640 1 -- 172.21.15.151:0/735406109 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748031b30 con 0x7fc758157a30 2023-10-18T11:10:30.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.419+0000 7fc75f15e640 1 -- 172.21.15.151:0/735406109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 msgr2=0x7fc758070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.419+0000 7fc75f15e640 1 --2- 172.21.15.151:0/735406109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758070e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7480098a0 tx=0x7fc74802b8f0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.419+0000 7fc75f15e640 1 -- 172.21.15.151:0/735406109 shutdown_connections 2023-10-18T11:10:30.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.419+0000 7fc75f15e640 1 --2- 172.21.15.151:0/735406109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758070e00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.419+0000 7fc75f15e640 1 -- 172.21.15.151:0/735406109 >> 172.21.15.151:0/735406109 conn(0x7fc75806b080 msgr2=0x7fc75806b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.419+0000 7fc75f15e640 1 -- 172.21.15.151:0/735406109 shutdown_connections 2023-10-18T11:10:30.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.419+0000 7fc75f15e640 1 -- 172.21.15.151:0/735406109 wait complete. 2023-10-18T11:10:30.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.421+0000 7fc75f15e640 1 Processor -- start 2023-10-18T11:10:30.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.421+0000 7fc75f15e640 1 -- start start 2023-10-18T11:10:30.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.421+0000 7f37df7fe640 1 -- 172.21.15.151:0/2140794454 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f37d80052b0 con 0x7f37e80c62f0 2023-10-18T11:10:30.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.422+0000 7fc75f15e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7580c8bc0 0x7fc7581ee660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.422+0000 7fc75f15e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7581511c0 0x7fc7581599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.422+0000 7fc75f15e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.422+0000 7fc75f15e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758154340 con 0x7fc7581511c0 2023-10-18T11:10:30.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.422+0000 7fc75f15e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581ef0b0 con 0x7fc7580c8bc0 2023-10-18T11:10:30.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.422+0000 7fc75f15e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c0e50 con 0x7fc758157a30 2023-10-18T11:10:30.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.422+0000 7f37df7fe640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f37c806aea0 0x7f37c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.423+0000 7f37df7fe640 1 -- 172.21.15.151:0/2140794454 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f37d8057f30 con 0x7f37e80c62f0 2023-10-18T11:10:30.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.423+0000 7f37ddd9b640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f37c806aea0 0x7f37c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.425+0000 7f37ddd9b640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f37c806aea0 0x7f37c806d360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f37d0036000 tx=0x7f37d0030000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.441+0000 7fbe6affd640 1 -- 172.21.15.151:0/3946540651 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe70055910 con 0x7fbe7406de00 2023-10-18T11:10:30.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.447+0000 7f37df7fe640 1 -- 172.21.15.151:0/2140794454 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37d8054270 con 0x7f37e80c62f0 2023-10-18T11:10:30.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.447+0000 7fe7c8ff9640 1 -- 172.21.15.151:0/1701840563 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7c0034070 con 0x7fe7cc06fbd0 2023-10-18T11:10:30.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.447+0000 7fc75d6fb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.450 INFO:teuthology.orchestra.run.smithi151.stdout:64424509457 2023-10-18T11:10:30.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.449+0000 7fc75cefa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7580c8bc0 0x7fc7581ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.450+0000 7fc75d6fb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57418/0 (socket says 172.21.15.151:57418) 2023-10-18T11:10:30.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.450+0000 7fc75d6fb640 1 -- 172.21.15.151:0/2533033002 learned_addr learned my addr 172.21.15.151:0/2533033002 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:30.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.450+0000 7fc0a57fa640 1 -- 172.21.15.151:0/2950908345 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0a0043020 con 0x7fc0a815af50 2023-10-18T11:10:30.453 INFO:teuthology.orchestra.run.smithi151.stdout:64424509457 2023-10-18T11:10:30.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe7b806aec0 msgr2=0x7fe7b806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe7b806aec0 0x7fe7b806d380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc006fd0 tx=0x7fe7bc008040 comp rx=0 tx=0).stop 2023-10-18T11:10:30.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc06fbd0 msgr2=0x7fe7cc0c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc06fbd0 0x7fe7cc0c80a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00098a0 tx=0x7fe7c0004730 comp rx=0 tx=0).stop 2023-10-18T11:10:30.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 shutdown_connections 2023-10-18T11:10:30.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe7b806aec0 0x7fe7b806d380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7cc0c5760 0x7fe7cc0c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7cc0c5380 0x7fe7cc200250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 --2- 172.21.15.151:0/1701840563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7cc06fbd0 0x7fe7cc0c80a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 >> 172.21.15.151:0/1701840563 conn(0x7fe7cc0c6da0 msgr2=0x7fe7cc16d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 shutdown_connections 2023-10-18T11:10:30.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.451+0000 7fe7d129a640 1 -- 172.21.15.151:0/1701840563 wait complete. 2023-10-18T11:10:30.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc08c06aec0 msgr2=0x7fc08c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc08c06aec0 0x7fc08c06d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc09c001370 tx=0x7fc09c007bb0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0a815af50 msgr2=0x7fc0a8138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0a815af50 0x7fc0a8138ae0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009f40 tx=0x7fc0a0004a40 comp rx=0 tx=0).stop 2023-10-18T11:10:30.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 shutdown_connections 2023-10-18T11:10:30.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc08c06aec0 0x7fc08c06d380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0a815af50 0x7fc0a8138ae0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0a8151090 0x7fc0a806cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 --2- 172.21.15.151:0/2950908345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a80cd190 0x7fc0a806c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.453+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 >> 172.21.15.151:0/2950908345 conn(0x7fc0a806e210 msgr2=0x7fc0a80afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.454+0000 7fc75d6fb640 1 -- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7580c8bc0 msgr2=0x7fc7581ee660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.454+0000 7fc75d6fb640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7580c8bc0 0x7fc7581ee660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.454+0000 7fc75d6fb640 1 -- 172.21.15.151:0/2533033002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7581511c0 msgr2=0x7fc7581599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.454+0000 7fc75d6fb640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7581511c0 0x7fc7581599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.454+0000 7fc75d6fb640 1 -- 172.21.15.151:0/2533033002 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480094d0 con 0x7fc758157a30 2023-10-18T11:10:30.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.454+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 shutdown_connections 2023-10-18T11:10:30.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.454+0000 7fc0af10c640 1 -- 172.21.15.151:0/2950908345 wait complete. 2023-10-18T11:10:30.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.456+0000 7faa7d7fa640 1 -- 172.21.15.151:0/3132483656 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faa74043580 con 0x7faa8006de00 2023-10-18T11:10:30.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.457+0000 7faa7d7fa640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faa6406aec0 0x7faa6406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.457+0000 7fc75d6fb640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758159f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7480097f0 tx=0x7fc7480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.458+0000 7faa7ffff640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faa6406aec0 0x7faa6406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.458+0000 7faa7ffff640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faa6406aec0 0x7faa6406d380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa801509e0 tx=0x7faa6c008040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.462+0000 7fc7557fa640 1 -- 172.21.15.151:0/2533033002 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74803ac60 con 0x7fc758157a30 2023-10-18T11:10:30.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.462+0000 7fc7557fa640 1 -- 172.21.15.151:0/2533033002 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74803ade0 con 0x7fc758157a30 2023-10-18T11:10:30.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.462+0000 7fc7557fa640 1 -- 172.21.15.151:0/2533033002 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748044630 con 0x7fc758157a30 2023-10-18T11:10:30.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.462+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7580c1130 con 0x7fc758157a30 2023-10-18T11:10:30.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.462+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7581594b0 con 0x7fc758157a30 2023-10-18T11:10:30.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.463+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7581596a0 con 0x7fc758157a30 2023-10-18T11:10:30.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.473+0000 7faa7d7fa640 1 -- 172.21.15.151:0/3132483656 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa7403e070 con 0x7faa8006de00 2023-10-18T11:10:30.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.474+0000 7faa7d7fa640 1 -- 172.21.15.151:0/3132483656 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa74077db0 con 0x7faa8006de00 2023-10-18T11:10:30.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.5 2023-10-18T11:10:30.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.2 2023-10-18T11:10:30.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.484+0000 7fc7557fa640 1 -- 172.21.15.151:0/2533033002 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc74802f050 con 0x7fc758157a30 2023-10-18T11:10:30.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.484+0000 7fc7557fa640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc74406ae70 0x7fc74406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.485+0000 7fc75cefa640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc74406ae70 0x7fc74406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.485+0000 7fc75cefa640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc74406ae70 0x7fc74406d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc750001ef0 tx=0x7fc750009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.506+0000 7f42377fe640 1 -- 172.21.15.151:0/1458115366 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42500f34e0 con 0x7f424804b250 2023-10-18T11:10:30.509 INFO:teuthology.orchestra.run.smithi151.stdout:64424509458 2023-10-18T11:10:30.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f423c06af00 msgr2=0x7f423c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f423c06af00 0x7f423c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4240006fd0 tx=0x7f4240006bc0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f424804b250 msgr2=0x7f42481794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f424804b250 0x7f42481794d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f425004ef10 tx=0x7f4250068a80 comp rx=0 tx=0).stop 2023-10-18T11:10:30.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 shutdown_connections 2023-10-18T11:10:30.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f424804b250 0x7f42481794d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f423c06af00 0x7f423c06d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4248045980 0x7f42480bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 --2- 172.21.15.151:0/1458115366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f424800e3f0 0x7f42480346f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 >> 172.21.15.151:0/1458115366 conn(0x7f42480502d0 msgr2=0x7f4248005f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 shutdown_connections 2023-10-18T11:10:30.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.509+0000 7f425496b640 1 -- 172.21.15.151:0/1458115366 wait complete. 2023-10-18T11:10:30.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509458 for osd.4 2023-10-18T11:10:30.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.647+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbe7404e160 con 0x7fbe7406de00 2023-10-18T11:10:30.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.651+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37e804e160 con 0x7f37e80c62f0 2023-10-18T11:10:30.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.671+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7faa800c2d50 con 0x7faa8006de00 2023-10-18T11:10:30.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.676+0000 7faa7d7fa640 1 -- 172.21.15.151:0/3132483656 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa800c2d50 con 0x7faa8006de00 2023-10-18T11:10:30.678 INFO:teuthology.orchestra.run.smithi151.stdout:60129542161 2023-10-18T11:10:30.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faa6406aec0 msgr2=0x7faa6406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faa6406aec0 0x7faa6406d380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa801509e0 tx=0x7faa6c008040 comp rx=0 tx=0).stop 2023-10-18T11:10:30.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa8006de00 msgr2=0x7faa800c0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa8006de00 0x7faa800c0890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa74033000 tx=0x7faa74004730 comp rx=0 tx=0).stop 2023-10-18T11:10:30.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 shutdown_connections 2023-10-18T11:10:30.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7faa6406aec0 0x7faa6406d380 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa80157770 0x7faa800713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa801510a0 0x7faa801f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 --2- 172.21.15.151:0/3132483656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa8006de00 0x7faa800c0890 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 >> 172.21.15.151:0/3132483656 conn(0x7faa80069f70 msgr2=0x7faa8014b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 shutdown_connections 2023-10-18T11:10:30.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.679+0000 7faa86bfc640 1 -- 172.21.15.151:0/3132483656 wait complete. 2023-10-18T11:10:30.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542162 got 60129542161 for osd.6 2023-10-18T11:10:30.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.718+0000 7fbe6affd640 1 -- 172.21.15.151:0/3946540651 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe70058f30 con 0x7fbe7406de00 2023-10-18T11:10:30.721 INFO:teuthology.orchestra.run.smithi151.stdout:64424509459 2023-10-18T11:10:30.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.721+0000 7fc7557fa640 1 -- 172.21.15.151:0/2533033002 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc74807aa00 con 0x7fc758157a30 2023-10-18T11:10:30.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.721+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe5806aec0 msgr2=0x7fbe5806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.721+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe5806aec0 0x7fbe5806d380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe740cb4f0 tx=0x7fbe64008040 comp rx=0 tx=0).stop 2023-10-18T11:10:30.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.721+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 msgr2=0x7fbe7414f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.721+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 0x7fbe7414f7e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000d830 tx=0x7fbe7000dcf0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.721+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 shutdown_connections 2023-10-18T11:10:30.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.722+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe74157770 0x7fbe741595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.722+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe741510a0 0x7fbe74159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.722+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe5806aec0 0x7fbe5806d380 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.722+0000 7fbe7c67c640 1 --2- 172.21.15.151:0/3946540651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe7406de00 0x7fbe7414f7e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.722+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 >> 172.21.15.151:0/3946540651 conn(0x7fbe74069f70 msgr2=0x7fbe7414c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.722+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 shutdown_connections 2023-10-18T11:10:30.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.722+0000 7fbe7c67c640 1 -- 172.21.15.151:0/3946540651 wait complete. 2023-10-18T11:10:30.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.734+0000 7f37df7fe640 1 -- 172.21.15.151:0/2140794454 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37d8057890 con 0x7f37e80c62f0 2023-10-18T11:10:30.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.735+0000 7fc7557fa640 1 -- 172.21.15.151:0/2533033002 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc748076d40 con 0x7fc758157a30 2023-10-18T11:10:30.737 INFO:teuthology.orchestra.run.smithi151.stdout:64424509458 2023-10-18T11:10:30.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f37c806aea0 msgr2=0x7f37c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f37c806aea0 0x7f37c806d360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f37d0036000 tx=0x7f37d0030000 comp rx=0 tx=0).stop 2023-10-18T11:10:30.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c62f0 msgr2=0x7f37e81559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c62f0 0x7f37e81559f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c6d0 tx=0x7f37d800cb90 comp rx=0 tx=0).stop 2023-10-18T11:10:30.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 shutdown_connections 2023-10-18T11:10:30.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f37c806aea0 0x7f37c806d360 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f37d0036000 tx=0x7f37d0030000 comp rx=0 tx=0).stop 2023-10-18T11:10:30.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37e81600c0 0x7f37e815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e80c66d0 0x7f37e80c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 --2- 172.21.15.151:0/2140794454 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37e80c62f0 0x7f37e81559f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.738+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 >> 172.21.15.151:0/2140794454 conn(0x7f37e80cb320 msgr2=0x7f37e806abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509459 for osd.7 2023-10-18T11:10:30.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.739+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 shutdown_connections 2023-10-18T11:10:30.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.739+0000 7f37ec8e7640 1 -- 172.21.15.151:0/2140794454 wait complete. 2023-10-18T11:10:30.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.740+0000 7f57ae7fc640 1 -- 172.21.15.151:0/280152705 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f57a80423e0 con 0x7f57b80cbe20 2023-10-18T11:10:30.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.741+0000 7f57ae7fc640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f579c06aef0 0x7f579c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:30.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.742+0000 7f57ae7fc640 1 -- 172.21.15.151:0/280152705 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f57a80ac110 con 0x7f57b80cbe20 2023-10-18T11:10:30.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.742+0000 7f57bdd85640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f579c06aef0 0x7f579c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:30.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.742+0000 7f57bdd85640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f579c06aef0 0x7f579c06d3b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57b4005880 tx=0x7f57b4009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:30.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.748+0000 7f57ae7fc640 1 -- 172.21.15.151:0/280152705 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57a8077020 con 0x7f57b80cbe20 2023-10-18T11:10:30.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509458 for osd.1 2023-10-18T11:10:30.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.943+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc7581596a0 con 0x7fc758157a30 2023-10-18T11:10:30.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.946+0000 7fc7557fa640 1 -- 172.21.15.151:0/2533033002 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc748052070 con 0x7fc758157a30 2023-10-18T11:10:30.949 INFO:teuthology.orchestra.run.smithi151.stdout:64424509457 2023-10-18T11:10:30.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc74406ae70 msgr2=0x7fc74406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc74406ae70 0x7fc74406d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc750001ef0 tx=0x7fc750009040 comp rx=0 tx=0).stop 2023-10-18T11:10:30.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 msgr2=0x7fc758159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:30.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758159f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7480097f0 tx=0x7fc7480046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 shutdown_connections 2023-10-18T11:10:30.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc758157a30 0x7fc758159f10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7581511c0 0x7fc7581599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fc74406ae70 0x7fc74406d330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 --2- 172.21.15.151:0/2533033002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7580c8bc0 0x7fc7581ee660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:30.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 >> 172.21.15.151:0/2533033002 conn(0x7fc75806b080 msgr2=0x7fc7580c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:30.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 shutdown_connections 2023-10-18T11:10:30.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.949+0000 7fc75f15e640 1 -- 172.21.15.151:0/2533033002 wait complete. 2023-10-18T11:10:30.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.3 2023-10-18T11:10:30.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:30.970+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57b814fdb0 con 0x7f57b80cbe20 2023-10-18T11:10:31.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.019+0000 7f57ae7fc640 1 -- 172.21.15.151:0/280152705 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57a807a640 con 0x7f57b80cbe20 2023-10-18T11:10:31.022 INFO:teuthology.orchestra.run.smithi151.stdout:64424509459 2023-10-18T11:10:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.022+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f579c06aef0 msgr2=0x7f579c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.022+0000 7f57bffe9640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f579c06aef0 0x7f579c06d3b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57b4005880 tx=0x7f57b4009040 comp rx=0 tx=0).stop 2023-10-18T11:10:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.022+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b80cbe20 msgr2=0x7f57b8151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.022+0000 7f57bffe9640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b80cbe20 0x7f57b8151250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57a802bf70 tx=0x7f57a8004730 comp rx=0 tx=0).stop 2023-10-18T11:10:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.023+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 shutdown_connections 2023-10-18T11:10:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.023+0000 7f57bffe9640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b815d170 0x7f57b80cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.023+0000 7f57bffe9640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f579c06aef0 0x7f579c06d3b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.023+0000 7f57bffe9640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57b80cbe20 0x7f57b8151250 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.023+0000 7f57bffe9640 1 --2- 172.21.15.151:0/280152705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57b80c9650 0x7f57b81500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.023+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 >> 172.21.15.151:0/280152705 conn(0x7f57b80659d0 msgr2=0x7f57b80b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.023+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 shutdown_connections 2023-10-18T11:10:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.023+0000 7f57bffe9640 1 -- 172.21.15.151:0/280152705 wait complete. 2023-10-18T11:10:31.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509459 for osd.0 2023-10-18T11:10:31.043 DEBUG:teuthology.parallel:result is None 2023-10-18T11:10:31.482 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-18T11:10:31.484 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-18T11:10:31.531 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-18T11:10:31.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.685+0000 7f40eabe7640 1 Processor -- start 2023-10-18T11:10:31.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.686+0000 7f40eabe7640 1 -- start start 2023-10-18T11:10:31.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.687+0000 7f40eabe7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e40715d0 0x7f40e40c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.687+0000 7f40eabe7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40e415c5d0 0x7f40e415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.687+0000 7f40eabe7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e40c6450 con 0x7f40e41532a0 2023-10-18T11:10:31.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.687+0000 7f40eabe7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40c5ae0 con 0x7f40e415c5d0 2023-10-18T11:10:31.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.687+0000 7f40eabe7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c54a0 con 0x7f40e40715d0 2023-10-18T11:10:31.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.688+0000 7f40e3fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e40715d0 0x7f40e40c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.688+0000 7f40e3fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e40715d0 0x7f40e40c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57422/0 (socket says 172.21.15.151:57422) 2023-10-18T11:10:31.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.688+0000 7f40e3fff640 1 -- 172.21.15.151:0/3258160648 learned_addr learned my addr 172.21.15.151:0/3258160648 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:31.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.688+0000 7f40e9184640 1 --2- 172.21.15.151:0/3258160648 >> v2:172.21.15.151:3300/0 conn(0x7f40e415c5d0 0x7f40e415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.691+0000 7f40e3fff640 1 -- 172.21.15.151:0/3258160648 >> v2:172.21.15.151:3300/0 conn(0x7f40e415c5d0 msgr2=0x7f40e415ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:31.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.691+0000 7f40e3fff640 1 --2- 172.21.15.151:0/3258160648 >> v2:172.21.15.151:3300/0 conn(0x7f40e415c5d0 0x7f40e415ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.691+0000 7f40e3fff640 1 -- 172.21.15.151:0/3258160648 >> v1:172.21.15.151:6789/0 conn(0x7f40e41532a0 legacy=0x7f40e406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.691+0000 7f40e3fff640 1 -- 172.21.15.151:0/3258160648 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40c5780 con 0x7f40e40715d0 2023-10-18T11:10:31.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.693+0000 7f40e3fff640 1 --2- 172.21.15.151:0/3258160648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e40715d0 0x7f40e40c5f10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009870 tx=0x7f40d002ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d3925b270cfff32 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:31.698 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-18T11:10:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.696+0000 7f40e37fe640 1 -- 172.21.15.151:0/3258160648 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d002f830 con 0x7f40e40715d0 2023-10-18T11:10:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.696+0000 7f40e37fe640 1 -- 172.21.15.151:0/3258160648 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d002f990 con 0x7f40e40715d0 2023-10-18T11:10:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.696+0000 7f40e37fe640 1 -- 172.21.15.151:0/3258160648 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d002fd20 con 0x7f40e40715d0 2023-10-18T11:10:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.697+0000 7f40eabe7640 1 -- 172.21.15.151:0/3258160648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e40715d0 msgr2=0x7f40e40c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.697+0000 7f40eabe7640 1 --2- 172.21.15.151:0/3258160648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e40715d0 0x7f40e40c5f10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009870 tx=0x7f40d002ba10 comp rx=0 tx=0).stop 2023-10-18T11:10:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.697+0000 7f40eabe7640 1 -- 172.21.15.151:0/3258160648 shutdown_connections 2023-10-18T11:10:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.697+0000 7f40eabe7640 1 --2- 172.21.15.151:0/3258160648 >> v2:172.21.15.151:3300/0 conn(0x7f40e415c5d0 0x7f40e415ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.697+0000 7f40eabe7640 1 --2- 172.21.15.151:0/3258160648 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e40715d0 0x7f40e40c5f10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.697+0000 7f40eabe7640 1 -- 172.21.15.151:0/3258160648 >> 172.21.15.151:0/3258160648 conn(0x7f40e4069f70 msgr2=0x7f40e406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:31.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.697+0000 7f40eabe7640 1 -- 172.21.15.151:0/3258160648 shutdown_connections 2023-10-18T11:10:31.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.697+0000 7f40eabe7640 1 -- 172.21.15.151:0/3258160648 wait complete. 2023-10-18T11:10:31.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.699+0000 7f40eabe7640 1 Processor -- start 2023-10-18T11:10:31.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.699+0000 7f40eabe7640 1 -- start start 2023-10-18T11:10:31.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.700+0000 7f40eabe7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40e40715d0 0x7f40e41562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.700+0000 7f40eabe7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e41532a0 0x7f40e41f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.700+0000 7f40eabe7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40e415c5d0 0x7f40e41eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.700+0000 7f40eabe7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41567e0 con 0x7f40e40715d0 2023-10-18T11:10:31.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.700+0000 7f40eabe7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41ed2b0 con 0x7f40e415c5d0 2023-10-18T11:10:31.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.700+0000 7f40eabe7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41f2a40 con 0x7f40e41532a0 2023-10-18T11:10:31.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.701+0000 7f40e3fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e41532a0 0x7f40e41f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.701+0000 7f40e9184640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40e415c5d0 0x7f40e41eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.701+0000 7f40e8983640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40e40715d0 0x7f40e41562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.701+0000 7f40e3fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e41532a0 0x7f40e41f2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57426/0 (socket says 172.21.15.151:57426) 2023-10-18T11:10:31.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.701+0000 7f40e3fff640 1 -- 172.21.15.151:0/226630579 learned_addr learned my addr 172.21.15.151:0/226630579 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:31.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.705+0000 7f40e3fff640 1 -- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40e415c5d0 msgr2=0x7f40e41eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.705+0000 7f40e3fff640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40e415c5d0 0x7f40e41eda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.705+0000 7f40e3fff640 1 -- 172.21.15.151:0/226630579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40e40715d0 msgr2=0x7f40e41562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.705+0000 7f40e3fff640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40e40715d0 0x7f40e41562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.705+0000 7f40e3fff640 1 -- 172.21.15.151:0/226630579 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00094d0 con 0x7f40e41532a0 2023-10-18T11:10:31.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.707+0000 7f40e3fff640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e41532a0 0x7f40e41f2050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40d0000c00 tx=0x7f40d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.711+0000 7f40e17fa640 1 -- 172.21.15.151:0/226630579 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d003b040 con 0x7f40e41532a0 2023-10-18T11:10:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.711+0000 7f40e17fa640 1 -- 172.21.15.151:0/226630579 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d0037d00 con 0x7f40e41532a0 2023-10-18T11:10:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.711+0000 7f40e17fa640 1 -- 172.21.15.151:0/226630579 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00426a0 con 0x7f40e41532a0 2023-10-18T11:10:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.711+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e41f2ce0 con 0x7f40e41532a0 2023-10-18T11:10:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.711+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e4159c70 con 0x7f40e41532a0 2023-10-18T11:10:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.712+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e404e160 con 0x7f40e41532a0 2023-10-18T11:10:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.725+0000 7f3704d0f640 1 Processor -- start 2023-10-18T11:10:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.725+0000 7f3704d0f640 1 -- start start 2023-10-18T11:10:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.726+0000 7f4ce137c640 1 Processor -- start 2023-10-18T11:10:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.726+0000 7f4ce137c640 1 -- start start 2023-10-18T11:10:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.726+0000 7f3704d0f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f37000cbe20 0x7f370015d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.726+0000 7f3704d0f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37000b1340 0x7f37000cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.726+0000 7f3704d0f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f37000c9650 0x7f37000c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.726+0000 7f3704d0f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3700153870 con 0x7f37000c9650 2023-10-18T11:10:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.726+0000 7f3704d0f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000cc200 con 0x7f37000cbe20 2023-10-18T11:10:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.726+0000 7f3704d0f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37000b1e30 con 0x7f37000b1340 2023-10-18T11:10:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.727+0000 7f36fe59c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f37000cbe20 0x7f370015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.727+0000 7f4ce137c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4cdc0cbe20 0x7f4cdc15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.728+0000 7f36fe59c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f37000cbe20 0x7f370015d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38952/0 (socket says 172.21.15.151:38952) 2023-10-18T11:10:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.728+0000 7f36fe59c640 1 -- 172.21.15.151:0/2865018873 learned_addr learned my addr 172.21.15.151:0/2865018873 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.727+0000 7f4ce137c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc153870 con 0x7f4cdc0b1340 2023-10-18T11:10:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.727+0000 7f4ce137c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc0cc200 con 0x7f4cdc0c9650 2023-10-18T11:10:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.727+0000 7f4ce137c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc0b1e30 con 0x7f4cdc0cbe20 2023-10-18T11:10:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.729+0000 7f4cdb7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f4cdc0c9650 0x7f4cdc163970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50078/0 (socket says 172.21.15.151:50078) 2023-10-18T11:10:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.729+0000 7f4cdb7fe640 1 -- 172.21.15.151:0/1921923082 learned_addr learned my addr 172.21.15.151:0/1921923082 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.730+0000 7f36fe59c640 1 -- 172.21.15.151:0/2865018873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37000b1340 msgr2=0x7f37000cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.730+0000 7f36fe59c640 1 --2- 172.21.15.151:0/2865018873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37000b1340 0x7f37000cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.730+0000 7f36fe59c640 1 -- 172.21.15.151:0/2865018873 >> v2:172.21.15.151:3300/0 conn(0x7f37000c9650 msgr2=0x7f37000c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:31.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.730+0000 7f36fe59c640 1 --2- 172.21.15.151:0/2865018873 >> v2:172.21.15.151:3300/0 conn(0x7f37000c9650 0x7f37000c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.730+0000 7f36fe59c640 1 -- 172.21.15.151:0/2865018873 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37001590d0 con 0x7f37000cbe20 2023-10-18T11:10:31.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.732+0000 7f4cdaffd640 1 --2- 172.21.15.151:0/1921923082 >> v2:172.21.15.151:3300/0 conn(0x7f4cdc0cbe20 0x7f4cdc15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.733+0000 7f40e17fa640 1 -- 172.21.15.151:0/226630579 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40d003f3f0 con 0x7f40e41532a0 2023-10-18T11:10:31.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.733+0000 7f36fe59c640 1 --2- 172.21.15.151:0/2865018873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000cbe20 0x7f370015d170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f370008c5c0 tx=0x7f36f002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810ee1ebebeb207f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:31.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.734+0000 7f40e17fa640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40c806aec0 0x7f40c806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.734+0000 7f40e8983640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40c806aec0 0x7f40c806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.735+0000 7f40e8983640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40c806aec0 0x7f40c806d380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f40d8001780 tx=0x7f40d8009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:31.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.735+0000 7f40e17fa640 1 -- 172.21.15.151:0/226630579 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40d007ae60 con 0x7f40e41532a0 2023-10-18T11:10:31.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.738+0000 7f4cd9ffb640 1 -- 172.21.15.151:0/1921923082 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470774911 0 0) 0x7f4cdc0cc200 con 0x7f4cdc0c9650 2023-10-18T11:10:31.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.738+0000 7f4cd9ffb640 1 -- 172.21.15.151:0/1921923082 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc4003520 con 0x7f4cdc0c9650 2023-10-18T11:10:31.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.738+0000 7f4cdaffd640 1 -- 172.21.15.151:0/1921923082 >> v1:172.21.15.169:6789/0 conn(0x7f4cdc0c9650 legacy=0x7f4cdc163970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.738+0000 7f4cdaffd640 1 -- 172.21.15.151:0/1921923082 >> v1:172.21.15.151:6789/0 conn(0x7f4cdc0b1340 legacy=0x7f4cdc0cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:31.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.738+0000 7f4cdaffd640 1 -- 172.21.15.151:0/1921923082 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc1590d0 con 0x7f4cdc0cbe20 2023-10-18T11:10:31.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.739+0000 7f36fd59a640 1 -- 172.21.15.151:0/2865018873 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0030860 con 0x7f37000cbe20 2023-10-18T11:10:31.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.739+0000 7f36fd59a640 1 -- 172.21.15.151:0/2865018873 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f00309c0 con 0x7f37000cbe20 2023-10-18T11:10:31.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.739+0000 7f36fd59a640 1 -- 172.21.15.151:0/2865018873 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0030d50 con 0x7f37000cbe20 2023-10-18T11:10:31.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.740+0000 7f3704d0f640 1 -- 172.21.15.151:0/2865018873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000cbe20 msgr2=0x7f370015d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.740+0000 7f3704d0f640 1 --2- 172.21.15.151:0/2865018873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000cbe20 0x7f370015d170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f370008c5c0 tx=0x7f36f002b9a0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.740+0000 7f3704d0f640 1 -- 172.21.15.151:0/2865018873 shutdown_connections 2023-10-18T11:10:31.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.740+0000 7f3704d0f640 1 --2- 172.21.15.151:0/2865018873 >> v2:172.21.15.151:3300/0 conn(0x7f37000c9650 0x7f37000c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.740+0000 7f3704d0f640 1 --2- 172.21.15.151:0/2865018873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37000b1340 0x7f37000cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.740+0000 7f3704d0f640 1 --2- 172.21.15.151:0/2865018873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000cbe20 0x7f370015d170 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.740+0000 7f3704d0f640 1 -- 172.21.15.151:0/2865018873 >> 172.21.15.151:0/2865018873 conn(0x7f37000659d0 msgr2=0x7f3700065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:31.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.740+0000 7f3704d0f640 1 -- 172.21.15.151:0/2865018873 shutdown_connections 2023-10-18T11:10:31.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.740+0000 7f3704d0f640 1 -- 172.21.15.151:0/2865018873 wait complete. 2023-10-18T11:10:31.744 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-18T11:10:31.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.741+0000 7f4cdaffd640 1 --2- 172.21.15.151:0/1921923082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0cbe20 0x7f4cdc15d170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0097a0 tx=0x7f4ccc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c0974c031b6c22 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:31.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.742+0000 7f3704d0f640 1 Processor -- start 2023-10-18T11:10:31.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.742+0000 7f3704d0f640 1 -- start start 2023-10-18T11:10:31.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.743+0000 7f3704d0f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37000b1340 0x7f370014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.743+0000 7f3704d0f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000c9650 0x7f370014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.743+0000 7f3704d0f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37000cbe20 0x7f370015c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.743+0000 7f3704d0f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37001e2a60 con 0x7f37000cbe20 2023-10-18T11:10:31.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.743+0000 7f3704d0f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37000ce460 con 0x7f37000c9650 2023-10-18T11:10:31.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.743+0000 7f3704d0f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370015bef0 con 0x7f37000b1340 2023-10-18T11:10:31.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.745+0000 7f36fdd9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000c9650 0x7f370014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.745+0000 7f36fdd9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000c9650 0x7f370014f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38958/0 (socket says 172.21.15.151:38958) 2023-10-18T11:10:31.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.745+0000 7f36fdd9b640 1 -- 172.21.15.151:0/202688213 learned_addr learned my addr 172.21.15.151:0/202688213 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:31.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.749+0000 7f36fdd9b640 1 -- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37000b1340 msgr2=0x7f370014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.749+0000 7f36fdd9b640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37000b1340 0x7f370014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.749+0000 7f36fdd9b640 1 -- 172.21.15.151:0/202688213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37000cbe20 msgr2=0x7f370015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.749+0000 7f36fdd9b640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37000cbe20 0x7f370015c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.749+0000 7f36fdd9b640 1 -- 172.21.15.151:0/202688213 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f00094d0 con 0x7f37000c9650 2023-10-18T11:10:31.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.746+0000 7f4cd9ffb640 1 -- 172.21.15.151:0/1921923082 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc030610 con 0x7f4cdc0cbe20 2023-10-18T11:10:31.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.746+0000 7f4cd9ffb640 1 -- 172.21.15.151:0/1921923082 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc030770 con 0x7f4cdc0cbe20 2023-10-18T11:10:31.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.746+0000 7f4cd9ffb640 1 -- 172.21.15.151:0/1921923082 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc030b00 con 0x7f4cdc0cbe20 2023-10-18T11:10:31.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.747+0000 7f4ce137c640 1 -- 172.21.15.151:0/1921923082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0cbe20 msgr2=0x7f4cdc15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.747+0000 7f4ce137c640 1 --2- 172.21.15.151:0/1921923082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0cbe20 0x7f4cdc15d170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0097a0 tx=0x7f4ccc02b960 comp rx=0 tx=0).stop 2023-10-18T11:10:31.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.747+0000 7f4ce137c640 1 -- 172.21.15.151:0/1921923082 shutdown_connections 2023-10-18T11:10:31.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.747+0000 7f4ce137c640 1 --2- 172.21.15.151:0/1921923082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0cbe20 0x7f4cdc15d170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.747+0000 7f4ce137c640 1 -- 172.21.15.151:0/1921923082 >> 172.21.15.151:0/1921923082 conn(0x7f4cdc0659d0 msgr2=0x7f4cdc065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:31.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.748+0000 7f4ce137c640 1 -- 172.21.15.151:0/1921923082 shutdown_connections 2023-10-18T11:10:31.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.748+0000 7f4ce137c640 1 -- 172.21.15.151:0/1921923082 wait complete. 2023-10-18T11:10:31.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.750+0000 7f4ce137c640 1 Processor -- start 2023-10-18T11:10:31.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.750+0000 7f4ce137c640 1 -- start start 2023-10-18T11:10:31.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.751+0000 7f4ce137c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4cdc0b1340 0x7f4cdc0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.751+0000 7f4ce137c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0c9650 0x7f4cdc1eea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.751+0000 7f4ce137c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cdc0cbe20 0x7f4cdc15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.751+0000 7f4ce137c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc15a230 con 0x7f4cdc0c9650 2023-10-18T11:10:31.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.751+0000 7f4ce137c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc1f2460 con 0x7f4cdc0cbe20 2023-10-18T11:10:31.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.751+0000 7f4ce137c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc15a480 con 0x7f4cdc0b1340 2023-10-18T11:10:31.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.751+0000 7f36fdd9b640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000c9650 0x7f370014f120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f36f400b4a0 tx=0x7f36f400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:31.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.752+0000 7f4cdb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cdc0cbe20 0x7f4cdc15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.753+0000 7f4cda7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0c9650 0x7f4cdc1eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.753+0000 7f4cda7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0c9650 0x7f4cdc1eea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44928/0 (socket says 172.21.15.151:44928) 2023-10-18T11:10:31.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.753+0000 7f4cda7fc640 1 -- 172.21.15.151:0/3973462159 learned_addr learned my addr 172.21.15.151:0/3973462159 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:31.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.756+0000 7f36eeffd640 1 -- 172.21.15.151:0/202688213 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4010610 con 0x7f37000c9650 2023-10-18T11:10:31.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.756+0000 7f36eeffd640 1 -- 172.21.15.151:0/202688213 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f4010770 con 0x7f37000c9650 2023-10-18T11:10:31.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.756+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37000ce180 con 0x7f37000c9650 2023-10-18T11:10:31.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.756+0000 7f36eeffd640 1 -- 172.21.15.151:0/202688213 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4010b20 con 0x7f37000c9650 2023-10-18T11:10:31.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.756+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370015b8a0 con 0x7f37000c9650 2023-10-18T11:10:31.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.758+0000 7f4cda7fc640 1 -- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4cdc0b1340 msgr2=0x7f4cdc0c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.758+0000 7f4cda7fc640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4cdc0b1340 0x7f4cdc0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.758+0000 7f4cda7fc640 1 -- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cdc0cbe20 msgr2=0x7f4cdc15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:31.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.758+0000 7f4cda7fc640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cdc0cbe20 0x7f4cdc15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.758+0000 7f4cda7fc640 1 -- 172.21.15.151:0/3973462159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc009400 con 0x7f4cdc0c9650 2023-10-18T11:10:31.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.758+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3700072160 con 0x7f37000c9650 2023-10-18T11:10:31.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.761+0000 7f4cda7fc640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0c9650 0x7f4cdc1eea10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c430 tx=0x7f4cd000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:31.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-18T11:10:31.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.764+0000 7f4cc37fe640 1 -- 172.21.15.151:0/3973462159 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0011790 con 0x7f4cdc0c9650 2023-10-18T11:10:31.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.765+0000 7f4cc37fe640 1 -- 172.21.15.151:0/3973462159 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd00118f0 con 0x7f4cdc0c9650 2023-10-18T11:10:31.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.765+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cdc15a760 con 0x7f4cdc0c9650 2023-10-18T11:10:31.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.765+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc1f2120 con 0x7f4cdc0c9650 2023-10-18T11:10:31.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.765+0000 7f4cc37fe640 1 -- 172.21.15.151:0/3973462159 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0011ce0 con 0x7f4cdc0c9650 2023-10-18T11:10:31.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.766+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cbc005250 con 0x7f4cdc0c9650 2023-10-18T11:10:31.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.785+0000 7f36eeffd640 1 -- 172.21.15.151:0/202688213 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36f4010c80 con 0x7f37000c9650 2023-10-18T11:10:31.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.786+0000 7f36eeffd640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f36e006aef0 0x7f36e006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.786+0000 7f36eeffd640 1 -- 172.21.15.151:0/202688213 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f36f405c570 con 0x7f37000c9650 2023-10-18T11:10:31.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.787+0000 7f36fe59c640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f36e006aef0 0x7f36e006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.788+0000 7f36fe59c640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f36e006aef0 0x7f36e006d3b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f36f0036000 tx=0x7f36f003b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:31.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.888+0000 7f2f75be9640 1 Processor -- start 2023-10-18T11:10:31.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.889+0000 7f2f75be9640 1 -- start start 2023-10-18T11:10:31.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.890+0000 7f2f75be9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2f70151090 0x7f2f70156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.890+0000 7f2f75be9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2f7015af50 0x7f2f700c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.890+0000 7f2f75be9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f700cd190 0x7f2f700659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.890+0000 7f2f75be9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f700c8f00 con 0x7f2f7015af50 2023-10-18T11:10:31.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.890+0000 7f2f75be9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f70151470 con 0x7f2f70151090 2023-10-18T11:10:31.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.890+0000 7f2f75be9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7015aac0 con 0x7f2f700cd190 2023-10-18T11:10:31.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.938+0000 7fa2bc664640 1 Processor -- start 2023-10-18T11:10:31.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.938+0000 7fa2bc664640 1 -- start start 2023-10-18T11:10:31.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.939+0000 7fa2bc664640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa2b41510a0 0x7fa2b40c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.939+0000 7fa2bc664640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b406d430 con 0x7fa2b40c4e60 2023-10-18T11:10:31.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.939+0000 7fa2bc664640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b4151480 con 0x7fa2b4157770 2023-10-18T11:10:31.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.939+0000 7fa2bc664640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b40c27d0 con 0x7fa2b41510a0 2023-10-18T11:10:31.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.963+0000 7f4be67f0640 1 Processor -- start 2023-10-18T11:10:31.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.963+0000 7f4be67f0640 1 -- start start 2023-10-18T11:10:31.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.964+0000 7f4be67f0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4be00c9990 0x7f4be00c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.964+0000 7f4be67f0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be006b760 con 0x7f4be00c5da0 2023-10-18T11:10:31.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.964+0000 7f4be67f0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be006a870 con 0x7f4be0153250 2023-10-18T11:10:31.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.964+0000 7f4be67f0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be0153630 con 0x7f4be00c9990 2023-10-18T11:10:31.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-18T11:10:31.979 INFO:tasks.ceph.mds.e.smithi151.stderr:2023-10-18T11:10:31.974+0000 f5b3640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-10-18T11:10:31.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.988+0000 7f4cc37fe640 1 -- 172.21.15.151:0/3973462159 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4cd001c460 con 0x7f4cdc0c9650 2023-10-18T11:10:31.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.989+0000 7f40e17fa640 1 -- 172.21.15.151:0/226630579 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40d00771a0 con 0x7f40e41532a0 2023-10-18T11:10:31.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.989+0000 7f4cc37fe640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4cc806aec0 0x7f4cc806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:31.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.990+0000 7f4cdaffd640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4cc806aec0 0x7f4cc806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.990+0000 7f4cdaffd640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4cc806aec0 0x7f4cc806d380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc036000 tx=0x7f4ccc030000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:31.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.991+0000 7f2f6ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f700cd190 0x7f2f700659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:31.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.992+0000 7f2f6ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f700cd190 0x7f2f700659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57466/0 (socket says 172.21.15.151:57466) 2023-10-18T11:10:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.992+0000 7f2f6ffff640 1 -- 172.21.15.151:0/98161765 learned_addr learned my addr 172.21.15.151:0/98161765 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.992+0000 7f4cc37fe640 1 -- 172.21.15.151:0/3973462159 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4cd0059420 con 0x7f4cdc0c9650 2023-10-18T11:10:31.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.996+0000 7f2f6ffff640 1 -- 172.21.15.151:0/98161765 >> v2:172.21.15.169:3300/0 conn(0x7f2f70151090 msgr2=0x7f2f70156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:31.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.996+0000 7f2f6ffff640 1 --2- 172.21.15.151:0/98161765 >> v2:172.21.15.169:3300/0 conn(0x7f2f70151090 0x7f2f70156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.996+0000 7f2f6ffff640 1 -- 172.21.15.151:0/98161765 >> v2:172.21.15.151:3300/0 conn(0x7f2f7015af50 msgr2=0x7f2f700c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:31.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.996+0000 7f2f6ffff640 1 --2- 172.21.15.151:0/98161765 >> v2:172.21.15.151:3300/0 conn(0x7f2f7015af50 0x7f2f700c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:31.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.996+0000 7f2f6ffff640 1 -- 172.21.15.151:0/98161765 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70157220 con 0x7f2f700cd190 2023-10-18T11:10:32.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:31.998+0000 7f2f6ffff640 1 --2- 172.21.15.151:0/98161765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f700cd190 0x7f2f700659d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f700c6d00 tx=0x7f2f6802be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91fb353abedcf557 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.002+0000 7f2f6e7fc640 1 -- 172.21.15.151:0/98161765 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6802c9f0 con 0x7f2f700cd190 2023-10-18T11:10:32.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.002+0000 7f2f6e7fc640 1 -- 172.21.15.151:0/98161765 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6802cb50 con 0x7f2f700cd190 2023-10-18T11:10:32.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.002+0000 7f2f6e7fc640 1 -- 172.21.15.151:0/98161765 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680343f0 con 0x7f2f700cd190 2023-10-18T11:10:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.002+0000 7f2f75be9640 1 -- 172.21.15.151:0/98161765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f700cd190 msgr2=0x7f2f700659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.002+0000 7f2f75be9640 1 --2- 172.21.15.151:0/98161765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f700cd190 0x7f2f700659d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f700c6d00 tx=0x7f2f6802be50 comp rx=0 tx=0).stop 2023-10-18T11:10:32.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.003+0000 7f2f75be9640 1 -- 172.21.15.151:0/98161765 shutdown_connections 2023-10-18T11:10:32.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.003+0000 7f2f75be9640 1 --2- 172.21.15.151:0/98161765 >> v2:172.21.15.151:3300/0 conn(0x7f2f7015af50 0x7f2f700c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.003+0000 7f2f75be9640 1 --2- 172.21.15.151:0/98161765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f700cd190 0x7f2f700659d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.003+0000 7f2f75be9640 1 --2- 172.21.15.151:0/98161765 >> v2:172.21.15.169:3300/0 conn(0x7f2f70151090 0x7f2f70156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.003+0000 7f2f75be9640 1 -- 172.21.15.151:0/98161765 >> 172.21.15.151:0/98161765 conn(0x7f2f7006e210 msgr2=0x7f2f7006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.003+0000 7f2f75be9640 1 -- 172.21.15.151:0/98161765 shutdown_connections 2023-10-18T11:10:32.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.003+0000 7f2f75be9640 1 -- 172.21.15.151:0/98161765 wait complete. 2023-10-18T11:10:32.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.004+0000 7f2f75be9640 1 Processor -- start 2023-10-18T11:10:32.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.005+0000 7f2f75be9640 1 -- start start 2023-10-18T11:10:32.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.005+0000 7f2f75be9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f700cd190 0x7f2f70149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.005+0000 7f2f75be9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f70151090 0x7f2f701466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.005+0000 7f2f75be9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f7015af50 0x7f2f70144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.006+0000 7f2f75be9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f700708f0 con 0x7f2f700cd190 2023-10-18T11:10:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.006+0000 7f2f75be9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7015a210 con 0x7f2f70151090 2023-10-18T11:10:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.006+0000 7f2f75be9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f70070370 con 0x7f2f7015af50 2023-10-18T11:10:32.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.006+0000 7f2f6ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f7015af50 0x7f2f70144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.006+0000 7f2f6ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f7015af50 0x7f2f70144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57476/0 (socket says 172.21.15.151:57476) 2023-10-18T11:10:32.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.006+0000 7f2f6ffff640 1 -- 172.21.15.151:0/627132926 learned_addr learned my addr 172.21.15.151:0/627132926 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.010+0000 7f2f6ffff640 1 -- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f70151090 msgr2=0x7f2f701466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.010+0000 7f2f6ffff640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f70151090 0x7f2f701466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.010+0000 7f2f6ffff640 1 -- 172.21.15.151:0/627132926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f700cd190 msgr2=0x7f2f70149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.010+0000 7f2f6ffff640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f700cd190 0x7f2f70149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.010+0000 7f2f6ffff640 1 -- 172.21.15.151:0/627132926 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68009b30 con 0x7f2f7015af50 2023-10-18T11:10:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.012+0000 7f2f6ffff640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f7015af50 0x7f2f70144f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009f40 tx=0x7f2f68004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.015+0000 7f2f57fff640 1 -- 172.21.15.151:0/627132926 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68009510 con 0x7f2f7015af50 2023-10-18T11:10:32.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.016+0000 7f2f57fff640 1 -- 172.21.15.151:0/627132926 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6803e450 con 0x7f2f7015af50 2023-10-18T11:10:32.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.016+0000 7f2f57fff640 1 -- 172.21.15.151:0/627132926 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6803e7e0 con 0x7f2f7015af50 2023-10-18T11:10:32.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.016+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f70070610 con 0x7f2f7015af50 2023-10-18T11:10:32.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.016+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f701461d0 con 0x7f2f7015af50 2023-10-18T11:10:32.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.017+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f70145d50 con 0x7f2f7015af50 2023-10-18T11:10:32.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.036+0000 7f2f57fff640 1 -- 172.21.15.151:0/627132926 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f6803e940 con 0x7f2f7015af50 2023-10-18T11:10:32.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.036+0000 7f2f57fff640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2f5c06aef0 0x7f2f5c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.037+0000 7f2f6f7fe640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2f5c06aef0 0x7f2f5c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.038+0000 7f2f6f7fe640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2f5c06aef0 0x7f2f5c06d3b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009710 tx=0x7f2f60006c90 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.040+0000 7f36eeffd640 1 -- 172.21.15.151:0/202688213 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36f40581f0 con 0x7f37000c9650 2023-10-18T11:10:32.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.041+0000 7fa2ba400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa2b41510a0 0x7fa2b40c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.041+0000 7fa2ba400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa2b41510a0 0x7fa2b40c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:38988/0 (socket says 172.21.15.151:38988) 2023-10-18T11:10:32.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.041+0000 7fa2ba400640 1 -- 172.21.15.151:0/717205723 learned_addr learned my addr 172.21.15.151:0/717205723 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:32.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.045+0000 7fa2ba400640 1 -- 172.21.15.151:0/717205723 >> v1:172.21.15.169:6789/0 conn(0x7fa2b4157770 legacy=0x7fa2b406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:32.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.045+0000 7fa2ba400640 1 -- 172.21.15.151:0/717205723 >> v1:172.21.15.151:6789/0 conn(0x7fa2b40c4e60 legacy=0x7fa2b41616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:32.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.045+0000 7fa2ba400640 1 -- 172.21.15.151:0/717205723 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b40c2a90 con 0x7fa2b41510a0 2023-10-18T11:10:32.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.047+0000 7f4be57ee640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f4be0153250 0x7f4be015cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50096/0 (socket says 172.21.15.151:50096) 2023-10-18T11:10:32.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.047+0000 7f4be57ee640 1 -- 172.21.15.151:0/1709379942 learned_addr learned my addr 172.21.15.151:0/1709379942 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:32.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.053+0000 7fa2ba400640 1 --2- 172.21.15.151:0/717205723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 0x7fa2b40c2180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009870 tx=0x7fa2b002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd7344eabfcfdd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.057+0000 7fa2b93fe640 1 -- 172.21.15.151:0/717205723 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0030860 con 0x7fa2b41510a0 2023-10-18T11:10:32.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.057+0000 7fa2b93fe640 1 -- 172.21.15.151:0/717205723 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b00309c0 con 0x7fa2b41510a0 2023-10-18T11:10:32.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.057+0000 7fa2b93fe640 1 -- 172.21.15.151:0/717205723 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0030d50 con 0x7fa2b41510a0 2023-10-18T11:10:32.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.058+0000 7fa2bc664640 1 -- 172.21.15.151:0/717205723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 msgr2=0x7fa2b40c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.058+0000 7fa2bc664640 1 --2- 172.21.15.151:0/717205723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 0x7fa2b40c2180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009870 tx=0x7fa2b002b9a0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.058+0000 7fa2bc664640 1 -- 172.21.15.151:0/717205723 shutdown_connections 2023-10-18T11:10:32.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.058+0000 7fa2bc664640 1 --2- 172.21.15.151:0/717205723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 0x7fa2b40c2180 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.058+0000 7fa2bc664640 1 -- 172.21.15.151:0/717205723 >> 172.21.15.151:0/717205723 conn(0x7fa2b4069f70 msgr2=0x7fa2b406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.058+0000 7fa2bc664640 1 -- 172.21.15.151:0/717205723 shutdown_connections 2023-10-18T11:10:32.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.058+0000 7fa2bc664640 1 -- 172.21.15.151:0/717205723 wait complete. 2023-10-18T11:10:32.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.061+0000 7fa2bc664640 1 Processor -- start 2023-10-18T11:10:32.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.061+0000 7fa2bc664640 1 -- start start 2023-10-18T11:10:32.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.063+0000 7fa2bc664640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2b40c4e60 0x7fa2b4147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.063+0000 7fa2bc664640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 0x7fa2b4070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.063+0000 7fa2bc664640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2b4157770 0x7fa2b4071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.063+0000 7fa2bc664640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41e30f0 con 0x7fa2b40c4e60 2023-10-18T11:10:32.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.063+0000 7fa2bc664640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40bcc10 con 0x7fa2b41510a0 2023-10-18T11:10:32.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.063+0000 7fa2bc664640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41ef640 con 0x7fa2b4157770 2023-10-18T11:10:32.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.063+0000 7fa2b9bff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 0x7fa2b4070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.064+0000 7fa2b9bff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 0x7fa2b4070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:39016/0 (socket says 172.21.15.151:39016) 2023-10-18T11:10:32.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.064+0000 7fa2b9bff640 1 -- 172.21.15.151:0/3807345462 learned_addr learned my addr 172.21.15.151:0/3807345462 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:32.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.067+0000 7fa2b9bff640 1 -- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2b4157770 msgr2=0x7fa2b4071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.067+0000 7fa2b9bff640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2b4157770 0x7fa2b4071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.067+0000 7fa2b9bff640 1 -- 172.21.15.151:0/3807345462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2b40c4e60 msgr2=0x7fa2b4147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.067+0000 7fa2b9bff640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2b40c4e60 0x7fa2b4147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.067+0000 7fa2b9bff640 1 -- 172.21.15.151:0/3807345462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00094d0 con 0x7fa2b41510a0 2023-10-18T11:10:32.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.068+0000 7f4cc37fe640 1 -- 172.21.15.151:0/3973462159 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4cd0055060 con 0x7f4cdc0c9650 2023-10-18T11:10:32.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.069+0000 7fa2b9bff640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 0x7fa2b4070d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400b3e0 tx=0x7fa2a400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.073+0000 7fa2aaffd640 1 -- 172.21.15.151:0/3807345462 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4011830 con 0x7fa2b41510a0 2023-10-18T11:10:32.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.073+0000 7fa2aaffd640 1 -- 172.21.15.151:0/3807345462 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a40119b0 con 0x7fa2b41510a0 2023-10-18T11:10:32.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.073+0000 7fa2aaffd640 1 -- 172.21.15.151:0/3807345462 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4011d60 con 0x7fa2b41510a0 2023-10-18T11:10:32.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.073+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b40bc590 con 0x7fa2b41510a0 2023-10-18T11:10:32.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.073+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b40bce60 con 0x7fa2b41510a0 2023-10-18T11:10:32.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.075+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b404e160 con 0x7fa2b41510a0 2023-10-18T11:10:32.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.094+0000 7fa2aaffd640 1 -- 172.21.15.151:0/3807345462 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa2a401a400 con 0x7fa2b41510a0 2023-10-18T11:10:32.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.096+0000 7fa2aaffd640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa29806aec0 0x7fa29806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.096+0000 7fa2ba400640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa29806aec0 0x7fa29806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.097+0000 7fa2ba400640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa29806aec0 0x7fa29806d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0036000 tx=0x7fa2b003b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.171+0000 7f0981a10640 1 Processor -- start 2023-10-18T11:10:32.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.172+0000 7f0981a10640 1 -- start start 2023-10-18T11:10:32.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.173+0000 7f0981a10640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c0c2180 0x7f097c06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.173+0000 7f0981a10640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f097c06de00 0x7f097c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.173+0000 7f0981a10640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c0c25a0 con 0x7f097c1510a0 2023-10-18T11:10:32.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.173+0000 7f0981a10640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c06d430 con 0x7f097c06de00 2023-10-18T11:10:32.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.173+0000 7f0981a10640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c151480 con 0x7f097c0c2180 2023-10-18T11:10:32.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.190+0000 7f4be5fef640 1 --2- 172.21.15.151:0/1709379942 >> v2:172.21.15.151:3300/0 conn(0x7f4be00c9990 0x7f4be00c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.193+0000 7f4be5fef640 1 -- 172.21.15.151:0/1709379942 >> v1:172.21.15.169:6789/0 conn(0x7f4be0153250 legacy=0x7f4be015cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.193+0000 7f4be5fef640 1 -- 172.21.15.151:0/1709379942 >> v1:172.21.15.151:6789/0 conn(0x7f4be00c5da0 legacy=0x7f4be00cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:32.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.193+0000 7f4be5fef640 1 -- 172.21.15.151:0/1709379942 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be006ab50 con 0x7f4be00c9990 2023-10-18T11:10:32.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.199+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f40e40c5cf0 con 0x7f40e41532a0 2023-10-18T11:10:32.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.199+0000 7f4be5fef640 1 --2- 172.21.15.151:0/1709379942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be00c9990 0x7f4be00c9d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8009d90 tx=0x7f4bd802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b444aa353f0a1fa server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.202+0000 7f4bd7fff640 1 -- 172.21.15.151:0/1709379942 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd802cc60 con 0x7f4be00c9990 2023-10-18T11:10:32.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.203+0000 7f4bd7fff640 1 -- 172.21.15.151:0/1709379942 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd802cdc0 con 0x7f4be00c9990 2023-10-18T11:10:32.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.203+0000 7f4bd7fff640 1 -- 172.21.15.151:0/1709379942 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8034660 con 0x7f4be00c9990 2023-10-18T11:10:32.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.204+0000 7f4be67f0640 1 -- 172.21.15.151:0/1709379942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be00c9990 msgr2=0x7f4be00c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.204+0000 7f4be67f0640 1 --2- 172.21.15.151:0/1709379942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be00c9990 0x7f4be00c9d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8009d90 tx=0x7f4bd802beb0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.204+0000 7f4be67f0640 1 -- 172.21.15.151:0/1709379942 shutdown_connections 2023-10-18T11:10:32.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.204+0000 7f4be67f0640 1 --2- 172.21.15.151:0/1709379942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be00c9990 0x7f4be00c9d70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.204+0000 7f4be67f0640 1 -- 172.21.15.151:0/1709379942 >> 172.21.15.151:0/1709379942 conn(0x7f4be0065bb0 msgr2=0x7f4be0065fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.204+0000 7f4be67f0640 1 -- 172.21.15.151:0/1709379942 shutdown_connections 2023-10-18T11:10:32.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.204+0000 7f4be67f0640 1 -- 172.21.15.151:0/1709379942 wait complete. 2023-10-18T11:10:32.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.206+0000 7f4be67f0640 1 Processor -- start 2023-10-18T11:10:32.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.206+0000 7f4be67f0640 1 -- start start 2023-10-18T11:10:32.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.207+0000 7f4be67f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4be00c5da0 0x7f4be014c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.207+0000 7f4be67f0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be00c9990 0x7f4be00c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.207+0000 7f4be67f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be0153250 0x7f4be00c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.207+0000 7f4be67f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be01ee1d0 con 0x7f4be0153250 2023-10-18T11:10:32.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.207+0000 7f4be67f0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be01ee3e0 con 0x7f4be00c9990 2023-10-18T11:10:32.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.207+0000 7f4be67f0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be01ee6c0 con 0x7f4be00c5da0 2023-10-18T11:10:32.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.223+0000 7f4be5fef640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be0153250 0x7f4be00c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.223+0000 7f4be5fef640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be0153250 0x7f4be00c18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44966/0 (socket says 172.21.15.151:44966) 2023-10-18T11:10:32.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.223+0000 7f4be5fef640 1 -- 172.21.15.151:0/633519015 learned_addr learned my addr 172.21.15.151:0/633519015 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:32.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.229+0000 7f4be5fef640 1 -- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4be00c5da0 msgr2=0x7f4be014c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.229+0000 7f4be5fef640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4be00c5da0 0x7f4be014c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.229+0000 7f4be5fef640 1 -- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be00c9990 msgr2=0x7f4be00c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.229+0000 7f4be5fef640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be00c9990 0x7f4be00c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.229+0000 7f4be5fef640 1 -- 172.21.15.151:0/633519015 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd8009a70 con 0x7f4be0153250 2023-10-18T11:10:32.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.232+0000 7f4be5fef640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be0153250 0x7f4be00c18a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8009d90 tx=0x7f4bd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.237+0000 7f4bd5ffb640 1 -- 172.21.15.151:0/633519015 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd803e610 con 0x7f4be0153250 2023-10-18T11:10:32.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.237+0000 7f4bd5ffb640 1 -- 172.21.15.151:0/633519015 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd803e790 con 0x7f4be0153250 2023-10-18T11:10:32.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.237+0000 7f4bd5ffb640 1 -- 172.21.15.151:0/633519015 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd803eb40 con 0x7f4be0153250 2023-10-18T11:10:32.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.237+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be01ee9a0 con 0x7f4be0153250 2023-10-18T11:10:32.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.237+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be01eef60 con 0x7f4be0153250 2023-10-18T11:10:32.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.238+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be01ef0f0 con 0x7f4be0153250 2023-10-18T11:10:32.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.260+0000 7f4bd5ffb640 1 -- 172.21.15.151:0/633519015 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4bd803b050 con 0x7f4be0153250 2023-10-18T11:10:32.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.261+0000 7f4bd5ffb640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bc406aef0 0x7f4bc406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.261+0000 7f4be57ee640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bc406aef0 0x7f4bc406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.262+0000 7f4be57ee640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bc406aef0 0x7f4bc406d3b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc001550 tx=0x7f4bdc007a40 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.263+0000 7f4bd5ffb640 1 -- 172.21.15.151:0/633519015 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4bd807b200 con 0x7f4be0153250 2023-10-18T11:10:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.280+0000 7f2f57fff640 1 -- 172.21.15.151:0/627132926 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f6807bcd0 con 0x7f2f7015af50 2023-10-18T11:10:32.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.292+0000 7f2f57fff640 1 -- 172.21.15.151:0/627132926 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f68077910 con 0x7f2f7015af50 2023-10-18T11:10:32.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.297+0000 7f40e17fa640 1 -- 172.21.15.151:0/226630579 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f40d0047090 con 0x7f40e41532a0 2023-10-18T11:10:32.299 INFO:teuthology.orchestra.run.smithi151.stdout:64424509458 2023-10-18T11:10:32.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.297+0000 7f097a7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c0c2180 0x7f097c06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40c806aec0 msgr2=0x7f40c806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40c806aec0 0x7f40c806d380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f40d8001780 tx=0x7f40d8009040 comp rx=0 tx=0).stop 2023-10-18T11:10:32.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e41532a0 msgr2=0x7f40e41f2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e41532a0 0x7f40e41f2050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40d0000c00 tx=0x7f40d00046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f097a7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c0c2180 0x7f097c06d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57494/0 (socket says 172.21.15.151:57494) 2023-10-18T11:10:32.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f097a7fc640 1 -- 172.21.15.151:0/1718255461 learned_addr learned my addr 172.21.15.151:0/1718255461 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:32.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 shutdown_connections 2023-10-18T11:10:32.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f40c806aec0 0x7f40c806d380 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40e415c5d0 0x7f40e41eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40e41532a0 0x7f40e41f2050 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 --2- 172.21.15.151:0/226630579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40e40715d0 0x7f40e41562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.300+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 >> 172.21.15.151:0/226630579 conn(0x7f40e4069f70 msgr2=0x7f40e415a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.301+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 shutdown_connections 2023-10-18T11:10:32.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.301+0000 7f40eabe7640 1 -- 172.21.15.151:0/226630579 wait complete. 2023-10-18T11:10:32.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.5 2023-10-18T11:10:32.328 DEBUG:teuthology.parallel:result is None 2023-10-18T11:10:32.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.340+0000 7fa2aaffd640 1 -- 172.21.15.151:0/3807345462 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa2a40592c0 con 0x7fa2b41510a0 2023-10-18T11:10:32.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.349+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f370015c060 con 0x7f37000c9650 2023-10-18T11:10:32.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.352+0000 7fa2aaffd640 1 -- 172.21.15.151:0/3807345462 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2a4054f00 con 0x7fa2b41510a0 2023-10-18T11:10:32.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.355+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4cbc0057d0 con 0x7f4cdc0c9650 2023-10-18T11:10:32.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.356+0000 7f097a7fc640 1 -- 172.21.15.151:0/1718255461 >> v2:172.21.15.169:3300/0 conn(0x7f097c06de00 msgr2=0x7f097c0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:32.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.356+0000 7f097a7fc640 1 --2- 172.21.15.151:0/1718255461 >> v2:172.21.15.169:3300/0 conn(0x7f097c06de00 0x7f097c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.356+0000 7f097a7fc640 1 -- 172.21.15.151:0/1718255461 >> v1:172.21.15.169:6789/0 conn(0x7f097c1510a0 legacy=0x7f097c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:32.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.356+0000 7f097a7fc640 1 -- 172.21.15.151:0/1718255461 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0c27d0 con 0x7f097c0c2180 2023-10-18T11:10:32.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.365+0000 7f097a7fc640 1 --2- 172.21.15.151:0/1718255461 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c0c2180 0x7f097c06d8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0970009870 tx=0x7f097002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8804f7f7dc803cc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.371+0000 7f0979ffb640 1 -- 172.21.15.151:0/1718255461 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970030840 con 0x7f097c0c2180 2023-10-18T11:10:32.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.371+0000 7f0979ffb640 1 -- 172.21.15.151:0/1718255461 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09700309a0 con 0x7f097c0c2180 2023-10-18T11:10:32.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.371+0000 7f0979ffb640 1 -- 172.21.15.151:0/1718255461 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970030d30 con 0x7f097c0c2180 2023-10-18T11:10:32.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.372+0000 7f0981a10640 1 -- 172.21.15.151:0/1718255461 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c0c2180 msgr2=0x7f097c06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.372+0000 7f0981a10640 1 --2- 172.21.15.151:0/1718255461 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c0c2180 0x7f097c06d8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0970009870 tx=0x7f097002b980 comp rx=0 tx=0).stop 2023-10-18T11:10:32.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.372+0000 7f0981a10640 1 -- 172.21.15.151:0/1718255461 shutdown_connections 2023-10-18T11:10:32.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.372+0000 7f0981a10640 1 --2- 172.21.15.151:0/1718255461 >> v2:172.21.15.169:3300/0 conn(0x7f097c06de00 0x7f097c0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.372+0000 7f0981a10640 1 --2- 172.21.15.151:0/1718255461 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c0c2180 0x7f097c06d8c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.372+0000 7f0981a10640 1 -- 172.21.15.151:0/1718255461 >> 172.21.15.151:0/1718255461 conn(0x7f097c069f70 msgr2=0x7f097c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.372+0000 7f0981a10640 1 -- 172.21.15.151:0/1718255461 shutdown_connections 2023-10-18T11:10:32.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.372+0000 7f0981a10640 1 -- 172.21.15.151:0/1718255461 wait complete. 2023-10-18T11:10:32.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.374+0000 7f0981a10640 1 Processor -- start 2023-10-18T11:10:32.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.374+0000 7f0981a10640 1 -- start start 2023-10-18T11:10:32.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.375+0000 7f0981a10640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c06de00 0x7f097c0be010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.375+0000 7f0981a10640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f097c0c2180 0x7f097c1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.375+0000 7f0981a10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f097c1510a0 0x7f097c154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.375+0000 7f0981a10640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0be550 con 0x7f097c1510a0 2023-10-18T11:10:32.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.375+0000 7f0981a10640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c1eeb60 con 0x7f097c0c2180 2023-10-18T11:10:32.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.375+0000 7f0981a10640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c1eee40 con 0x7f097c06de00 2023-10-18T11:10:32.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.376+0000 7f097affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c06de00 0x7f097c0be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.377+0000 7f097affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c06de00 0x7f097c0be010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57508/0 (socket says 172.21.15.151:57508) 2023-10-18T11:10:32.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.377+0000 7f097affd640 1 -- 172.21.15.151:0/3530046170 learned_addr learned my addr 172.21.15.151:0/3530046170 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:32.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.380+0000 7f097affd640 1 -- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f097c0c2180 msgr2=0x7f097c1575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.380+0000 7f097affd640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f097c0c2180 0x7f097c1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.380+0000 7f097affd640 1 -- 172.21.15.151:0/3530046170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f097c1510a0 msgr2=0x7f097c154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.380+0000 7f097affd640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f097c1510a0 0x7f097c154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.380+0000 7f097affd640 1 -- 172.21.15.151:0/3530046170 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700094d0 con 0x7f097c06de00 2023-10-18T11:10:32.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.382+0000 7f097affd640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c06de00 0x7f097c0be010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c410 tx=0x7f096c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.385+0000 7f0963fff640 1 -- 172.21.15.151:0/3530046170 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0035f0 con 0x7f097c06de00 2023-10-18T11:10:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.385+0000 7f0963fff640 1 -- 172.21.15.151:0/3530046170 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c003750 con 0x7f097c06de00 2023-10-18T11:10:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.385+0000 7f0963fff640 1 -- 172.21.15.151:0/3530046170 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c003b40 con 0x7f097c06de00 2023-10-18T11:10:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.385+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c1ef120 con 0x7f097c06de00 2023-10-18T11:10:32.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.386+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c1ef6e0 con 0x7f097c06de00 2023-10-18T11:10:32.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.387+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c04e160 con 0x7f097c06de00 2023-10-18T11:10:32.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.407+0000 7f0963fff640 1 -- 172.21.15.151:0/3530046170 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f096c003ca0 con 0x7f097c06de00 2023-10-18T11:10:32.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.408+0000 7f0963fff640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f096806aec0 0x7f096806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:32.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.408+0000 7f097a7fc640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f096806aec0 0x7f096806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:32.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.409+0000 7f097a7fc640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f096806aec0 0x7f096806d380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0970036000 tx=0x7f097003b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:32.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.426+0000 7f36eeffd640 1 -- 172.21.15.151:0/202688213 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36f401e020 con 0x7f37000c9650 2023-10-18T11:10:32.429 INFO:teuthology.orchestra.run.smithi151.stdout:64424509458 2023-10-18T11:10:32.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.428+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f36e006aef0 msgr2=0x7f36e006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.428+0000 7f3704d0f640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f36e006aef0 0x7f36e006d3b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f36f0036000 tx=0x7f36f003b040 comp rx=0 tx=0).stop 2023-10-18T11:10:32.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.428+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000c9650 msgr2=0x7f370014f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.428+0000 7f3704d0f640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000c9650 0x7f370014f120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f36f400b4a0 tx=0x7f36f400b960 comp rx=0 tx=0).stop 2023-10-18T11:10:32.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.429+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 shutdown_connections 2023-10-18T11:10:32.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.429+0000 7f3704d0f640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37000cbe20 0x7f370015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.429+0000 7f3704d0f640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f36e006aef0 0x7f36e006d3b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.429+0000 7f3704d0f640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37000c9650 0x7f370014f120 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.429+0000 7f3704d0f640 1 --2- 172.21.15.151:0/202688213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37000b1340 0x7f370014ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.429+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 >> 172.21.15.151:0/202688213 conn(0x7f37000659d0 msgr2=0x7f37000ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.429+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 shutdown_connections 2023-10-18T11:10:32.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.429+0000 7f3704d0f640 1 -- 172.21.15.151:0/202688213 wait complete. 2023-10-18T11:10:32.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.2 2023-10-18T11:10:32.449 DEBUG:teuthology.parallel:result is None 2023-10-18T11:10:32.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.501+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2f70151860 con 0x7f2f7015af50 2023-10-18T11:10:32.533 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:10:32.539 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:10:32.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.582+0000 7f4bd5ffb640 1 -- 172.21.15.151:0/633519015 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4bd8076e40 con 0x7f4be0153250 2023-10-18T11:10:32.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.594+0000 7f4cc37fe640 1 -- 172.21.15.151:0/3973462159 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4cd0058680 con 0x7f4cdc0c9650 2023-10-18T11:10:32.597 INFO:teuthology.orchestra.run.smithi151.stdout:64424509459 2023-10-18T11:10:32.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4cc806aec0 msgr2=0x7f4cc806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4cc806aec0 0x7f4cc806d380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc036000 tx=0x7f4ccc030000 comp rx=0 tx=0).stop 2023-10-18T11:10:32.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0c9650 msgr2=0x7f4cdc1eea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0c9650 0x7f4cdc1eea10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c430 tx=0x7f4cd000c8f0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 shutdown_connections 2023-10-18T11:10:32.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4cc806aec0 0x7f4cc806d380 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cdc0cbe20 0x7f4cdc15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4cdc0c9650 0x7f4cdc1eea10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 --2- 172.21.15.151:0/3973462159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4cdc0b1340 0x7f4cdc0c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 >> 172.21.15.151:0/3973462159 conn(0x7f4cdc0659d0 msgr2=0x7f4cdc0c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 shutdown_connections 2023-10-18T11:10:32.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.598+0000 7f4ce137c640 1 -- 172.21.15.151:0/3973462159 wait complete. 2023-10-18T11:10:32.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.605+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa2b40c5960 con 0x7fa2b41510a0 2023-10-18T11:10:32.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509459 for osd.4 2023-10-18T11:10:32.626 DEBUG:teuthology.parallel:result is None 2023-10-18T11:10:32.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.646+0000 7f0963fff640 1 -- 172.21.15.151:0/3530046170 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f096c013e70 con 0x7f097c06de00 2023-10-18T11:10:32.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.658+0000 7f0963fff640 1 -- 172.21.15.151:0/3530046170 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f096c054230 con 0x7f097c06de00 2023-10-18T11:10:32.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.668+0000 7fa2aaffd640 1 -- 172.21.15.151:0/3807345462 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2a4015020 con 0x7fa2b41510a0 2023-10-18T11:10:32.671 INFO:teuthology.orchestra.run.smithi151.stdout:64424509460 2023-10-18T11:10:32.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa29806aec0 msgr2=0x7fa29806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa29806aec0 0x7fa29806d380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0036000 tx=0x7fa2b003b040 comp rx=0 tx=0).stop 2023-10-18T11:10:32.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 msgr2=0x7fa2b4070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 0x7fa2b4070d00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400b3e0 tx=0x7fa2a400b8a0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 shutdown_connections 2023-10-18T11:10:32.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2b4157770 0x7fa2b4071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa29806aec0 0x7fa29806d380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2b41510a0 0x7fa2b4070d00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 --2- 172.21.15.151:0/3807345462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2b40c4e60 0x7fa2b4147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 >> 172.21.15.151:0/3807345462 conn(0x7fa2b4069f70 msgr2=0x7fa2b41e5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 shutdown_connections 2023-10-18T11:10:32.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.672+0000 7fa2bc664640 1 -- 172.21.15.151:0/3807345462 wait complete. 2023-10-18T11:10:32.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509460 for osd.7 2023-10-18T11:10:32.692 DEBUG:teuthology.parallel:result is None 2023-10-18T11:10:32.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.694+0000 7f2f57fff640 1 -- 172.21.15.151:0/627132926 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f70151860 con 0x7f2f7015af50 2023-10-18T11:10:32.696 INFO:teuthology.orchestra.run.smithi151.stdout:60129542163 2023-10-18T11:10:32.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2f5c06aef0 msgr2=0x7f2f5c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2f5c06aef0 0x7f2f5c06d3b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009710 tx=0x7f2f60006c90 comp rx=0 tx=0).stop 2023-10-18T11:10:32.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f7015af50 msgr2=0x7f2f70144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f7015af50 0x7f2f70144f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009f40 tx=0x7f2f68004a40 comp rx=0 tx=0).stop 2023-10-18T11:10:32.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 shutdown_connections 2023-10-18T11:10:32.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2f7015af50 0x7f2f70144f40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2f5c06aef0 0x7f2f5c06d3b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f70151090 0x7f2f701466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 --2- 172.21.15.151:0/627132926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f700cd190 0x7f2f70149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 >> 172.21.15.151:0/627132926 conn(0x7f2f7006e210 msgr2=0x7f2f700b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 shutdown_connections 2023-10-18T11:10:32.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.697+0000 7f2f75be9640 1 -- 172.21.15.151:0/627132926 wait complete. 2023-10-18T11:10:32.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542162 got 60129542163 for osd.6 2023-10-18T11:10:32.717 DEBUG:teuthology.parallel:result is None 2023-10-18T11:10:32.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.802+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4be004e160 con 0x7f4be0153250 2023-10-18T11:10:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.843+0000 7f4bd5ffb640 1 -- 172.21.15.151:0/633519015 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4bd8039090 con 0x7f4be0153250 2023-10-18T11:10:32.845 INFO:teuthology.orchestra.run.smithi151.stdout:64424509459 2023-10-18T11:10:32.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bc406aef0 msgr2=0x7f4bc406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bc406aef0 0x7f4bc406d3b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc001550 tx=0x7f4bdc007a40 comp rx=0 tx=0).stop 2023-10-18T11:10:32.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be0153250 msgr2=0x7f4be00c18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be0153250 0x7f4be00c18a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8009d90 tx=0x7f4bd8004a40 comp rx=0 tx=0).stop 2023-10-18T11:10:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 shutdown_connections 2023-10-18T11:10:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4be0153250 0x7f4be00c18a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bc406aef0 0x7f4bc406d3b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4be00c9990 0x7f4be00c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 --2- 172.21.15.151:0/633519015 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4be00c5da0 0x7f4be014c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.846+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 >> 172.21.15.151:0/633519015 conn(0x7f4be0065bb0 msgr2=0x7f4be0151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.847+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 shutdown_connections 2023-10-18T11:10:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.847+0000 7f4be67f0640 1 -- 172.21.15.151:0/633519015 wait complete. 2023-10-18T11:10:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.849+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f097c1eef80 con 0x7f097c06de00 2023-10-18T11:10:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.856+0000 7f0963fff640 1 -- 172.21.15.151:0/3530046170 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f097c1eef80 con 0x7f097c06de00 2023-10-18T11:10:32.859 INFO:teuthology.orchestra.run.smithi151.stdout:64424509458 2023-10-18T11:10:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f096806aec0 msgr2=0x7f096806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f096806aec0 0x7f096806d380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0970036000 tx=0x7f097003b040 comp rx=0 tx=0).stop 2023-10-18T11:10:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c06de00 msgr2=0x7f097c0be010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c06de00 0x7f097c0be010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c410 tx=0x7f096c00c8d0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 shutdown_connections 2023-10-18T11:10:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f097c1510a0 0x7f097c154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f096806aec0 0x7f096806d380 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f097c0c2180 0x7f097c1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 --2- 172.21.15.151:0/3530046170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f097c06de00 0x7f097c0be010 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 >> 172.21.15.151:0/3530046170 conn(0x7f097c069f70 msgr2=0x7f097c14f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 shutdown_connections 2023-10-18T11:10:32.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:32.859+0000 7f0981a10640 1 -- 172.21.15.151:0/3530046170 wait complete. 2023-10-18T11:10:32.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509459 for osd.1 2023-10-18T11:10:32.867 DEBUG:teuthology.parallel:result is None 2023-10-18T11:10:32.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.3 2023-10-18T11:10:32.878 DEBUG:teuthology.parallel:result is None 2023-10-18T11:10:32.878 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-18T11:10:32.879 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:10:33.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.135+0000 7f1a8ffff640 1 Processor -- start 2023-10-18T11:10:33.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.135+0000 7f1a8ffff640 1 -- start start 2023-10-18T11:10:33.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.136+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a900c6160 0x7f1a900c1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:33.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.136+0000 7f1a8ffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a900c6740 0x7f1a900c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:33.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.136+0000 7f1a8ffff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a901575a0 con 0x7f1a90150ff0 2023-10-18T11:10:33.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.137+0000 7f1a8ffff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a901513d0 con 0x7f1a900c6740 2023-10-18T11:10:33.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.137+0000 7f1a8ffff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a900c5960 con 0x7f1a900c6160 2023-10-18T11:10:33.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.137+0000 7f1a8e7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a900c6160 0x7f1a900c1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:33.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.137+0000 7f1a8effd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f1a90150ff0 0x7f1a90069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50102/0 (socket says 172.21.15.151:50102) 2023-10-18T11:10:33.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.137+0000 7f1a8effd640 1 -- 172.21.15.151:0/3691719932 learned_addr learned my addr 172.21.15.151:0/3691719932 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:33.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.140+0000 7f1a8e7fc640 1 -- 172.21.15.151:0/3691719932 >> v2:172.21.15.151:3300/0 conn(0x7f1a900c6740 msgr2=0x7f1a900c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:33.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.140+0000 7f1a8e7fc640 1 --2- 172.21.15.151:0/3691719932 >> v2:172.21.15.151:3300/0 conn(0x7f1a900c6740 0x7f1a900c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.140+0000 7f1a8e7fc640 1 -- 172.21.15.151:0/3691719932 >> v1:172.21.15.169:6789/0 conn(0x7f1a90150ff0 legacy=0x7f1a90069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.140+0000 7f1a8e7fc640 1 -- 172.21.15.151:0/3691719932 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900c5c40 con 0x7f1a900c6160 2023-10-18T11:10:33.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.142+0000 7f1a8e7fc640 1 --2- 172.21.15.151:0/3691719932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a900c6160 0x7f1a900c1150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a840097a0 tx=0x7f1a8402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa5e764d95da96d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.146+0000 7f1a8dffb640 1 -- 172.21.15.151:0/3691719932 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84030800 con 0x7f1a900c6160 2023-10-18T11:10:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.146+0000 7f1a8dffb640 1 -- 172.21.15.151:0/3691719932 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a84030960 con 0x7f1a900c6160 2023-10-18T11:10:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.146+0000 7f1a8dffb640 1 -- 172.21.15.151:0/3691719932 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84030cf0 con 0x7f1a900c6160 2023-10-18T11:10:33.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.147+0000 7f1a8ffff640 1 -- 172.21.15.151:0/3691719932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a900c6160 msgr2=0x7f1a900c1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.147+0000 7f1a8ffff640 1 --2- 172.21.15.151:0/3691719932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a900c6160 0x7f1a900c1150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a840097a0 tx=0x7f1a8402b940 comp rx=0 tx=0).stop 2023-10-18T11:10:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.147+0000 7f1a8ffff640 1 -- 172.21.15.151:0/3691719932 shutdown_connections 2023-10-18T11:10:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.147+0000 7f1a8ffff640 1 --2- 172.21.15.151:0/3691719932 >> v2:172.21.15.151:3300/0 conn(0x7f1a900c6740 0x7f1a900c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.147+0000 7f1a8ffff640 1 --2- 172.21.15.151:0/3691719932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a900c6160 0x7f1a900c1150 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.147+0000 7f1a8ffff640 1 -- 172.21.15.151:0/3691719932 >> 172.21.15.151:0/3691719932 conn(0x7f1a9006e5e0 msgr2=0x7f1a900cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:33.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.147+0000 7f1a8ffff640 1 -- 172.21.15.151:0/3691719932 shutdown_connections 2023-10-18T11:10:33.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.147+0000 7f1a8ffff640 1 -- 172.21.15.151:0/3691719932 wait complete. 2023-10-18T11:10:33.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.149+0000 7f1a8ffff640 1 Processor -- start 2023-10-18T11:10:33.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.149+0000 7f1a8ffff640 1 -- start start 2023-10-18T11:10:33.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.150+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a900c6160 0x7f1a9014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:33.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.150+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a900c6740 0x7f1a90151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:33.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.150+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a90150ff0 0x7f1a90152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:33.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.150+0000 7f1a8ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a901534a0 con 0x7f1a900c6160 2023-10-18T11:10:33.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.150+0000 7f1a8ffff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a901f2d90 con 0x7f1a900c6740 2023-10-18T11:10:33.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.150+0000 7f1a8ffff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90072380 con 0x7f1a90150ff0 2023-10-18T11:10:33.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.151+0000 7f1a8e7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a900c6740 0x7f1a90151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:33.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.151+0000 7f1a8f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a90150ff0 0x7f1a90152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:33.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.151+0000 7f1a8f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a90150ff0 0x7f1a90152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57518/0 (socket says 172.21.15.151:57518) 2023-10-18T11:10:33.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.151+0000 7f1a8f7fe640 1 -- 172.21.15.151:0/775300906 learned_addr learned my addr 172.21.15.151:0/775300906 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:33.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.151+0000 7f1a8e7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a900c6740 0x7f1a90151cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:39062/0 (socket says 172.21.15.151:39062) 2023-10-18T11:10:33.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.155+0000 7f1a8e7fc640 1 -- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a90150ff0 msgr2=0x7f1a90152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:33.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.155+0000 7f1a8e7fc640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a90150ff0 0x7f1a90152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.155+0000 7f1a8e7fc640 1 -- 172.21.15.151:0/775300906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a900c6160 msgr2=0x7f1a9014a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:33.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.155+0000 7f1a8e7fc640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a900c6160 0x7f1a9014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.155+0000 7f1a8e7fc640 1 -- 172.21.15.151:0/775300906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84009400 con 0x7f1a900c6740 2023-10-18T11:10:33.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.158+0000 7f1a8e7fc640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a900c6740 0x7f1a90151cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a84033000 tx=0x7f1a840046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:33.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.162+0000 7f1a777fe640 1 -- 172.21.15.151:0/775300906 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8403e070 con 0x7f1a900c6740 2023-10-18T11:10:33.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.163+0000 7f1a777fe640 1 -- 172.21.15.151:0/775300906 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a84039ba0 con 0x7f1a900c6740 2023-10-18T11:10:33.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.163+0000 7f1a777fe640 1 -- 172.21.15.151:0/775300906 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a840423f0 con 0x7f1a900c6740 2023-10-18T11:10:33.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.163+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a900720e0 con 0x7f1a900c6740 2023-10-18T11:10:33.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.163+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a901f2ab0 con 0x7f1a900c6740 2023-10-18T11:10:33.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.164+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a900c6b70 con 0x7f1a900c6740 2023-10-18T11:10:33.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.190+0000 7f1a777fe640 1 -- 172.21.15.151:0/775300906 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a84042550 con 0x7f1a900c6740 2023-10-18T11:10:33.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.192+0000 7f1a777fe640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a7c06aef0 0x7f1a7c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:33.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.192+0000 7f1a8effd640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a7c06aef0 0x7f1a7c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:33.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.193+0000 7f1a8effd640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a7c06aef0 0x7f1a7c06d3b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a800015f0 tx=0x7f1a80007a40 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:33.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.463+0000 7f1a777fe640 1 -- 172.21.15.151:0/775300906 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1a8407bae0 con 0x7f1a900c6740 2023-10-18T11:10:33.478 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.476+0000 7f1a777fe640 1 -- 172.21.15.151:0/775300906 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a84077720 con 0x7f1a900c6740 2023-10-18T11:10:33.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.676+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a90157230 con 0x7f1a7c06aef0 2023-10-18T11:10:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.696+0000 7f1a777fe640 1 -- 172.21.15.151:0/775300906 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368268 (secure 0 0 0) 0x7f1a800058b0 con 0x7f1a7c06aef0 2023-10-18T11:10:33.705 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:33.707 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:10:33.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a7c06aef0 msgr2=0x7f1a7c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:33.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a7c06aef0 0x7f1a7c06d3b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a800015f0 tx=0x7f1a80007a40 comp rx=0 tx=0).stop 2023-10-18T11:10:33.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a900c6740 msgr2=0x7f1a90151cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:33.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a900c6740 0x7f1a90151cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a84033000 tx=0x7f1a840046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 shutdown_connections 2023-10-18T11:10:33.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a90150ff0 0x7f1a90152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a7c06aef0 0x7f1a7c06d3b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a900c6740 0x7f1a90151cf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 --2- 172.21.15.151:0/775300906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a900c6160 0x7f1a9014a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 >> 172.21.15.151:0/775300906 conn(0x7f1a9006e5e0 msgr2=0x7f1a900c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:33.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 shutdown_connections 2023-10-18T11:10:33.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.705+0000 7f1a8ffff640 1 -- 172.21.15.151:0/775300906 wait complete. 2023-10-18T11:10:33.729 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-18T11:10:32.202116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599113,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":315,"num_write_kb":2469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":255,"ondisk_log_size":255,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2973696,"data_stored":2275788,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4106,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002638"},"pg_stats":[{"pgid":"2.1f","version":"31'11","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.430057+0000","last_change":"2023-10-18T11:09:36.796784+0000","last_active":"2023-10-18T11:10:30.430057+0000","last_peered":"2023-10-18T11:10:30.430057+0000","last_clean":"2023-10-18T11:10:30.430057+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:10:30.430057+0000","last_undegraded":"2023-10-18T11:10:30.430057+0000","last_fullsized":"2023-10-18T11:10:30.430057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.181907+0000","last_change":"2023-10-18T11:09:39.421701+0000","last_active":"2023-10-18T11:10:09.181907+0000","last_peered":"2023-10-18T11:10:09.181907+0000","last_clean":"2023-10-18T11:10:09.181907+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:10:09.181907+0000","last_undegraded":"2023-10-18T11:10:09.181907+0000","last_fullsized":"2023-10-18T11:10:09.181907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179158+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:10:09.179158+0000","last_peered":"2023-10-18T11:10:09.179158+0000","last_clean":"2023-10-18T11:10:09.179158+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:10:09.179158+0000","last_undegraded":"2023-10-18T11:10:09.179158+0000","last_fullsized":"2023-10-18T11:10:09.179158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.409911+0000","last_change":"2023-10-18T11:09:36.909894+0000","last_active":"2023-10-18T11:10:10.409911+0000","last_peered":"2023-10-18T11:10:10.409911+0000","last_clean":"2023-10-18T11:10:10.409911+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:10:10.409911+0000","last_undegraded":"2023-10-18T11:10:10.409911+0000","last_fullsized":"2023-10-18T11:10:10.409911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176067+0000","last_change":"2023-10-18T11:09:39.363102+0000","last_active":"2023-10-18T11:10:09.176067+0000","last_peered":"2023-10-18T11:10:09.176067+0000","last_clean":"2023-10-18T11:10:09.176067+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:10:09.176067+0000","last_undegraded":"2023-10-18T11:10:09.176067+0000","last_fullsized":"2023-10-18T11:10:09.176067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168922+0000","last_change":"2023-10-18T11:09:46.109981+0000","last_active":"2023-10-18T11:10:09.168922+0000","last_peered":"2023-10-18T11:10:09.168922+0000","last_clean":"2023-10-18T11:10:09.168922+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:10:09.168922+0000","last_undegraded":"2023-10-18T11:10:09.168922+0000","last_fullsized":"2023-10-18T11:10:09.168922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:26.971949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'7","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.519180+0000","last_change":"2023-10-18T11:09:36.896708+0000","last_active":"2023-10-18T11:10:30.519180+0000","last_peered":"2023-10-18T11:10:30.519180+0000","last_clean":"2023-10-18T11:10:30.519180+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:10:30.519180+0000","last_undegraded":"2023-10-18T11:10:30.519180+0000","last_fullsized":"2023-10-18T11:10:30.519180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171648+0000","last_change":"2023-10-18T11:09:39.397225+0000","last_active":"2023-10-18T11:10:09.171648+0000","last_peered":"2023-10-18T11:10:09.171648+0000","last_clean":"2023-10-18T11:10:09.171648+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:10:09.171648+0000","last_undegraded":"2023-10-18T11:10:09.171648+0000","last_fullsized":"2023-10-18T11:10:09.171648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169423+0000","last_change":"2023-10-18T11:09:46.114798+0000","last_active":"2023-10-18T11:10:09.169423+0000","last_peered":"2023-10-18T11:10:09.169423+0000","last_clean":"2023-10-18T11:10:09.169423+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:10:09.169423+0000","last_undegraded":"2023-10-18T11:10:09.169423+0000","last_fullsized":"2023-10-18T11:10:09.169423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:57.280120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166779+0000","last_change":"2023-10-18T11:09:36.795004+0000","last_active":"2023-10-18T11:10:09.166779+0000","last_peered":"2023-10-18T11:10:09.166779+0000","last_clean":"2023-10-18T11:10:09.166779+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:10:09.166779+0000","last_undegraded":"2023-10-18T11:10:09.166779+0000","last_fullsized":"2023-10-18T11:10:09.166779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171988+0000","last_change":"2023-10-18T11:09:39.398621+0000","last_active":"2023-10-18T11:10:09.171988+0000","last_peered":"2023-10-18T11:10:09.171988+0000","last_clean":"2023-10-18T11:10:09.171988+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:10:09.171988+0000","last_undegraded":"2023-10-18T11:10:09.171988+0000","last_fullsized":"2023-10-18T11:10:09.171988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169095+0000","last_change":"2023-10-18T11:09:46.115280+0000","last_active":"2023-10-18T11:10:09.169095+0000","last_peered":"2023-10-18T11:10:09.169095+0000","last_clean":"2023-10-18T11:10:09.169095+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:10:09.169095+0000","last_undegraded":"2023-10-18T11:10:09.169095+0000","last_fullsized":"2023-10-18T11:10:09.169095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:26.647416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165312+0000","last_change":"2023-10-18T11:09:39.397253+0000","last_active":"2023-10-18T11:10:09.165312+0000","last_peered":"2023-10-18T11:10:09.165312+0000","last_clean":"2023-10-18T11:10:09.165312+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:10:09.165312+0000","last_undegraded":"2023-10-18T11:10:09.165312+0000","last_fullsized":"2023-10-18T11:10:09.165312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.424298+0000","last_change":"2023-10-18T11:09:36.893066+0000","last_active":"2023-10-18T11:10:21.424298+0000","last_peered":"2023-10-18T11:10:21.424298+0000","last_clean":"2023-10-18T11:10:21.424298+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:10:21.424298+0000","last_undegraded":"2023-10-18T11:10:21.424298+0000","last_fullsized":"2023-10-18T11:10:21.424298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:32.587464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169855+0000","last_change":"2023-10-18T11:09:46.096113+0000","last_active":"2023-10-18T11:10:09.169855+0000","last_peered":"2023-10-18T11:10:09.169855+0000","last_clean":"2023-10-18T11:10:09.169855+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:10:09.169855+0000","last_undegraded":"2023-10-18T11:10:09.169855+0000","last_fullsized":"2023-10-18T11:10:09.169855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:09.971210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.180886+0000","last_change":"2023-10-18T11:09:39.423651+0000","last_active":"2023-10-18T11:10:09.180886+0000","last_peered":"2023-10-18T11:10:09.180886+0000","last_clean":"2023-10-18T11:10:09.180886+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:10:09.180886+0000","last_undegraded":"2023-10-18T11:10:09.180886+0000","last_fullsized":"2023-10-18T11:10:09.180886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.409084+0000","last_change":"2023-10-18T11:09:36.913611+0000","last_active":"2023-10-18T11:10:10.409084+0000","last_peered":"2023-10-18T11:10:10.409084+0000","last_clean":"2023-10-18T11:10:10.409084+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:10:10.409084+0000","last_undegraded":"2023-10-18T11:10:10.409084+0000","last_fullsized":"2023-10-18T11:10:10.409084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169776+0000","last_change":"2023-10-18T11:09:46.114729+0000","last_active":"2023-10-18T11:10:09.169776+0000","last_peered":"2023-10-18T11:10:09.169776+0000","last_clean":"2023-10-18T11:10:09.169776+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:10:09.169776+0000","last_undegraded":"2023-10-18T11:10:09.169776+0000","last_fullsized":"2023-10-18T11:10:09.169776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:50.156790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178636+0000","last_change":"2023-10-18T11:09:39.420146+0000","last_active":"2023-10-18T11:10:09.178636+0000","last_peered":"2023-10-18T11:10:09.178636+0000","last_clean":"2023-10-18T11:10:09.178636+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:10:09.178636+0000","last_undegraded":"2023-10-18T11:10:09.178636+0000","last_fullsized":"2023-10-18T11:10:09.178636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.435008+0000","last_change":"2023-10-18T11:09:36.915198+0000","last_active":"2023-10-18T11:10:30.435008+0000","last_peered":"2023-10-18T11:10:30.435008+0000","last_clean":"2023-10-18T11:10:30.435008+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:10:30.435008+0000","last_undegraded":"2023-10-18T11:10:30.435008+0000","last_fullsized":"2023-10-18T11:10:30.435008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:18.429550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.416467+0000","last_change":"2023-10-18T11:10:10.413988+0000","last_active":"2023-10-18T11:10:10.416467+0000","last_peered":"2023-10-18T11:10:10.416467+0000","last_clean":"2023-10-18T11:10:10.416467+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:10:10.416467+0000","last_undegraded":"2023-10-18T11:10:10.416467+0000","last_fullsized":"2023-10-18T11:10:10.416467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169153+0000","last_change":"2023-10-18T11:09:39.399181+0000","last_active":"2023-10-18T11:10:09.169153+0000","last_peered":"2023-10-18T11:10:09.169153+0000","last_clean":"2023-10-18T11:10:09.169153+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:10:09.169153+0000","last_undegraded":"2023-10-18T11:10:09.169153+0000","last_fullsized":"2023-10-18T11:10:09.169153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:13.349921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.425764+0000","last_change":"2023-10-18T11:09:36.797637+0000","last_active":"2023-10-18T11:10:21.425764+0000","last_peered":"2023-10-18T11:10:21.425764+0000","last_clean":"2023-10-18T11:10:21.425764+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:10:21.425764+0000","last_undegraded":"2023-10-18T11:10:21.425764+0000","last_fullsized":"2023-10-18T11:10:21.425764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:08.109221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169728+0000","last_change":"2023-10-18T11:09:46.109408+0000","last_active":"2023-10-18T11:10:09.169728+0000","last_peered":"2023-10-18T11:10:09.169728+0000","last_clean":"2023-10-18T11:10:09.169728+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:10:09.169728+0000","last_undegraded":"2023-10-18T11:10:09.169728+0000","last_fullsized":"2023-10-18T11:10:09.169728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.174070+0000","last_change":"2023-10-18T11:09:39.366234+0000","last_active":"2023-10-18T11:10:09.174070+0000","last_peered":"2023-10-18T11:10:09.174070+0000","last_clean":"2023-10-18T11:10:09.174070+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:10:09.174070+0000","last_undegraded":"2023-10-18T11:10:09.174070+0000","last_fullsized":"2023-10-18T11:10:09.174070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.654804+0000","last_change":"2023-10-18T11:09:36.896533+0000","last_active":"2023-10-18T11:10:21.654804+0000","last_peered":"2023-10-18T11:10:21.654804+0000","last_clean":"2023-10-18T11:10:21.654804+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:10:21.654804+0000","last_undegraded":"2023-10-18T11:10:21.654804+0000","last_fullsized":"2023-10-18T11:10:21.654804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168970+0000","last_change":"2023-10-18T11:09:46.094196+0000","last_active":"2023-10-18T11:10:09.168970+0000","last_peered":"2023-10-18T11:10:09.168970+0000","last_clean":"2023-10-18T11:10:09.168970+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:10:09.168970+0000","last_undegraded":"2023-10-18T11:10:09.168970+0000","last_fullsized":"2023-10-18T11:10:09.168970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:43.456989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182246+0000","last_change":"2023-10-18T11:09:39.420016+0000","last_active":"2023-10-18T11:10:09.182246+0000","last_peered":"2023-10-18T11:10:09.182246+0000","last_clean":"2023-10-18T11:10:09.182246+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:10:09.182246+0000","last_undegraded":"2023-10-18T11:10:09.182246+0000","last_fullsized":"2023-10-18T11:10:09.182246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'7","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.437990+0000","last_change":"2023-10-18T11:09:36.913659+0000","last_active":"2023-10-18T11:10:30.437990+0000","last_peered":"2023-10-18T11:10:30.437990+0000","last_clean":"2023-10-18T11:10:30.437990+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:10:30.437990+0000","last_undegraded":"2023-10-18T11:10:30.437990+0000","last_fullsized":"2023-10-18T11:10:30.437990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179764+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:10:09.179764+0000","last_peered":"2023-10-18T11:10:09.179764+0000","last_clean":"2023-10-18T11:10:09.179764+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:10:09.179764+0000","last_undegraded":"2023-10-18T11:10:09.179764+0000","last_fullsized":"2023-10-18T11:10:09.179764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162384+0000","last_change":"2023-10-18T11:09:39.243607+0000","last_active":"2023-10-18T11:10:09.162384+0000","last_peered":"2023-10-18T11:10:09.162384+0000","last_clean":"2023-10-18T11:10:09.162384+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:10:09.162384+0000","last_undegraded":"2023-10-18T11:10:09.162384+0000","last_fullsized":"2023-10-18T11:10:09.162384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.518400+0000","last_change":"2023-10-18T11:09:36.798396+0000","last_active":"2023-10-18T11:10:30.518400+0000","last_peered":"2023-10-18T11:10:30.518400+0000","last_clean":"2023-10-18T11:10:30.518400+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:10:30.518400+0000","last_undegraded":"2023-10-18T11:10:30.518400+0000","last_fullsized":"2023-10-18T11:10:30.518400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:04.311252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177625+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:10:09.177625+0000","last_peered":"2023-10-18T11:10:09.177625+0000","last_clean":"2023-10-18T11:10:09.177625+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:10:09.177625+0000","last_undegraded":"2023-10-18T11:10:09.177625+0000","last_fullsized":"2023-10-18T11:10:09.177625+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.172014+0000","last_change":"2023-10-18T11:09:39.417304+0000","last_active":"2023-10-18T11:10:09.172014+0000","last_peered":"2023-10-18T11:10:09.172014+0000","last_clean":"2023-10-18T11:10:09.172014+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:10:09.172014+0000","last_undegraded":"2023-10-18T11:10:09.172014+0000","last_fullsized":"2023-10-18T11:10:09.172014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.411166+0000","last_change":"2023-10-18T11:09:36.909623+0000","last_active":"2023-10-18T11:10:10.411166+0000","last_peered":"2023-10-18T11:10:10.411166+0000","last_clean":"2023-10-18T11:10:10.411166+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:10:10.411166+0000","last_undegraded":"2023-10-18T11:10:10.411166+0000","last_fullsized":"2023-10-18T11:10:10.411166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161364+0000","last_change":"2023-10-18T11:09:46.100735+0000","last_active":"2023-10-18T11:10:09.161364+0000","last_peered":"2023-10-18T11:10:09.161364+0000","last_clean":"2023-10-18T11:10:09.161364+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:10:09.161364+0000","last_undegraded":"2023-10-18T11:10:09.161364+0000","last_fullsized":"2023-10-18T11:10:09.161364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169573+0000","last_change":"2023-10-18T11:09:39.400602+0000","last_active":"2023-10-18T11:10:09.169573+0000","last_peered":"2023-10-18T11:10:09.169573+0000","last_clean":"2023-10-18T11:10:09.169573+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:10:09.169573+0000","last_undegraded":"2023-10-18T11:10:09.169573+0000","last_fullsized":"2023-10-18T11:10:09.169573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:37.020893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.396221+0000","last_change":"2023-10-18T11:09:36.915028+0000","last_active":"2023-10-18T11:10:10.396221+0000","last_peered":"2023-10-18T11:10:10.396221+0000","last_clean":"2023-10-18T11:10:10.396221+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:10:10.396221+0000","last_undegraded":"2023-10-18T11:10:10.396221+0000","last_fullsized":"2023-10-18T11:10:10.396221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162244+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:10:09.162244+0000","last_peered":"2023-10-18T11:10:09.162244+0000","last_clean":"2023-10-18T11:10:09.162244+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:10:09.162244+0000","last_undegraded":"2023-10-18T11:10:09.162244+0000","last_fullsized":"2023-10-18T11:10:09.162244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161140+0000","last_change":"2023-10-18T11:09:39.243829+0000","last_active":"2023-10-18T11:10:09.161140+0000","last_peered":"2023-10-18T11:10:09.161140+0000","last_clean":"2023-10-18T11:10:09.161140+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:10:09.161140+0000","last_undegraded":"2023-10-18T11:10:09.161140+0000","last_fullsized":"2023-10-18T11:10:09.161140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.442856+0000","last_change":"2023-10-18T11:09:36.910270+0000","last_active":"2023-10-18T11:10:28.442856+0000","last_peered":"2023-10-18T11:10:28.442856+0000","last_clean":"2023-10-18T11:10:28.442856+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:10:28.442856+0000","last_undegraded":"2023-10-18T11:10:28.442856+0000","last_fullsized":"2023-10-18T11:10:28.442856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163801+0000","last_change":"2023-10-18T11:09:46.114610+0000","last_active":"2023-10-18T11:10:09.163801+0000","last_peered":"2023-10-18T11:10:09.163801+0000","last_clean":"2023-10-18T11:10:09.163801+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:10:09.163801+0000","last_undegraded":"2023-10-18T11:10:09.163801+0000","last_fullsized":"2023-10-18T11:10:09.163801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177327+0000","last_change":"2023-10-18T11:09:39.404210+0000","last_active":"2023-10-18T11:10:09.177327+0000","last_peered":"2023-10-18T11:10:09.177327+0000","last_clean":"2023-10-18T11:10:09.177327+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:10:09.177327+0000","last_undegraded":"2023-10-18T11:10:09.177327+0000","last_fullsized":"2023-10-18T11:10:09.177327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.315925+0000","last_change":"2023-10-18T11:09:36.913804+0000","last_active":"2023-10-18T11:10:28.315925+0000","last_peered":"2023-10-18T11:10:28.315925+0000","last_clean":"2023-10-18T11:10:28.315925+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:10:28.315925+0000","last_undegraded":"2023-10-18T11:10:28.315925+0000","last_fullsized":"2023-10-18T11:10:28.315925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173920+0000","last_change":"2023-10-18T11:09:46.092566+0000","last_active":"2023-10-18T11:10:09.173920+0000","last_peered":"2023-10-18T11:10:09.173920+0000","last_clean":"2023-10-18T11:10:09.173920+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:10:09.173920+0000","last_undegraded":"2023-10-18T11:10:09.173920+0000","last_fullsized":"2023-10-18T11:10:09.173920+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:42.848835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178796+0000","last_change":"2023-10-18T11:09:39.422507+0000","last_active":"2023-10-18T11:10:09.178796+0000","last_peered":"2023-10-18T11:10:09.178796+0000","last_clean":"2023-10-18T11:10:09.178796+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:10:09.178796+0000","last_undegraded":"2023-10-18T11:10:09.178796+0000","last_fullsized":"2023-10-18T11:10:09.178796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.432102+0000","last_change":"2023-10-18T11:09:36.828474+0000","last_active":"2023-10-18T11:10:30.432102+0000","last_peered":"2023-10-18T11:10:30.432102+0000","last_clean":"2023-10-18T11:10:30.432102+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:10:30.432102+0000","last_undegraded":"2023-10-18T11:10:30.432102+0000","last_fullsized":"2023-10-18T11:10:30.432102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166583+0000","last_change":"2023-10-18T11:09:19.365660+0000","last_active":"2023-10-18T11:10:09.166583+0000","last_peered":"2023-10-18T11:10:09.166583+0000","last_clean":"2023-10-18T11:10:09.166583+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:10:09.166583+0000","last_undegraded":"2023-10-18T11:10:09.166583+0000","last_fullsized":"2023-10-18T11:10:09.166583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_clean_scrub_stamp":"2023-10-18T11:09:17.711667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:34:53.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164849+0000","last_change":"2023-10-18T11:09:46.118571+0000","last_active":"2023-10-18T11:10:09.164849+0000","last_peered":"2023-10-18T11:10:09.164849+0000","last_clean":"2023-10-18T11:10:09.164849+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:10:09.164849+0000","last_undegraded":"2023-10-18T11:10:09.164849+0000","last_fullsized":"2023-10-18T11:10:09.164849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:46.781070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166799+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:10:09.166799+0000","last_peered":"2023-10-18T11:10:09.166799+0000","last_clean":"2023-10-18T11:10:09.166799+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:10:09.166799+0000","last_undegraded":"2023-10-18T11:10:09.166799+0000","last_fullsized":"2023-10-18T11:10:09.166799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.435307+0000","last_change":"2023-10-18T11:09:36.829100+0000","last_active":"2023-10-18T11:10:30.435307+0000","last_peered":"2023-10-18T11:10:30.435307+0000","last_clean":"2023-10-18T11:10:30.435307+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:10:30.435307+0000","last_undegraded":"2023-10-18T11:10:30.435307+0000","last_fullsized":"2023-10-18T11:10:30.435307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.418740+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:10:10.418740+0000","last_peered":"2023-10-18T11:10:10.418740+0000","last_clean":"2023-10-18T11:10:10.418740+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:10:10.418740+0000","last_undegraded":"2023-10-18T11:10:10.418740+0000","last_fullsized":"2023-10-18T11:10:10.418740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171728+0000","last_change":"2023-10-18T11:09:39.419862+0000","last_active":"2023-10-18T11:10:09.171728+0000","last_peered":"2023-10-18T11:10:09.171728+0000","last_clean":"2023-10-18T11:10:09.171728+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:10:09.171728+0000","last_undegraded":"2023-10-18T11:10:09.171728+0000","last_fullsized":"2023-10-18T11:10:09.171728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.411373+0000","last_change":"2023-10-18T11:09:36.912905+0000","last_active":"2023-10-18T11:10:10.411373+0000","last_peered":"2023-10-18T11:10:10.411373+0000","last_clean":"2023-10-18T11:10:10.411373+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:10:10.411373+0000","last_undegraded":"2023-10-18T11:10:10.411373+0000","last_fullsized":"2023-10-18T11:10:10.411373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177785+0000","last_change":"2023-10-18T11:09:46.097744+0000","last_active":"2023-10-18T11:10:09.177785+0000","last_peered":"2023-10-18T11:10:09.177785+0000","last_clean":"2023-10-18T11:10:09.177785+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:10:09.177785+0000","last_undegraded":"2023-10-18T11:10:09.177785+0000","last_fullsized":"2023-10-18T11:10:09.177785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:20.073279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167753+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:10:09.167753+0000","last_peered":"2023-10-18T11:10:09.167753+0000","last_clean":"2023-10-18T11:10:09.167753+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:10:09.167753+0000","last_undegraded":"2023-10-18T11:10:09.167753+0000","last_fullsized":"2023-10-18T11:10:09.167753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:51.220855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.384262+0000","last_change":"2023-10-18T11:09:36.907280+0000","last_active":"2023-10-18T11:10:10.384262+0000","last_peered":"2023-10-18T11:10:10.384262+0000","last_clean":"2023-10-18T11:10:10.384262+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:10:10.384262+0000","last_undegraded":"2023-10-18T11:10:10.384262+0000","last_fullsized":"2023-10-18T11:10:10.384262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171054+0000","last_change":"2023-10-18T11:09:46.096894+0000","last_active":"2023-10-18T11:10:09.171054+0000","last_peered":"2023-10-18T11:10:09.171054+0000","last_clean":"2023-10-18T11:10:09.171054+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:10:09.171054+0000","last_undegraded":"2023-10-18T11:10:09.171054+0000","last_fullsized":"2023-10-18T11:10:09.171054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167081+0000","last_change":"2023-10-18T11:09:39.399750+0000","last_active":"2023-10-18T11:10:09.167081+0000","last_peered":"2023-10-18T11:10:09.167081+0000","last_clean":"2023-10-18T11:10:09.167081+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:10:09.167081+0000","last_undegraded":"2023-10-18T11:10:09.167081+0000","last_fullsized":"2023-10-18T11:10:09.167081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:35.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.395042+0000","last_change":"2023-10-18T11:09:36.897906+0000","last_active":"2023-10-18T11:10:10.395042+0000","last_peered":"2023-10-18T11:10:10.395042+0000","last_clean":"2023-10-18T11:10:10.395042+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:10:10.395042+0000","last_undegraded":"2023-10-18T11:10:10.395042+0000","last_fullsized":"2023-10-18T11:10:10.395042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:41:27.304152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168875+0000","last_change":"2023-10-18T11:09:46.109151+0000","last_active":"2023-10-18T11:10:09.168875+0000","last_peered":"2023-10-18T11:10:09.168875+0000","last_clean":"2023-10-18T11:10:09.168875+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:10:09.168875+0000","last_undegraded":"2023-10-18T11:10:09.168875+0000","last_fullsized":"2023-10-18T11:10:09.168875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:41.785820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166808+0000","last_change":"2023-10-18T11:09:39.397483+0000","last_active":"2023-10-18T11:10:09.166808+0000","last_peered":"2023-10-18T11:10:09.166808+0000","last_clean":"2023-10-18T11:10:09.166808+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:10:09.166808+0000","last_undegraded":"2023-10-18T11:10:09.166808+0000","last_fullsized":"2023-10-18T11:10:09.166808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'16","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.445318+0000","last_change":"2023-10-18T11:09:36.916080+0000","last_active":"2023-10-18T11:10:28.445318+0000","last_peered":"2023-10-18T11:10:28.445318+0000","last_clean":"2023-10-18T11:10:28.445318+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:10:28.445318+0000","last_undegraded":"2023-10-18T11:10:28.445318+0000","last_fullsized":"2023-10-18T11:10:28.445318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:22.058134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173831+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:10:09.173831+0000","last_peered":"2023-10-18T11:10:09.173831+0000","last_clean":"2023-10-18T11:10:09.173831+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:10:09.173831+0000","last_undegraded":"2023-10-18T11:10:09.173831+0000","last_fullsized":"2023-10-18T11:10:09.173831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164509+0000","last_change":"2023-10-18T11:09:39.358262+0000","last_active":"2023-10-18T11:10:09.164509+0000","last_peered":"2023-10-18T11:10:09.164509+0000","last_clean":"2023-10-18T11:10:09.164509+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:10:09.164509+0000","last_undegraded":"2023-10-18T11:10:09.164509+0000","last_fullsized":"2023-10-18T11:10:09.164509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.455697+0000","last_change":"2023-10-18T11:09:36.893045+0000","last_active":"2023-10-18T11:10:28.455697+0000","last_peered":"2023-10-18T11:10:28.455697+0000","last_clean":"2023-10-18T11:10:28.455697+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:10:28.455697+0000","last_undegraded":"2023-10-18T11:10:28.455697+0000","last_fullsized":"2023-10-18T11:10:28.455697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182137+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:10:09.182137+0000","last_peered":"2023-10-18T11:10:09.182137+0000","last_clean":"2023-10-18T11:10:09.182137+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:10:09.182137+0000","last_undegraded":"2023-10-18T11:10:09.182137+0000","last_fullsized":"2023-10-18T11:10:09.182137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:27.567970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167151+0000","last_change":"2023-10-18T11:09:39.399188+0000","last_active":"2023-10-18T11:10:09.167151+0000","last_peered":"2023-10-18T11:10:09.167151+0000","last_clean":"2023-10-18T11:10:09.167151+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:10:09.167151+0000","last_undegraded":"2023-10-18T11:10:09.167151+0000","last_fullsized":"2023-10-18T11:10:09.167151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.444753+0000","last_change":"2023-10-18T11:09:36.905576+0000","last_active":"2023-10-18T11:10:21.444753+0000","last_peered":"2023-10-18T11:10:21.444753+0000","last_clean":"2023-10-18T11:10:21.444753+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:10:21.444753+0000","last_undegraded":"2023-10-18T11:10:21.444753+0000","last_fullsized":"2023-10-18T11:10:21.444753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179319+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:10:09.179319+0000","last_peered":"2023-10-18T11:10:09.179319+0000","last_clean":"2023-10-18T11:10:09.179319+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:10:09.179319+0000","last_undegraded":"2023-10-18T11:10:09.179319+0000","last_fullsized":"2023-10-18T11:10:09.179319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:47.871773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.174065+0000","last_change":"2023-10-18T11:09:39.361805+0000","last_active":"2023-10-18T11:10:09.174065+0000","last_peered":"2023-10-18T11:10:09.174065+0000","last_clean":"2023-10-18T11:10:09.174065+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:10:09.174065+0000","last_undegraded":"2023-10-18T11:10:09.174065+0000","last_fullsized":"2023-10-18T11:10:09.174065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'7","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.453993+0000","last_change":"2023-10-18T11:09:36.894141+0000","last_active":"2023-10-18T11:10:28.453993+0000","last_peered":"2023-10-18T11:10:28.453993+0000","last_clean":"2023-10-18T11:10:28.453993+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:10:28.453993+0000","last_undegraded":"2023-10-18T11:10:28.453993+0000","last_fullsized":"2023-10-18T11:10:28.453993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171913+0000","last_change":"2023-10-18T11:09:46.114944+0000","last_active":"2023-10-18T11:10:09.171913+0000","last_peered":"2023-10-18T11:10:09.171913+0000","last_clean":"2023-10-18T11:10:09.171913+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:10:09.171913+0000","last_undegraded":"2023-10-18T11:10:09.171913+0000","last_fullsized":"2023-10-18T11:10:09.171913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166923+0000","last_change":"2023-10-18T11:09:39.420430+0000","last_active":"2023-10-18T11:10:09.166923+0000","last_peered":"2023-10-18T11:10:09.166923+0000","last_clean":"2023-10-18T11:10:09.166923+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:10:09.166923+0000","last_undegraded":"2023-10-18T11:10:09.166923+0000","last_fullsized":"2023-10-18T11:10:09.166923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:12.994704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.657711+0000","last_change":"2023-10-18T11:09:36.904648+0000","last_active":"2023-10-18T11:10:21.657711+0000","last_peered":"2023-10-18T11:10:21.657711+0000","last_clean":"2023-10-18T11:10:21.657711+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:10:21.657711+0000","last_undegraded":"2023-10-18T11:10:21.657711+0000","last_fullsized":"2023-10-18T11:10:21.657711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161456+0000","last_change":"2023-10-18T11:09:46.101866+0000","last_active":"2023-10-18T11:10:09.161456+0000","last_peered":"2023-10-18T11:10:09.161456+0000","last_clean":"2023-10-18T11:10:09.161456+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:10:09.161456+0000","last_undegraded":"2023-10-18T11:10:09.161456+0000","last_fullsized":"2023-10-18T11:10:09.161456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:41.150485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169443+0000","last_change":"2023-10-18T11:09:39.398597+0000","last_active":"2023-10-18T11:10:09.169443+0000","last_peered":"2023-10-18T11:10:09.169443+0000","last_clean":"2023-10-18T11:10:09.169443+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:10:09.169443+0000","last_undegraded":"2023-10-18T11:10:09.169443+0000","last_fullsized":"2023-10-18T11:10:09.169443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:10.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.678209+0000","last_change":"2023-10-18T11:09:36.913285+0000","last_active":"2023-10-18T11:10:21.678209+0000","last_peered":"2023-10-18T11:10:21.678209+0000","last_clean":"2023-10-18T11:10:21.678209+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:10:21.678209+0000","last_undegraded":"2023-10-18T11:10:21.678209+0000","last_fullsized":"2023-10-18T11:10:21.678209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169273+0000","last_change":"2023-10-18T11:09:46.094205+0000","last_active":"2023-10-18T11:10:09.169273+0000","last_peered":"2023-10-18T11:10:09.169273+0000","last_clean":"2023-10-18T11:10:09.169273+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:10:09.169273+0000","last_undegraded":"2023-10-18T11:10:09.169273+0000","last_fullsized":"2023-10-18T11:10:09.169273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:13.509608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176274+0000","last_change":"2023-10-18T11:09:39.363739+0000","last_active":"2023-10-18T11:10:09.176274+0000","last_peered":"2023-10-18T11:10:09.176274+0000","last_clean":"2023-10-18T11:10:09.176274+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:10:09.176274+0000","last_undegraded":"2023-10-18T11:10:09.176274+0000","last_fullsized":"2023-10-18T11:10:09.176274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:52.069782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.434643+0000","last_change":"2023-10-18T11:09:36.896767+0000","last_active":"2023-10-18T11:10:21.434643+0000","last_peered":"2023-10-18T11:10:21.434643+0000","last_clean":"2023-10-18T11:10:21.434643+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:10:21.434643+0000","last_undegraded":"2023-10-18T11:10:21.434643+0000","last_fullsized":"2023-10-18T11:10:21.434643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178440+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:10:09.178440+0000","last_peered":"2023-10-18T11:10:09.178440+0000","last_clean":"2023-10-18T11:10:09.178440+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:10:09.178440+0000","last_undegraded":"2023-10-18T11:10:09.178440+0000","last_fullsized":"2023-10-18T11:10:09.178440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.172124+0000","last_change":"2023-10-18T11:09:39.351468+0000","last_active":"2023-10-18T11:10:09.172124+0000","last_peered":"2023-10-18T11:10:09.172124+0000","last_clean":"2023-10-18T11:10:09.172124+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:10:09.172124+0000","last_undegraded":"2023-10-18T11:10:09.172124+0000","last_fullsized":"2023-10-18T11:10:09.172124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.664449+0000","last_change":"2023-10-18T11:09:36.896596+0000","last_active":"2023-10-18T11:10:21.664449+0000","last_peered":"2023-10-18T11:10:21.664449+0000","last_clean":"2023-10-18T11:10:21.664449+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:10:21.664449+0000","last_undegraded":"2023-10-18T11:10:21.664449+0000","last_fullsized":"2023-10-18T11:10:21.664449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179254+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:10:09.179254+0000","last_peered":"2023-10-18T11:10:09.179254+0000","last_clean":"2023-10-18T11:10:09.179254+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:10:09.179254+0000","last_undegraded":"2023-10-18T11:10:09.179254+0000","last_fullsized":"2023-10-18T11:10:09.179254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.417214+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:10:10.417214+0000","last_peered":"2023-10-18T11:10:10.417214+0000","last_clean":"2023-10-18T11:10:10.417214+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:10:10.417214+0000","last_undegraded":"2023-10-18T11:10:10.417214+0000","last_fullsized":"2023-10-18T11:10:10.417214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:09.785576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161029+0000","last_change":"2023-10-18T11:09:39.418416+0000","last_active":"2023-10-18T11:10:09.161029+0000","last_peered":"2023-10-18T11:10:09.161029+0000","last_clean":"2023-10-18T11:10:09.161029+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:10:09.161029+0000","last_undegraded":"2023-10-18T11:10:09.161029+0000","last_fullsized":"2023-10-18T11:10:09.161029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.442768+0000","last_change":"2023-10-18T11:09:36.893158+0000","last_active":"2023-10-18T11:10:21.442768+0000","last_peered":"2023-10-18T11:10:21.442768+0000","last_clean":"2023-10-18T11:10:21.442768+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:10:21.442768+0000","last_undegraded":"2023-10-18T11:10:21.442768+0000","last_fullsized":"2023-10-18T11:10:21.442768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164789+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:10:09.164789+0000","last_peered":"2023-10-18T11:10:09.164789+0000","last_clean":"2023-10-18T11:10:09.164789+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:10:09.164789+0000","last_undegraded":"2023-10-18T11:10:09.164789+0000","last_fullsized":"2023-10-18T11:10:09.164789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178550+0000","last_change":"2023-10-18T11:09:39.421160+0000","last_active":"2023-10-18T11:10:09.178550+0000","last_peered":"2023-10-18T11:10:09.178550+0000","last_clean":"2023-10-18T11:10:09.178550+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:10:09.178550+0000","last_undegraded":"2023-10-18T11:10:09.178550+0000","last_fullsized":"2023-10-18T11:10:09.178550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.313822+0000","last_change":"2023-10-18T11:09:36.911629+0000","last_active":"2023-10-18T11:10:28.313822+0000","last_peered":"2023-10-18T11:10:28.313822+0000","last_clean":"2023-10-18T11:10:28.313822+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:10:28.313822+0000","last_undegraded":"2023-10-18T11:10:28.313822+0000","last_fullsized":"2023-10-18T11:10:28.313822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:53.929992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.454238+0000","last_change":"2023-10-18T11:09:36.894351+0000","last_active":"2023-10-18T11:10:28.454238+0000","last_peered":"2023-10-18T11:10:28.454238+0000","last_clean":"2023-10-18T11:10:28.454238+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:10:28.454238+0000","last_undegraded":"2023-10-18T11:10:28.454238+0000","last_fullsized":"2023-10-18T11:10:28.454238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:11.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.180784+0000","last_change":"2023-10-18T11:09:39.404508+0000","last_active":"2023-10-18T11:10:09.180784+0000","last_peered":"2023-10-18T11:10:09.180784+0000","last_clean":"2023-10-18T11:10:09.180784+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:10:09.180784+0000","last_undegraded":"2023-10-18T11:10:09.180784+0000","last_fullsized":"2023-10-18T11:10:09.180784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144886+0000","last_change":"2023-10-18T11:09:46.117246+0000","last_active":"2023-10-18T11:10:09.144886+0000","last_peered":"2023-10-18T11:10:09.144886+0000","last_clean":"2023-10-18T11:10:09.144886+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:10:09.144886+0000","last_undegraded":"2023-10-18T11:10:09.144886+0000","last_fullsized":"2023-10-18T11:10:09.144886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:59.808082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.474878+0000","last_change":"2023-10-18T11:09:36.912013+0000","last_active":"2023-10-18T11:10:21.474878+0000","last_peered":"2023-10-18T11:10:21.474878+0000","last_clean":"2023-10-18T11:10:21.474878+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:10:21.474878+0000","last_undegraded":"2023-10-18T11:10:21.474878+0000","last_fullsized":"2023-10-18T11:10:21.474878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:49.950001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169156+0000","last_change":"2023-10-18T11:09:39.400362+0000","last_active":"2023-10-18T11:10:09.169156+0000","last_peered":"2023-10-18T11:10:09.169156+0000","last_clean":"2023-10-18T11:10:09.169156+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:10:09.169156+0000","last_undegraded":"2023-10-18T11:10:09.169156+0000","last_fullsized":"2023-10-18T11:10:09.169156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:50.136754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182239+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:10:09.182239+0000","last_peered":"2023-10-18T11:10:09.182239+0000","last_clean":"2023-10-18T11:10:09.182239+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:10:09.182239+0000","last_undegraded":"2023-10-18T11:10:09.182239+0000","last_fullsized":"2023-10-18T11:10:09.182239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:52:09.414015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164430+0000","last_change":"2023-10-18T11:09:39.359747+0000","last_active":"2023-10-18T11:10:09.164430+0000","last_peered":"2023-10-18T11:10:09.164430+0000","last_clean":"2023-10-18T11:10:09.164430+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:10:09.164430+0000","last_undegraded":"2023-10-18T11:10:09.164430+0000","last_fullsized":"2023-10-18T11:10:09.164430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144846+0000","last_change":"2023-10-18T11:09:39.242600+0000","last_active":"2023-10-18T11:10:09.144846+0000","last_peered":"2023-10-18T11:10:09.144846+0000","last_clean":"2023-10-18T11:10:09.144846+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:10:09.144846+0000","last_undegraded":"2023-10-18T11:10:09.144846+0000","last_fullsized":"2023-10-18T11:10:09.144846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:45.076093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.419036+0000","last_change":"2023-10-18T11:10:10.416758+0000","last_active":"2023-10-18T11:10:10.419036+0000","last_peered":"2023-10-18T11:10:10.419036+0000","last_clean":"2023-10-18T11:10:10.419036+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:10:10.419036+0000","last_undegraded":"2023-10-18T11:10:10.419036+0000","last_fullsized":"2023-10-18T11:10:10.419036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177879+0000","last_change":"2023-10-18T11:09:39.425505+0000","last_active":"2023-10-18T11:10:09.177879+0000","last_peered":"2023-10-18T11:10:09.177879+0000","last_clean":"2023-10-18T11:10:09.177879+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:10:09.177879+0000","last_undegraded":"2023-10-18T11:10:09.177879+0000","last_fullsized":"2023-10-18T11:10:09.177879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179456+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:10:09.179456+0000","last_peered":"2023-10-18T11:10:09.179456+0000","last_clean":"2023-10-18T11:10:09.179456+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:10:09.179456+0000","last_undegraded":"2023-10-18T11:10:09.179456+0000","last_fullsized":"2023-10-18T11:10:09.179456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162742+0000","last_change":"2023-10-18T11:09:39.423043+0000","last_active":"2023-10-18T11:10:09.162742+0000","last_peered":"2023-10-18T11:10:09.162742+0000","last_clean":"2023-10-18T11:10:09.162742+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:10:09.162742+0000","last_undegraded":"2023-10-18T11:10:09.162742+0000","last_fullsized":"2023-10-18T11:10:09.162742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165107+0000","last_change":"2023-10-18T11:09:39.351604+0000","last_active":"2023-10-18T11:10:09.165107+0000","last_peered":"2023-10-18T11:10:09.165107+0000","last_clean":"2023-10-18T11:10:09.165107+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:10:09.165107+0000","last_undegraded":"2023-10-18T11:10:09.165107+0000","last_fullsized":"2023-10-18T11:10:09.165107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182241+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:10:09.182241+0000","last_peered":"2023-10-18T11:10:09.182241+0000","last_clean":"2023-10-18T11:10:09.182241+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:10:09.182241+0000","last_undegraded":"2023-10-18T11:10:09.182241+0000","last_fullsized":"2023-10-18T11:10:09.182241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171269+0000","last_change":"2023-10-18T11:09:39.419909+0000","last_active":"2023-10-18T11:10:09.171269+0000","last_peered":"2023-10-18T11:10:09.171269+0000","last_clean":"2023-10-18T11:10:09.171269+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:10:09.171269+0000","last_undegraded":"2023-10-18T11:10:09.171269+0000","last_fullsized":"2023-10-18T11:10:09.171269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179397+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:10:09.179397+0000","last_peered":"2023-10-18T11:10:09.179397+0000","last_clean":"2023-10-18T11:10:09.179397+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:10:09.179397+0000","last_undegraded":"2023-10-18T11:10:09.179397+0000","last_fullsized":"2023-10-18T11:10:09.179397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171348+0000","last_change":"2023-10-18T11:09:39.349250+0000","last_active":"2023-10-18T11:10:09.171348+0000","last_peered":"2023-10-18T11:10:09.171348+0000","last_clean":"2023-10-18T11:10:09.171348+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:10:09.171348+0000","last_undegraded":"2023-10-18T11:10:09.171348+0000","last_fullsized":"2023-10-18T11:10:09.171348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177703+0000","last_change":"2023-10-18T11:09:39.361414+0000","last_active":"2023-10-18T11:10:09.177703+0000","last_peered":"2023-10-18T11:10:09.177703+0000","last_clean":"2023-10-18T11:10:09.177703+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:10:09.177703+0000","last_undegraded":"2023-10-18T11:10:09.177703+0000","last_fullsized":"2023-10-18T11:10:09.177703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164861+0000","last_change":"2023-10-18T11:09:39.399067+0000","last_active":"2023-10-18T11:10:09.164861+0000","last_peered":"2023-10-18T11:10:09.164861+0000","last_clean":"2023-10-18T11:10:09.164861+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:10:09.164861+0000","last_undegraded":"2023-10-18T11:10:09.164861+0000","last_fullsized":"2023-10-18T11:10:09.164861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167183+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:10:09.167183+0000","last_peered":"2023-10-18T11:10:09.167183+0000","last_clean":"2023-10-18T11:10:09.167183+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:10:09.167183+0000","last_undegraded":"2023-10-18T11:10:09.167183+0000","last_fullsized":"2023-10-18T11:10:09.167183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:04.730798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.145690+0000","last_change":"2023-10-18T11:09:39.320727+0000","last_active":"2023-10-18T11:10:09.145690+0000","last_peered":"2023-10-18T11:10:09.145690+0000","last_clean":"2023-10-18T11:10:09.145690+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:10:09.145690+0000","last_undegraded":"2023-10-18T11:10:09.145690+0000","last_fullsized":"2023-10-18T11:10:09.145690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.407850+0000","last_change":"2023-10-18T11:10:10.401580+0000","last_active":"2023-10-18T11:10:10.407850+0000","last_peered":"2023-10-18T11:10:10.407850+0000","last_clean":"2023-10-18T11:10:10.407850+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:10:10.407850+0000","last_undegraded":"2023-10-18T11:10:10.407850+0000","last_fullsized":"2023-10-18T11:10:10.407850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171150+0000","last_change":"2023-10-18T11:09:39.354336+0000","last_active":"2023-10-18T11:10:09.171150+0000","last_peered":"2023-10-18T11:10:09.171150+0000","last_clean":"2023-10-18T11:10:09.171150+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:10:09.171150+0000","last_undegraded":"2023-10-18T11:10:09.171150+0000","last_fullsized":"2023-10-18T11:10:09.171150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161257+0000","last_change":"2023-10-18T11:09:39.401976+0000","last_active":"2023-10-18T11:10:09.161257+0000","last_peered":"2023-10-18T11:10:09.161257+0000","last_clean":"2023-10-18T11:10:09.161257+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:10:09.161257+0000","last_undegraded":"2023-10-18T11:10:09.161257+0000","last_fullsized":"2023-10-18T11:10:09.161257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173957+0000","last_change":"2023-10-18T11:09:39.366222+0000","last_active":"2023-10-18T11:10:09.173957+0000","last_peered":"2023-10-18T11:10:09.173957+0000","last_clean":"2023-10-18T11:10:09.173957+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:10:09.173957+0000","last_undegraded":"2023-10-18T11:10:09.173957+0000","last_fullsized":"2023-10-18T11:10:09.173957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:52.729507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.415418+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:10:10.415418+0000","last_peered":"2023-10-18T11:10:10.415418+0000","last_clean":"2023-10-18T11:10:10.415418+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:10:10.415418+0000","last_undegraded":"2023-10-18T11:10:10.415418+0000","last_fullsized":"2023-10-18T11:10:10.415418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:37:38.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169371+0000","last_change":"2023-10-18T11:09:39.400563+0000","last_active":"2023-10-18T11:10:09.169371+0000","last_peered":"2023-10-18T11:10:09.169371+0000","last_clean":"2023-10-18T11:10:09.169371+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:10:09.169371+0000","last_undegraded":"2023-10-18T11:10:09.169371+0000","last_fullsized":"2023-10-18T11:10:09.169371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:24.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164720+0000","last_change":"2023-10-18T11:09:39.320580+0000","last_active":"2023-10-18T11:10:09.164720+0000","last_peered":"2023-10-18T11:10:09.164720+0000","last_clean":"2023-10-18T11:10:09.164720+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:10:09.164720+0000","last_undegraded":"2023-10-18T11:10:09.164720+0000","last_fullsized":"2023-10-18T11:10:09.164720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165013+0000","last_change":"2023-10-18T11:09:39.320508+0000","last_active":"2023-10-18T11:10:09.165013+0000","last_peered":"2023-10-18T11:10:09.165013+0000","last_clean":"2023-10-18T11:10:09.165013+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:10:09.165013+0000","last_undegraded":"2023-10-18T11:10:09.165013+0000","last_fullsized":"2023-10-18T11:10:09.165013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167124+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:10:09.167124+0000","last_peered":"2023-10-18T11:10:09.167124+0000","last_clean":"2023-10-18T11:10:09.167124+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:10:09.167124+0000","last_undegraded":"2023-10-18T11:10:09.167124+0000","last_fullsized":"2023-10-18T11:10:09.167124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:11.432343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178301+0000","last_change":"2023-10-18T11:09:39.421921+0000","last_active":"2023-10-18T11:10:09.178301+0000","last_peered":"2023-10-18T11:10:09.178301+0000","last_clean":"2023-10-18T11:10:09.178301+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:10:09.178301+0000","last_undegraded":"2023-10-18T11:10:09.178301+0000","last_fullsized":"2023-10-18T11:10:09.178301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166717+0000","last_change":"2023-10-18T11:09:39.360846+0000","last_active":"2023-10-18T11:10:09.166717+0000","last_peered":"2023-10-18T11:10:09.166717+0000","last_clean":"2023-10-18T11:10:09.166717+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:10:09.166717+0000","last_undegraded":"2023-10-18T11:10:09.166717+0000","last_fullsized":"2023-10-18T11:10:09.166717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.417103+0000","last_change":"2023-10-18T11:10:10.413563+0000","last_active":"2023-10-18T11:10:10.417103+0000","last_peered":"2023-10-18T11:10:10.417103+0000","last_clean":"2023-10-18T11:10:10.417103+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:10:10.417103+0000","last_undegraded":"2023-10-18T11:10:10.417103+0000","last_fullsized":"2023-10-18T11:10:10.417103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:43.078216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166677+0000","last_change":"2023-10-18T11:09:39.355047+0000","last_active":"2023-10-18T11:10:09.166677+0000","last_peered":"2023-10-18T11:10:09.166677+0000","last_clean":"2023-10-18T11:10:09.166677+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:10:09.166677+0000","last_undegraded":"2023-10-18T11:10:09.166677+0000","last_fullsized":"2023-10-18T11:10:09.166677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171566+0000","last_change":"2023-10-18T11:09:39.418362+0000","last_active":"2023-10-18T11:10:09.171566+0000","last_peered":"2023-10-18T11:10:09.171566+0000","last_clean":"2023-10-18T11:10:09.171566+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:10:09.171566+0000","last_undegraded":"2023-10-18T11:10:09.171566+0000","last_fullsized":"2023-10-18T11:10:09.171566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.175529+0000","last_change":"2023-10-18T11:09:39.363750+0000","last_active":"2023-10-18T11:10:09.175529+0000","last_peered":"2023-10-18T11:10:09.175529+0000","last_clean":"2023-10-18T11:10:09.175529+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:10:09.175529+0000","last_undegraded":"2023-10-18T11:10:09.175529+0000","last_fullsized":"2023-10-18T11:10:09.175529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:43.536873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163609+0000","last_change":"2023-10-18T11:09:39.363259+0000","last_active":"2023-10-18T11:10:09.163609+0000","last_peered":"2023-10-18T11:10:09.163609+0000","last_clean":"2023-10-18T11:10:09.163609+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:10:09.163609+0000","last_undegraded":"2023-10-18T11:10:09.163609+0000","last_fullsized":"2023-10-18T11:10:09.163609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166784+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:10:09.166784+0000","last_peered":"2023-10-18T11:10:09.166784+0000","last_clean":"2023-10-18T11:10:09.166784+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:10:09.166784+0000","last_undegraded":"2023-10-18T11:10:09.166784+0000","last_fullsized":"2023-10-18T11:10:09.166784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:34.071910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8745,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":17602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":421888,"data_stored":726556,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.374},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.754}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.432}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32900000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.38700000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":136228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.39400000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.52800000000000002}]},{"osd":3,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.86199999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34100000000000003}]},{"osd":6,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.38},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35499999999999998}]},{"osd":7,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.37},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32500000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.57099999999999995}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.69799999999999995}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41399999999999998}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55800000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":139493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.802},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.5219999999999998,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":2.0209999999999999}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.8839999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":3.1080000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.6019999999999999,"5min":3.6019999999999999,"15min":3.6019999999999999},"last":1.921}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.81299999999999994}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":1.8340000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.109}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":3.661,"5min":3.661,"15min":3.661},"last":1.7569999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.84899999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.383}]},{"osd":1,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.4970000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.085}]},{"osd":4,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":1.026},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.556,"5min":3.556,"15min":3.556},"last":1.1499999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":1.2210000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.7069999999999999,"5min":3.7069999999999999,"15min":3.7069999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":4.0209999999999999,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":1.5980000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":1.4590000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":135794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.339},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":1.1080000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.04},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.077}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.163},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":0.745}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.2789999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":3.2040000000000002,"5min":3.2040000000000002,"15min":3.2040000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.998}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.135},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.7330000000000001,"5min":2.7330000000000001,"15min":2.7330000000000001},"last":1.6399999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":725912,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.90300000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.3799999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":2.0289999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2709999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.9039999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.9550000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.93600000000000005}]},{"osd":6,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.98599999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.024},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.9910000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":139369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.52300000000000002}]},{"osd":1,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":2.1259999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.59999999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.41399999999999998}]},{"osd":3,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.9870000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:10:33.737 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:10:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.980+0000 7f4af6d05640 1 Processor -- start 2023-10-18T11:10:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.981+0000 7f4af6d05640 1 -- start start 2023-10-18T11:10:33.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.982+0000 7f4af6d05640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af00b0b80 0x7f4af00c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:33.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.982+0000 7f4af6d05640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4af0160b30 0x7f4af00c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:33.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.983+0000 7f4af6d05640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00c0d50 con 0x7f4af00c9050 2023-10-18T11:10:33.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.983+0000 7f4af6d05640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af00c6ba0 con 0x7f4af0160b30 2023-10-18T11:10:33.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.983+0000 7f4af6d05640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00c0fc0 con 0x7f4af00b0b80 2023-10-18T11:10:33.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.983+0000 7f4aeffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4af0160b30 0x7f4af00c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:33.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.984+0000 7f4af4aa1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af00b0b80 0x7f4af00c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:33.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.984+0000 7f4af52a2640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f4af00c9050 0x7f4af00c5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50116/0 (socket says 172.21.15.151:50116) 2023-10-18T11:10:33.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.984+0000 7f4af52a2640 1 -- 172.21.15.151:0/2677419362 learned_addr learned my addr 172.21.15.151:0/2677419362 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.986+0000 7f4af4aa1640 1 -- 172.21.15.151:0/2677419362 >> v2:172.21.15.169:3300/0 conn(0x7f4af0160b30 msgr2=0x7f4af00c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.986+0000 7f4af4aa1640 1 --2- 172.21.15.151:0/2677419362 >> v2:172.21.15.169:3300/0 conn(0x7f4af0160b30 0x7f4af00c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.986+0000 7f4af4aa1640 1 -- 172.21.15.151:0/2677419362 >> v1:172.21.15.169:6789/0 conn(0x7f4af00c9050 legacy=0x7f4af00c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.986+0000 7f4af4aa1640 1 -- 172.21.15.151:0/2677419362 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00c12a0 con 0x7f4af00b0b80 2023-10-18T11:10:33.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.989+0000 7f4af4aa1640 1 --2- 172.21.15.151:0/2677419362 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af00b0b80 0x7f4af00c9970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097a0 tx=0x7f4ae402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ca5d2f5c2e34c8f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:33.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.993+0000 7f4aef7fe640 1 -- 172.21.15.151:0/2677419362 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4031830 con 0x7f4af00b0b80 2023-10-18T11:10:33.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.993+0000 7f4aef7fe640 1 -- 172.21.15.151:0/2677419362 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae4031990 con 0x7f4af00b0b80 2023-10-18T11:10:33.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.993+0000 7f4aef7fe640 1 -- 172.21.15.151:0/2677419362 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4031d20 con 0x7f4af00b0b80 2023-10-18T11:10:33.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.993+0000 7f4af6d05640 1 -- 172.21.15.151:0/2677419362 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af00b0b80 msgr2=0x7f4af00c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:33.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.993+0000 7f4af6d05640 1 --2- 172.21.15.151:0/2677419362 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af00b0b80 0x7f4af00c9970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097a0 tx=0x7f4ae402b8d0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.994+0000 7f4af6d05640 1 -- 172.21.15.151:0/2677419362 shutdown_connections 2023-10-18T11:10:33.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.994+0000 7f4af6d05640 1 --2- 172.21.15.151:0/2677419362 >> v2:172.21.15.169:3300/0 conn(0x7f4af0160b30 0x7f4af00c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.994+0000 7f4af6d05640 1 --2- 172.21.15.151:0/2677419362 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af00b0b80 0x7f4af00c9970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:33.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.994+0000 7f4af6d05640 1 -- 172.21.15.151:0/2677419362 >> 172.21.15.151:0/2677419362 conn(0x7f4af006e930 msgr2=0x7f4af00cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:33.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.994+0000 7f4af6d05640 1 -- 172.21.15.151:0/2677419362 shutdown_connections 2023-10-18T11:10:33.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.994+0000 7f4af6d05640 1 -- 172.21.15.151:0/2677419362 wait complete. 2023-10-18T11:10:33.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.996+0000 7f4af6d05640 1 Processor -- start 2023-10-18T11:10:33.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.996+0000 7f4af6d05640 1 -- start start 2023-10-18T11:10:34.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.998+0000 7f4af6d05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af00b0b80 0x7f4af00c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:34.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.998+0000 7f4af6d05640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4af00c9050 0x7f4af006ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:34.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.998+0000 7f4af6d05640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af0160b30 0x7f4af01f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:34.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.998+0000 7f4af6d05640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01533a0 con 0x7f4af00b0b80 2023-10-18T11:10:34.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.998+0000 7f4af6d05640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00c4120 con 0x7f4af00c9050 2023-10-18T11:10:34.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.998+0000 7f4af6d05640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af014ad30 con 0x7f4af0160b30 2023-10-18T11:10:34.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.998+0000 7f4aeffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4af00c9050 0x7f4af006ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:34.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.998+0000 7f4af52a2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af0160b30 0x7f4af01f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:34.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.999+0000 7f4aeffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4af00c9050 0x7f4af006ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:39080/0 (socket says 172.21.15.151:39080) 2023-10-18T11:10:34.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.999+0000 7f4aeffff640 1 -- 172.21.15.151:0/255930846 learned_addr learned my addr 172.21.15.151:0/255930846 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:34.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:33.999+0000 7f4af4aa1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af00b0b80 0x7f4af00c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:34.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.002+0000 7f4aeffff640 1 -- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af0160b30 msgr2=0x7f4af01f43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:34.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.002+0000 7f4aeffff640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af0160b30 0x7f4af01f43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:34.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.002+0000 7f4aeffff640 1 -- 172.21.15.151:0/255930846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af00b0b80 msgr2=0x7f4af00c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:34.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.002+0000 7f4aeffff640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af00b0b80 0x7f4af00c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:34.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.002+0000 7f4aeffff640 1 -- 172.21.15.151:0/255930846 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4009400 con 0x7f4af00c9050 2023-10-18T11:10:34.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.004+0000 7f4aeffff640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4af00c9050 0x7f4af006ada0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00e8a0 tx=0x7f4adc00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.008+0000 7f4aed7fa640 1 -- 172.21.15.151:0/255930846 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0094f0 con 0x7f4af00c9050 2023-10-18T11:10:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.008+0000 7f4aed7fa640 1 -- 172.21.15.151:0/255930846 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc00c940 con 0x7f4af00c9050 2023-10-18T11:10:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.008+0000 7f4aed7fa640 1 -- 172.21.15.151:0/255930846 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00ccf0 con 0x7f4af00c9050 2023-10-18T11:10:34.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.008+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af01f3f30 con 0x7f4af00c9050 2023-10-18T11:10:34.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.008+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af00c4eb0 con 0x7f4af00c9050 2023-10-18T11:10:34.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.009+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af01f40c0 con 0x7f4af00c9050 2023-10-18T11:10:34.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.268+0000 7f4aed7fa640 1 -- 172.21.15.151:0/255930846 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4adc013470 con 0x7f4af00c9050 2023-10-18T11:10:34.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.270+0000 7f4aed7fa640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4ad406aec0 0x7f4ad406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:34.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.270+0000 7f4aed7fa640 1 -- 172.21.15.151:0/255930846 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4adc08a0e0 con 0x7f4af00c9050 2023-10-18T11:10:34.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.270+0000 7f4af4aa1640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4ad406aec0 0x7f4ad406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:34.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.271+0000 7f4af4aa1640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4ad406aec0 0x7f4ad406d380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4036000 tx=0x7f4ae403c040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:34.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.280+0000 7f4aed7fa640 1 -- 172.21.15.151:0/255930846 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4adc054f60 con 0x7f4af00c9050 2023-10-18T11:10:34.478 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.476+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4af00c9eb0 con 0x7f4ad406aec0 2023-10-18T11:10:34.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.486+0000 7f4aed7fa640 1 -- 172.21.15.151:0/255930846 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368268 (secure 0 0 0) 0x7f4ae403a420 con 0x7f4ad406aec0 2023-10-18T11:10:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:34.495 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:10:34.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4ad406aec0 msgr2=0x7f4ad406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:34.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4ad406aec0 0x7f4ad406d380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4036000 tx=0x7f4ae403c040 comp rx=0 tx=0).stop 2023-10-18T11:10:34.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4af00c9050 msgr2=0x7f4af006ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:34.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4af00c9050 0x7f4af006ada0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00e8a0 tx=0x7f4adc00ed60 comp rx=0 tx=0).stop 2023-10-18T11:10:34.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 shutdown_connections 2023-10-18T11:10:34.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4af0160b30 0x7f4af01f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:34.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4ad406aec0 0x7f4ad406d380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:34.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4af00c9050 0x7f4af006ada0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:34.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 --2- 172.21.15.151:0/255930846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af00b0b80 0x7f4af00c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:34.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 >> 172.21.15.151:0/255930846 conn(0x7f4af006e930 msgr2=0x7f4af00c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:34.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 shutdown_connections 2023-10-18T11:10:34.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.492+0000 7f4af6d05640 1 -- 172.21.15.151:0/255930846 wait complete. 2023-10-18T11:10:34.512 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-10-18T11:10:34.202818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599113,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":315,"num_write_kb":2469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":255,"ondisk_log_size":255,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2973696,"data_stored":2275788,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4106,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002956"},"pg_stats":[{"pgid":"2.1f","version":"31'11","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.430057+0000","last_change":"2023-10-18T11:09:36.796784+0000","last_active":"2023-10-18T11:10:30.430057+0000","last_peered":"2023-10-18T11:10:30.430057+0000","last_clean":"2023-10-18T11:10:30.430057+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:10:30.430057+0000","last_undegraded":"2023-10-18T11:10:30.430057+0000","last_fullsized":"2023-10-18T11:10:30.430057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.181907+0000","last_change":"2023-10-18T11:09:39.421701+0000","last_active":"2023-10-18T11:10:09.181907+0000","last_peered":"2023-10-18T11:10:09.181907+0000","last_clean":"2023-10-18T11:10:09.181907+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:10:09.181907+0000","last_undegraded":"2023-10-18T11:10:09.181907+0000","last_fullsized":"2023-10-18T11:10:09.181907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179158+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:10:09.179158+0000","last_peered":"2023-10-18T11:10:09.179158+0000","last_clean":"2023-10-18T11:10:09.179158+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:10:09.179158+0000","last_undegraded":"2023-10-18T11:10:09.179158+0000","last_fullsized":"2023-10-18T11:10:09.179158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.409911+0000","last_change":"2023-10-18T11:09:36.909894+0000","last_active":"2023-10-18T11:10:10.409911+0000","last_peered":"2023-10-18T11:10:10.409911+0000","last_clean":"2023-10-18T11:10:10.409911+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:10:10.409911+0000","last_undegraded":"2023-10-18T11:10:10.409911+0000","last_fullsized":"2023-10-18T11:10:10.409911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176067+0000","last_change":"2023-10-18T11:09:39.363102+0000","last_active":"2023-10-18T11:10:09.176067+0000","last_peered":"2023-10-18T11:10:09.176067+0000","last_clean":"2023-10-18T11:10:09.176067+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:10:09.176067+0000","last_undegraded":"2023-10-18T11:10:09.176067+0000","last_fullsized":"2023-10-18T11:10:09.176067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168922+0000","last_change":"2023-10-18T11:09:46.109981+0000","last_active":"2023-10-18T11:10:09.168922+0000","last_peered":"2023-10-18T11:10:09.168922+0000","last_clean":"2023-10-18T11:10:09.168922+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:10:09.168922+0000","last_undegraded":"2023-10-18T11:10:09.168922+0000","last_fullsized":"2023-10-18T11:10:09.168922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:26.971949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'7","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.519180+0000","last_change":"2023-10-18T11:09:36.896708+0000","last_active":"2023-10-18T11:10:30.519180+0000","last_peered":"2023-10-18T11:10:30.519180+0000","last_clean":"2023-10-18T11:10:30.519180+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:10:30.519180+0000","last_undegraded":"2023-10-18T11:10:30.519180+0000","last_fullsized":"2023-10-18T11:10:30.519180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171648+0000","last_change":"2023-10-18T11:09:39.397225+0000","last_active":"2023-10-18T11:10:09.171648+0000","last_peered":"2023-10-18T11:10:09.171648+0000","last_clean":"2023-10-18T11:10:09.171648+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:10:09.171648+0000","last_undegraded":"2023-10-18T11:10:09.171648+0000","last_fullsized":"2023-10-18T11:10:09.171648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169423+0000","last_change":"2023-10-18T11:09:46.114798+0000","last_active":"2023-10-18T11:10:09.169423+0000","last_peered":"2023-10-18T11:10:09.169423+0000","last_clean":"2023-10-18T11:10:09.169423+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:10:09.169423+0000","last_undegraded":"2023-10-18T11:10:09.169423+0000","last_fullsized":"2023-10-18T11:10:09.169423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:57.280120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166779+0000","last_change":"2023-10-18T11:09:36.795004+0000","last_active":"2023-10-18T11:10:09.166779+0000","last_peered":"2023-10-18T11:10:09.166779+0000","last_clean":"2023-10-18T11:10:09.166779+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:10:09.166779+0000","last_undegraded":"2023-10-18T11:10:09.166779+0000","last_fullsized":"2023-10-18T11:10:09.166779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171988+0000","last_change":"2023-10-18T11:09:39.398621+0000","last_active":"2023-10-18T11:10:09.171988+0000","last_peered":"2023-10-18T11:10:09.171988+0000","last_clean":"2023-10-18T11:10:09.171988+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:10:09.171988+0000","last_undegraded":"2023-10-18T11:10:09.171988+0000","last_fullsized":"2023-10-18T11:10:09.171988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169095+0000","last_change":"2023-10-18T11:09:46.115280+0000","last_active":"2023-10-18T11:10:09.169095+0000","last_peered":"2023-10-18T11:10:09.169095+0000","last_clean":"2023-10-18T11:10:09.169095+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:10:09.169095+0000","last_undegraded":"2023-10-18T11:10:09.169095+0000","last_fullsized":"2023-10-18T11:10:09.169095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:26.647416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165312+0000","last_change":"2023-10-18T11:09:39.397253+0000","last_active":"2023-10-18T11:10:09.165312+0000","last_peered":"2023-10-18T11:10:09.165312+0000","last_clean":"2023-10-18T11:10:09.165312+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:10:09.165312+0000","last_undegraded":"2023-10-18T11:10:09.165312+0000","last_fullsized":"2023-10-18T11:10:09.165312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.424298+0000","last_change":"2023-10-18T11:09:36.893066+0000","last_active":"2023-10-18T11:10:21.424298+0000","last_peered":"2023-10-18T11:10:21.424298+0000","last_clean":"2023-10-18T11:10:21.424298+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:10:21.424298+0000","last_undegraded":"2023-10-18T11:10:21.424298+0000","last_fullsized":"2023-10-18T11:10:21.424298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:32.587464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169855+0000","last_change":"2023-10-18T11:09:46.096113+0000","last_active":"2023-10-18T11:10:09.169855+0000","last_peered":"2023-10-18T11:10:09.169855+0000","last_clean":"2023-10-18T11:10:09.169855+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:10:09.169855+0000","last_undegraded":"2023-10-18T11:10:09.169855+0000","last_fullsized":"2023-10-18T11:10:09.169855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:09.971210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.180886+0000","last_change":"2023-10-18T11:09:39.423651+0000","last_active":"2023-10-18T11:10:09.180886+0000","last_peered":"2023-10-18T11:10:09.180886+0000","last_clean":"2023-10-18T11:10:09.180886+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:10:09.180886+0000","last_undegraded":"2023-10-18T11:10:09.180886+0000","last_fullsized":"2023-10-18T11:10:09.180886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.409084+0000","last_change":"2023-10-18T11:09:36.913611+0000","last_active":"2023-10-18T11:10:10.409084+0000","last_peered":"2023-10-18T11:10:10.409084+0000","last_clean":"2023-10-18T11:10:10.409084+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:10:10.409084+0000","last_undegraded":"2023-10-18T11:10:10.409084+0000","last_fullsized":"2023-10-18T11:10:10.409084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169776+0000","last_change":"2023-10-18T11:09:46.114729+0000","last_active":"2023-10-18T11:10:09.169776+0000","last_peered":"2023-10-18T11:10:09.169776+0000","last_clean":"2023-10-18T11:10:09.169776+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:10:09.169776+0000","last_undegraded":"2023-10-18T11:10:09.169776+0000","last_fullsized":"2023-10-18T11:10:09.169776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:50.156790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178636+0000","last_change":"2023-10-18T11:09:39.420146+0000","last_active":"2023-10-18T11:10:09.178636+0000","last_peered":"2023-10-18T11:10:09.178636+0000","last_clean":"2023-10-18T11:10:09.178636+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:10:09.178636+0000","last_undegraded":"2023-10-18T11:10:09.178636+0000","last_fullsized":"2023-10-18T11:10:09.178636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.435008+0000","last_change":"2023-10-18T11:09:36.915198+0000","last_active":"2023-10-18T11:10:30.435008+0000","last_peered":"2023-10-18T11:10:30.435008+0000","last_clean":"2023-10-18T11:10:30.435008+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:10:30.435008+0000","last_undegraded":"2023-10-18T11:10:30.435008+0000","last_fullsized":"2023-10-18T11:10:30.435008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:18.429550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.416467+0000","last_change":"2023-10-18T11:10:10.413988+0000","last_active":"2023-10-18T11:10:10.416467+0000","last_peered":"2023-10-18T11:10:10.416467+0000","last_clean":"2023-10-18T11:10:10.416467+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:10:10.416467+0000","last_undegraded":"2023-10-18T11:10:10.416467+0000","last_fullsized":"2023-10-18T11:10:10.416467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169153+0000","last_change":"2023-10-18T11:09:39.399181+0000","last_active":"2023-10-18T11:10:09.169153+0000","last_peered":"2023-10-18T11:10:09.169153+0000","last_clean":"2023-10-18T11:10:09.169153+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:10:09.169153+0000","last_undegraded":"2023-10-18T11:10:09.169153+0000","last_fullsized":"2023-10-18T11:10:09.169153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:13.349921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.425764+0000","last_change":"2023-10-18T11:09:36.797637+0000","last_active":"2023-10-18T11:10:21.425764+0000","last_peered":"2023-10-18T11:10:21.425764+0000","last_clean":"2023-10-18T11:10:21.425764+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:10:21.425764+0000","last_undegraded":"2023-10-18T11:10:21.425764+0000","last_fullsized":"2023-10-18T11:10:21.425764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:08.109221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169728+0000","last_change":"2023-10-18T11:09:46.109408+0000","last_active":"2023-10-18T11:10:09.169728+0000","last_peered":"2023-10-18T11:10:09.169728+0000","last_clean":"2023-10-18T11:10:09.169728+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:10:09.169728+0000","last_undegraded":"2023-10-18T11:10:09.169728+0000","last_fullsized":"2023-10-18T11:10:09.169728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.174070+0000","last_change":"2023-10-18T11:09:39.366234+0000","last_active":"2023-10-18T11:10:09.174070+0000","last_peered":"2023-10-18T11:10:09.174070+0000","last_clean":"2023-10-18T11:10:09.174070+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:10:09.174070+0000","last_undegraded":"2023-10-18T11:10:09.174070+0000","last_fullsized":"2023-10-18T11:10:09.174070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.654804+0000","last_change":"2023-10-18T11:09:36.896533+0000","last_active":"2023-10-18T11:10:21.654804+0000","last_peered":"2023-10-18T11:10:21.654804+0000","last_clean":"2023-10-18T11:10:21.654804+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:10:21.654804+0000","last_undegraded":"2023-10-18T11:10:21.654804+0000","last_fullsized":"2023-10-18T11:10:21.654804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168970+0000","last_change":"2023-10-18T11:09:46.094196+0000","last_active":"2023-10-18T11:10:09.168970+0000","last_peered":"2023-10-18T11:10:09.168970+0000","last_clean":"2023-10-18T11:10:09.168970+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:10:09.168970+0000","last_undegraded":"2023-10-18T11:10:09.168970+0000","last_fullsized":"2023-10-18T11:10:09.168970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:43.456989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182246+0000","last_change":"2023-10-18T11:09:39.420016+0000","last_active":"2023-10-18T11:10:09.182246+0000","last_peered":"2023-10-18T11:10:09.182246+0000","last_clean":"2023-10-18T11:10:09.182246+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:10:09.182246+0000","last_undegraded":"2023-10-18T11:10:09.182246+0000","last_fullsized":"2023-10-18T11:10:09.182246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'7","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.437990+0000","last_change":"2023-10-18T11:09:36.913659+0000","last_active":"2023-10-18T11:10:30.437990+0000","last_peered":"2023-10-18T11:10:30.437990+0000","last_clean":"2023-10-18T11:10:30.437990+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:10:30.437990+0000","last_undegraded":"2023-10-18T11:10:30.437990+0000","last_fullsized":"2023-10-18T11:10:30.437990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179764+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:10:09.179764+0000","last_peered":"2023-10-18T11:10:09.179764+0000","last_clean":"2023-10-18T11:10:09.179764+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:10:09.179764+0000","last_undegraded":"2023-10-18T11:10:09.179764+0000","last_fullsized":"2023-10-18T11:10:09.179764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162384+0000","last_change":"2023-10-18T11:09:39.243607+0000","last_active":"2023-10-18T11:10:09.162384+0000","last_peered":"2023-10-18T11:10:09.162384+0000","last_clean":"2023-10-18T11:10:09.162384+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:10:09.162384+0000","last_undegraded":"2023-10-18T11:10:09.162384+0000","last_fullsized":"2023-10-18T11:10:09.162384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.518400+0000","last_change":"2023-10-18T11:09:36.798396+0000","last_active":"2023-10-18T11:10:30.518400+0000","last_peered":"2023-10-18T11:10:30.518400+0000","last_clean":"2023-10-18T11:10:30.518400+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:10:30.518400+0000","last_undegraded":"2023-10-18T11:10:30.518400+0000","last_fullsized":"2023-10-18T11:10:30.518400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:04.311252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177625+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:10:09.177625+0000","last_peered":"2023-10-18T11:10:09.177625+0000","last_clean":"2023-10-18T11:10:09.177625+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:10:09.177625+0000","last_undegraded":"2023-10-18T11:10:09.177625+0000","last_fullsized":"2023-10-18T11:10:09.177625+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.172014+0000","last_change":"2023-10-18T11:09:39.417304+0000","last_active":"2023-10-18T11:10:09.172014+0000","last_peered":"2023-10-18T11:10:09.172014+0000","last_clean":"2023-10-18T11:10:09.172014+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:10:09.172014+0000","last_undegraded":"2023-10-18T11:10:09.172014+0000","last_fullsized":"2023-10-18T11:10:09.172014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.411166+0000","last_change":"2023-10-18T11:09:36.909623+0000","last_active":"2023-10-18T11:10:10.411166+0000","last_peered":"2023-10-18T11:10:10.411166+0000","last_clean":"2023-10-18T11:10:10.411166+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:10:10.411166+0000","last_undegraded":"2023-10-18T11:10:10.411166+0000","last_fullsized":"2023-10-18T11:10:10.411166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161364+0000","last_change":"2023-10-18T11:09:46.100735+0000","last_active":"2023-10-18T11:10:09.161364+0000","last_peered":"2023-10-18T11:10:09.161364+0000","last_clean":"2023-10-18T11:10:09.161364+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:10:09.161364+0000","last_undegraded":"2023-10-18T11:10:09.161364+0000","last_fullsized":"2023-10-18T11:10:09.161364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169573+0000","last_change":"2023-10-18T11:09:39.400602+0000","last_active":"2023-10-18T11:10:09.169573+0000","last_peered":"2023-10-18T11:10:09.169573+0000","last_clean":"2023-10-18T11:10:09.169573+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:10:09.169573+0000","last_undegraded":"2023-10-18T11:10:09.169573+0000","last_fullsized":"2023-10-18T11:10:09.169573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:37.020893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.396221+0000","last_change":"2023-10-18T11:09:36.915028+0000","last_active":"2023-10-18T11:10:10.396221+0000","last_peered":"2023-10-18T11:10:10.396221+0000","last_clean":"2023-10-18T11:10:10.396221+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:10:10.396221+0000","last_undegraded":"2023-10-18T11:10:10.396221+0000","last_fullsized":"2023-10-18T11:10:10.396221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162244+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:10:09.162244+0000","last_peered":"2023-10-18T11:10:09.162244+0000","last_clean":"2023-10-18T11:10:09.162244+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:10:09.162244+0000","last_undegraded":"2023-10-18T11:10:09.162244+0000","last_fullsized":"2023-10-18T11:10:09.162244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161140+0000","last_change":"2023-10-18T11:09:39.243829+0000","last_active":"2023-10-18T11:10:09.161140+0000","last_peered":"2023-10-18T11:10:09.161140+0000","last_clean":"2023-10-18T11:10:09.161140+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:10:09.161140+0000","last_undegraded":"2023-10-18T11:10:09.161140+0000","last_fullsized":"2023-10-18T11:10:09.161140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.442856+0000","last_change":"2023-10-18T11:09:36.910270+0000","last_active":"2023-10-18T11:10:28.442856+0000","last_peered":"2023-10-18T11:10:28.442856+0000","last_clean":"2023-10-18T11:10:28.442856+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:10:28.442856+0000","last_undegraded":"2023-10-18T11:10:28.442856+0000","last_fullsized":"2023-10-18T11:10:28.442856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163801+0000","last_change":"2023-10-18T11:09:46.114610+0000","last_active":"2023-10-18T11:10:09.163801+0000","last_peered":"2023-10-18T11:10:09.163801+0000","last_clean":"2023-10-18T11:10:09.163801+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:10:09.163801+0000","last_undegraded":"2023-10-18T11:10:09.163801+0000","last_fullsized":"2023-10-18T11:10:09.163801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177327+0000","last_change":"2023-10-18T11:09:39.404210+0000","last_active":"2023-10-18T11:10:09.177327+0000","last_peered":"2023-10-18T11:10:09.177327+0000","last_clean":"2023-10-18T11:10:09.177327+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:10:09.177327+0000","last_undegraded":"2023-10-18T11:10:09.177327+0000","last_fullsized":"2023-10-18T11:10:09.177327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.315925+0000","last_change":"2023-10-18T11:09:36.913804+0000","last_active":"2023-10-18T11:10:28.315925+0000","last_peered":"2023-10-18T11:10:28.315925+0000","last_clean":"2023-10-18T11:10:28.315925+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:10:28.315925+0000","last_undegraded":"2023-10-18T11:10:28.315925+0000","last_fullsized":"2023-10-18T11:10:28.315925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173920+0000","last_change":"2023-10-18T11:09:46.092566+0000","last_active":"2023-10-18T11:10:09.173920+0000","last_peered":"2023-10-18T11:10:09.173920+0000","last_clean":"2023-10-18T11:10:09.173920+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:10:09.173920+0000","last_undegraded":"2023-10-18T11:10:09.173920+0000","last_fullsized":"2023-10-18T11:10:09.173920+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:42.848835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178796+0000","last_change":"2023-10-18T11:09:39.422507+0000","last_active":"2023-10-18T11:10:09.178796+0000","last_peered":"2023-10-18T11:10:09.178796+0000","last_clean":"2023-10-18T11:10:09.178796+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:10:09.178796+0000","last_undegraded":"2023-10-18T11:10:09.178796+0000","last_fullsized":"2023-10-18T11:10:09.178796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.432102+0000","last_change":"2023-10-18T11:09:36.828474+0000","last_active":"2023-10-18T11:10:30.432102+0000","last_peered":"2023-10-18T11:10:30.432102+0000","last_clean":"2023-10-18T11:10:30.432102+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:10:30.432102+0000","last_undegraded":"2023-10-18T11:10:30.432102+0000","last_fullsized":"2023-10-18T11:10:30.432102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166583+0000","last_change":"2023-10-18T11:09:19.365660+0000","last_active":"2023-10-18T11:10:09.166583+0000","last_peered":"2023-10-18T11:10:09.166583+0000","last_clean":"2023-10-18T11:10:09.166583+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:10:09.166583+0000","last_undegraded":"2023-10-18T11:10:09.166583+0000","last_fullsized":"2023-10-18T11:10:09.166583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_clean_scrub_stamp":"2023-10-18T11:09:17.711667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:34:53.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164849+0000","last_change":"2023-10-18T11:09:46.118571+0000","last_active":"2023-10-18T11:10:09.164849+0000","last_peered":"2023-10-18T11:10:09.164849+0000","last_clean":"2023-10-18T11:10:09.164849+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:10:09.164849+0000","last_undegraded":"2023-10-18T11:10:09.164849+0000","last_fullsized":"2023-10-18T11:10:09.164849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:46.781070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166799+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:10:09.166799+0000","last_peered":"2023-10-18T11:10:09.166799+0000","last_clean":"2023-10-18T11:10:09.166799+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:10:09.166799+0000","last_undegraded":"2023-10-18T11:10:09.166799+0000","last_fullsized":"2023-10-18T11:10:09.166799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:30.435307+0000","last_change":"2023-10-18T11:09:36.829100+0000","last_active":"2023-10-18T11:10:30.435307+0000","last_peered":"2023-10-18T11:10:30.435307+0000","last_clean":"2023-10-18T11:10:30.435307+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:10:30.435307+0000","last_undegraded":"2023-10-18T11:10:30.435307+0000","last_fullsized":"2023-10-18T11:10:30.435307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.418740+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:10:10.418740+0000","last_peered":"2023-10-18T11:10:10.418740+0000","last_clean":"2023-10-18T11:10:10.418740+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:10:10.418740+0000","last_undegraded":"2023-10-18T11:10:10.418740+0000","last_fullsized":"2023-10-18T11:10:10.418740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171728+0000","last_change":"2023-10-18T11:09:39.419862+0000","last_active":"2023-10-18T11:10:09.171728+0000","last_peered":"2023-10-18T11:10:09.171728+0000","last_clean":"2023-10-18T11:10:09.171728+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:10:09.171728+0000","last_undegraded":"2023-10-18T11:10:09.171728+0000","last_fullsized":"2023-10-18T11:10:09.171728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.411373+0000","last_change":"2023-10-18T11:09:36.912905+0000","last_active":"2023-10-18T11:10:10.411373+0000","last_peered":"2023-10-18T11:10:10.411373+0000","last_clean":"2023-10-18T11:10:10.411373+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:10:10.411373+0000","last_undegraded":"2023-10-18T11:10:10.411373+0000","last_fullsized":"2023-10-18T11:10:10.411373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177785+0000","last_change":"2023-10-18T11:09:46.097744+0000","last_active":"2023-10-18T11:10:09.177785+0000","last_peered":"2023-10-18T11:10:09.177785+0000","last_clean":"2023-10-18T11:10:09.177785+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:10:09.177785+0000","last_undegraded":"2023-10-18T11:10:09.177785+0000","last_fullsized":"2023-10-18T11:10:09.177785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:20.073279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167753+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:10:09.167753+0000","last_peered":"2023-10-18T11:10:09.167753+0000","last_clean":"2023-10-18T11:10:09.167753+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:10:09.167753+0000","last_undegraded":"2023-10-18T11:10:09.167753+0000","last_fullsized":"2023-10-18T11:10:09.167753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:51.220855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.384262+0000","last_change":"2023-10-18T11:09:36.907280+0000","last_active":"2023-10-18T11:10:10.384262+0000","last_peered":"2023-10-18T11:10:10.384262+0000","last_clean":"2023-10-18T11:10:10.384262+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:10:10.384262+0000","last_undegraded":"2023-10-18T11:10:10.384262+0000","last_fullsized":"2023-10-18T11:10:10.384262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171054+0000","last_change":"2023-10-18T11:09:46.096894+0000","last_active":"2023-10-18T11:10:09.171054+0000","last_peered":"2023-10-18T11:10:09.171054+0000","last_clean":"2023-10-18T11:10:09.171054+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:10:09.171054+0000","last_undegraded":"2023-10-18T11:10:09.171054+0000","last_fullsized":"2023-10-18T11:10:09.171054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167081+0000","last_change":"2023-10-18T11:09:39.399750+0000","last_active":"2023-10-18T11:10:09.167081+0000","last_peered":"2023-10-18T11:10:09.167081+0000","last_clean":"2023-10-18T11:10:09.167081+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:10:09.167081+0000","last_undegraded":"2023-10-18T11:10:09.167081+0000","last_fullsized":"2023-10-18T11:10:09.167081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:35.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.395042+0000","last_change":"2023-10-18T11:09:36.897906+0000","last_active":"2023-10-18T11:10:10.395042+0000","last_peered":"2023-10-18T11:10:10.395042+0000","last_clean":"2023-10-18T11:10:10.395042+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:10:10.395042+0000","last_undegraded":"2023-10-18T11:10:10.395042+0000","last_fullsized":"2023-10-18T11:10:10.395042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:41:27.304152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.168875+0000","last_change":"2023-10-18T11:09:46.109151+0000","last_active":"2023-10-18T11:10:09.168875+0000","last_peered":"2023-10-18T11:10:09.168875+0000","last_clean":"2023-10-18T11:10:09.168875+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:10:09.168875+0000","last_undegraded":"2023-10-18T11:10:09.168875+0000","last_fullsized":"2023-10-18T11:10:09.168875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:41.785820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166808+0000","last_change":"2023-10-18T11:09:39.397483+0000","last_active":"2023-10-18T11:10:09.166808+0000","last_peered":"2023-10-18T11:10:09.166808+0000","last_clean":"2023-10-18T11:10:09.166808+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:10:09.166808+0000","last_undegraded":"2023-10-18T11:10:09.166808+0000","last_fullsized":"2023-10-18T11:10:09.166808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'16","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.445318+0000","last_change":"2023-10-18T11:09:36.916080+0000","last_active":"2023-10-18T11:10:28.445318+0000","last_peered":"2023-10-18T11:10:28.445318+0000","last_clean":"2023-10-18T11:10:28.445318+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:10:28.445318+0000","last_undegraded":"2023-10-18T11:10:28.445318+0000","last_fullsized":"2023-10-18T11:10:28.445318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:22.058134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173831+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:10:09.173831+0000","last_peered":"2023-10-18T11:10:09.173831+0000","last_clean":"2023-10-18T11:10:09.173831+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:10:09.173831+0000","last_undegraded":"2023-10-18T11:10:09.173831+0000","last_fullsized":"2023-10-18T11:10:09.173831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164509+0000","last_change":"2023-10-18T11:09:39.358262+0000","last_active":"2023-10-18T11:10:09.164509+0000","last_peered":"2023-10-18T11:10:09.164509+0000","last_clean":"2023-10-18T11:10:09.164509+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:10:09.164509+0000","last_undegraded":"2023-10-18T11:10:09.164509+0000","last_fullsized":"2023-10-18T11:10:09.164509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.455697+0000","last_change":"2023-10-18T11:09:36.893045+0000","last_active":"2023-10-18T11:10:28.455697+0000","last_peered":"2023-10-18T11:10:28.455697+0000","last_clean":"2023-10-18T11:10:28.455697+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:10:28.455697+0000","last_undegraded":"2023-10-18T11:10:28.455697+0000","last_fullsized":"2023-10-18T11:10:28.455697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182137+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:10:09.182137+0000","last_peered":"2023-10-18T11:10:09.182137+0000","last_clean":"2023-10-18T11:10:09.182137+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:10:09.182137+0000","last_undegraded":"2023-10-18T11:10:09.182137+0000","last_fullsized":"2023-10-18T11:10:09.182137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:27.567970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167151+0000","last_change":"2023-10-18T11:09:39.399188+0000","last_active":"2023-10-18T11:10:09.167151+0000","last_peered":"2023-10-18T11:10:09.167151+0000","last_clean":"2023-10-18T11:10:09.167151+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:10:09.167151+0000","last_undegraded":"2023-10-18T11:10:09.167151+0000","last_fullsized":"2023-10-18T11:10:09.167151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'4","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.444753+0000","last_change":"2023-10-18T11:09:36.905576+0000","last_active":"2023-10-18T11:10:21.444753+0000","last_peered":"2023-10-18T11:10:21.444753+0000","last_clean":"2023-10-18T11:10:21.444753+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:10:21.444753+0000","last_undegraded":"2023-10-18T11:10:21.444753+0000","last_fullsized":"2023-10-18T11:10:21.444753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179319+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:10:09.179319+0000","last_peered":"2023-10-18T11:10:09.179319+0000","last_clean":"2023-10-18T11:10:09.179319+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:10:09.179319+0000","last_undegraded":"2023-10-18T11:10:09.179319+0000","last_fullsized":"2023-10-18T11:10:09.179319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:47.871773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.174065+0000","last_change":"2023-10-18T11:09:39.361805+0000","last_active":"2023-10-18T11:10:09.174065+0000","last_peered":"2023-10-18T11:10:09.174065+0000","last_clean":"2023-10-18T11:10:09.174065+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:10:09.174065+0000","last_undegraded":"2023-10-18T11:10:09.174065+0000","last_fullsized":"2023-10-18T11:10:09.174065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'7","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.453993+0000","last_change":"2023-10-18T11:09:36.894141+0000","last_active":"2023-10-18T11:10:28.453993+0000","last_peered":"2023-10-18T11:10:28.453993+0000","last_clean":"2023-10-18T11:10:28.453993+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:10:28.453993+0000","last_undegraded":"2023-10-18T11:10:28.453993+0000","last_fullsized":"2023-10-18T11:10:28.453993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171913+0000","last_change":"2023-10-18T11:09:46.114944+0000","last_active":"2023-10-18T11:10:09.171913+0000","last_peered":"2023-10-18T11:10:09.171913+0000","last_clean":"2023-10-18T11:10:09.171913+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:10:09.171913+0000","last_undegraded":"2023-10-18T11:10:09.171913+0000","last_fullsized":"2023-10-18T11:10:09.171913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166923+0000","last_change":"2023-10-18T11:09:39.420430+0000","last_active":"2023-10-18T11:10:09.166923+0000","last_peered":"2023-10-18T11:10:09.166923+0000","last_clean":"2023-10-18T11:10:09.166923+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:10:09.166923+0000","last_undegraded":"2023-10-18T11:10:09.166923+0000","last_fullsized":"2023-10-18T11:10:09.166923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:12.994704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.657711+0000","last_change":"2023-10-18T11:09:36.904648+0000","last_active":"2023-10-18T11:10:21.657711+0000","last_peered":"2023-10-18T11:10:21.657711+0000","last_clean":"2023-10-18T11:10:21.657711+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:10:21.657711+0000","last_undegraded":"2023-10-18T11:10:21.657711+0000","last_fullsized":"2023-10-18T11:10:21.657711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161456+0000","last_change":"2023-10-18T11:09:46.101866+0000","last_active":"2023-10-18T11:10:09.161456+0000","last_peered":"2023-10-18T11:10:09.161456+0000","last_clean":"2023-10-18T11:10:09.161456+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:10:09.161456+0000","last_undegraded":"2023-10-18T11:10:09.161456+0000","last_fullsized":"2023-10-18T11:10:09.161456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:41.150485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169443+0000","last_change":"2023-10-18T11:09:39.398597+0000","last_active":"2023-10-18T11:10:09.169443+0000","last_peered":"2023-10-18T11:10:09.169443+0000","last_clean":"2023-10-18T11:10:09.169443+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:10:09.169443+0000","last_undegraded":"2023-10-18T11:10:09.169443+0000","last_fullsized":"2023-10-18T11:10:09.169443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:10.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.678209+0000","last_change":"2023-10-18T11:09:36.913285+0000","last_active":"2023-10-18T11:10:21.678209+0000","last_peered":"2023-10-18T11:10:21.678209+0000","last_clean":"2023-10-18T11:10:21.678209+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:10:21.678209+0000","last_undegraded":"2023-10-18T11:10:21.678209+0000","last_fullsized":"2023-10-18T11:10:21.678209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169273+0000","last_change":"2023-10-18T11:09:46.094205+0000","last_active":"2023-10-18T11:10:09.169273+0000","last_peered":"2023-10-18T11:10:09.169273+0000","last_clean":"2023-10-18T11:10:09.169273+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:10:09.169273+0000","last_undegraded":"2023-10-18T11:10:09.169273+0000","last_fullsized":"2023-10-18T11:10:09.169273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:13.509608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.176274+0000","last_change":"2023-10-18T11:09:39.363739+0000","last_active":"2023-10-18T11:10:09.176274+0000","last_peered":"2023-10-18T11:10:09.176274+0000","last_clean":"2023-10-18T11:10:09.176274+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:10:09.176274+0000","last_undegraded":"2023-10-18T11:10:09.176274+0000","last_fullsized":"2023-10-18T11:10:09.176274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:52.069782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.434643+0000","last_change":"2023-10-18T11:09:36.896767+0000","last_active":"2023-10-18T11:10:21.434643+0000","last_peered":"2023-10-18T11:10:21.434643+0000","last_clean":"2023-10-18T11:10:21.434643+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:10:21.434643+0000","last_undegraded":"2023-10-18T11:10:21.434643+0000","last_fullsized":"2023-10-18T11:10:21.434643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178440+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:10:09.178440+0000","last_peered":"2023-10-18T11:10:09.178440+0000","last_clean":"2023-10-18T11:10:09.178440+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:10:09.178440+0000","last_undegraded":"2023-10-18T11:10:09.178440+0000","last_fullsized":"2023-10-18T11:10:09.178440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.172124+0000","last_change":"2023-10-18T11:09:39.351468+0000","last_active":"2023-10-18T11:10:09.172124+0000","last_peered":"2023-10-18T11:10:09.172124+0000","last_clean":"2023-10-18T11:10:09.172124+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:10:09.172124+0000","last_undegraded":"2023-10-18T11:10:09.172124+0000","last_fullsized":"2023-10-18T11:10:09.172124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.664449+0000","last_change":"2023-10-18T11:09:36.896596+0000","last_active":"2023-10-18T11:10:21.664449+0000","last_peered":"2023-10-18T11:10:21.664449+0000","last_clean":"2023-10-18T11:10:21.664449+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:10:21.664449+0000","last_undegraded":"2023-10-18T11:10:21.664449+0000","last_fullsized":"2023-10-18T11:10:21.664449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179254+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:10:09.179254+0000","last_peered":"2023-10-18T11:10:09.179254+0000","last_clean":"2023-10-18T11:10:09.179254+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:10:09.179254+0000","last_undegraded":"2023-10-18T11:10:09.179254+0000","last_fullsized":"2023-10-18T11:10:09.179254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.417214+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:10:10.417214+0000","last_peered":"2023-10-18T11:10:10.417214+0000","last_clean":"2023-10-18T11:10:10.417214+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:10:10.417214+0000","last_undegraded":"2023-10-18T11:10:10.417214+0000","last_fullsized":"2023-10-18T11:10:10.417214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:09.785576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161029+0000","last_change":"2023-10-18T11:09:39.418416+0000","last_active":"2023-10-18T11:10:09.161029+0000","last_peered":"2023-10-18T11:10:09.161029+0000","last_clean":"2023-10-18T11:10:09.161029+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:10:09.161029+0000","last_undegraded":"2023-10-18T11:10:09.161029+0000","last_fullsized":"2023-10-18T11:10:09.161029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.442768+0000","last_change":"2023-10-18T11:09:36.893158+0000","last_active":"2023-10-18T11:10:21.442768+0000","last_peered":"2023-10-18T11:10:21.442768+0000","last_clean":"2023-10-18T11:10:21.442768+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:10:21.442768+0000","last_undegraded":"2023-10-18T11:10:21.442768+0000","last_fullsized":"2023-10-18T11:10:21.442768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164789+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:10:09.164789+0000","last_peered":"2023-10-18T11:10:09.164789+0000","last_clean":"2023-10-18T11:10:09.164789+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:10:09.164789+0000","last_undegraded":"2023-10-18T11:10:09.164789+0000","last_fullsized":"2023-10-18T11:10:09.164789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178550+0000","last_change":"2023-10-18T11:09:39.421160+0000","last_active":"2023-10-18T11:10:09.178550+0000","last_peered":"2023-10-18T11:10:09.178550+0000","last_clean":"2023-10-18T11:10:09.178550+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:10:09.178550+0000","last_undegraded":"2023-10-18T11:10:09.178550+0000","last_fullsized":"2023-10-18T11:10:09.178550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.313822+0000","last_change":"2023-10-18T11:09:36.911629+0000","last_active":"2023-10-18T11:10:28.313822+0000","last_peered":"2023-10-18T11:10:28.313822+0000","last_clean":"2023-10-18T11:10:28.313822+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:10:28.313822+0000","last_undegraded":"2023-10-18T11:10:28.313822+0000","last_fullsized":"2023-10-18T11:10:28.313822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:53.929992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:28.454238+0000","last_change":"2023-10-18T11:09:36.894351+0000","last_active":"2023-10-18T11:10:28.454238+0000","last_peered":"2023-10-18T11:10:28.454238+0000","last_clean":"2023-10-18T11:10:28.454238+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:10:28.454238+0000","last_undegraded":"2023-10-18T11:10:28.454238+0000","last_fullsized":"2023-10-18T11:10:28.454238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:11.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.180784+0000","last_change":"2023-10-18T11:09:39.404508+0000","last_active":"2023-10-18T11:10:09.180784+0000","last_peered":"2023-10-18T11:10:09.180784+0000","last_clean":"2023-10-18T11:10:09.180784+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:10:09.180784+0000","last_undegraded":"2023-10-18T11:10:09.180784+0000","last_fullsized":"2023-10-18T11:10:09.180784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144886+0000","last_change":"2023-10-18T11:09:46.117246+0000","last_active":"2023-10-18T11:10:09.144886+0000","last_peered":"2023-10-18T11:10:09.144886+0000","last_clean":"2023-10-18T11:10:09.144886+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:10:09.144886+0000","last_undegraded":"2023-10-18T11:10:09.144886+0000","last_fullsized":"2023-10-18T11:10:09.144886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:59.808082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:21.474878+0000","last_change":"2023-10-18T11:09:36.912013+0000","last_active":"2023-10-18T11:10:21.474878+0000","last_peered":"2023-10-18T11:10:21.474878+0000","last_clean":"2023-10-18T11:10:21.474878+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:10:21.474878+0000","last_undegraded":"2023-10-18T11:10:21.474878+0000","last_fullsized":"2023-10-18T11:10:21.474878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:49.950001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169156+0000","last_change":"2023-10-18T11:09:39.400362+0000","last_active":"2023-10-18T11:10:09.169156+0000","last_peered":"2023-10-18T11:10:09.169156+0000","last_clean":"2023-10-18T11:10:09.169156+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:10:09.169156+0000","last_undegraded":"2023-10-18T11:10:09.169156+0000","last_fullsized":"2023-10-18T11:10:09.169156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:50.136754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182239+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:10:09.182239+0000","last_peered":"2023-10-18T11:10:09.182239+0000","last_clean":"2023-10-18T11:10:09.182239+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:10:09.182239+0000","last_undegraded":"2023-10-18T11:10:09.182239+0000","last_fullsized":"2023-10-18T11:10:09.182239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:52:09.414015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164430+0000","last_change":"2023-10-18T11:09:39.359747+0000","last_active":"2023-10-18T11:10:09.164430+0000","last_peered":"2023-10-18T11:10:09.164430+0000","last_clean":"2023-10-18T11:10:09.164430+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:10:09.164430+0000","last_undegraded":"2023-10-18T11:10:09.164430+0000","last_fullsized":"2023-10-18T11:10:09.164430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.144846+0000","last_change":"2023-10-18T11:09:39.242600+0000","last_active":"2023-10-18T11:10:09.144846+0000","last_peered":"2023-10-18T11:10:09.144846+0000","last_clean":"2023-10-18T11:10:09.144846+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:10:09.144846+0000","last_undegraded":"2023-10-18T11:10:09.144846+0000","last_fullsized":"2023-10-18T11:10:09.144846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:45.076093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.419036+0000","last_change":"2023-10-18T11:10:10.416758+0000","last_active":"2023-10-18T11:10:10.419036+0000","last_peered":"2023-10-18T11:10:10.419036+0000","last_clean":"2023-10-18T11:10:10.419036+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:10:10.419036+0000","last_undegraded":"2023-10-18T11:10:10.419036+0000","last_fullsized":"2023-10-18T11:10:10.419036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177879+0000","last_change":"2023-10-18T11:09:39.425505+0000","last_active":"2023-10-18T11:10:09.177879+0000","last_peered":"2023-10-18T11:10:09.177879+0000","last_clean":"2023-10-18T11:10:09.177879+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:10:09.177879+0000","last_undegraded":"2023-10-18T11:10:09.177879+0000","last_fullsized":"2023-10-18T11:10:09.177879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179456+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:10:09.179456+0000","last_peered":"2023-10-18T11:10:09.179456+0000","last_clean":"2023-10-18T11:10:09.179456+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:10:09.179456+0000","last_undegraded":"2023-10-18T11:10:09.179456+0000","last_fullsized":"2023-10-18T11:10:09.179456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.162742+0000","last_change":"2023-10-18T11:09:39.423043+0000","last_active":"2023-10-18T11:10:09.162742+0000","last_peered":"2023-10-18T11:10:09.162742+0000","last_clean":"2023-10-18T11:10:09.162742+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:10:09.162742+0000","last_undegraded":"2023-10-18T11:10:09.162742+0000","last_fullsized":"2023-10-18T11:10:09.162742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165107+0000","last_change":"2023-10-18T11:09:39.351604+0000","last_active":"2023-10-18T11:10:09.165107+0000","last_peered":"2023-10-18T11:10:09.165107+0000","last_clean":"2023-10-18T11:10:09.165107+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:10:09.165107+0000","last_undegraded":"2023-10-18T11:10:09.165107+0000","last_fullsized":"2023-10-18T11:10:09.165107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.182241+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:10:09.182241+0000","last_peered":"2023-10-18T11:10:09.182241+0000","last_clean":"2023-10-18T11:10:09.182241+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:10:09.182241+0000","last_undegraded":"2023-10-18T11:10:09.182241+0000","last_fullsized":"2023-10-18T11:10:09.182241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171269+0000","last_change":"2023-10-18T11:09:39.419909+0000","last_active":"2023-10-18T11:10:09.171269+0000","last_peered":"2023-10-18T11:10:09.171269+0000","last_clean":"2023-10-18T11:10:09.171269+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:10:09.171269+0000","last_undegraded":"2023-10-18T11:10:09.171269+0000","last_fullsized":"2023-10-18T11:10:09.171269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.179397+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:10:09.179397+0000","last_peered":"2023-10-18T11:10:09.179397+0000","last_clean":"2023-10-18T11:10:09.179397+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:10:09.179397+0000","last_undegraded":"2023-10-18T11:10:09.179397+0000","last_fullsized":"2023-10-18T11:10:09.179397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171348+0000","last_change":"2023-10-18T11:09:39.349250+0000","last_active":"2023-10-18T11:10:09.171348+0000","last_peered":"2023-10-18T11:10:09.171348+0000","last_clean":"2023-10-18T11:10:09.171348+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:10:09.171348+0000","last_undegraded":"2023-10-18T11:10:09.171348+0000","last_fullsized":"2023-10-18T11:10:09.171348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.177703+0000","last_change":"2023-10-18T11:09:39.361414+0000","last_active":"2023-10-18T11:10:09.177703+0000","last_peered":"2023-10-18T11:10:09.177703+0000","last_clean":"2023-10-18T11:10:09.177703+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:10:09.177703+0000","last_undegraded":"2023-10-18T11:10:09.177703+0000","last_fullsized":"2023-10-18T11:10:09.177703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164861+0000","last_change":"2023-10-18T11:09:39.399067+0000","last_active":"2023-10-18T11:10:09.164861+0000","last_peered":"2023-10-18T11:10:09.164861+0000","last_clean":"2023-10-18T11:10:09.164861+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:10:09.164861+0000","last_undegraded":"2023-10-18T11:10:09.164861+0000","last_fullsized":"2023-10-18T11:10:09.164861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167183+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:10:09.167183+0000","last_peered":"2023-10-18T11:10:09.167183+0000","last_clean":"2023-10-18T11:10:09.167183+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:10:09.167183+0000","last_undegraded":"2023-10-18T11:10:09.167183+0000","last_fullsized":"2023-10-18T11:10:09.167183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:04.730798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.145690+0000","last_change":"2023-10-18T11:09:39.320727+0000","last_active":"2023-10-18T11:10:09.145690+0000","last_peered":"2023-10-18T11:10:09.145690+0000","last_clean":"2023-10-18T11:10:09.145690+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:10:09.145690+0000","last_undegraded":"2023-10-18T11:10:09.145690+0000","last_fullsized":"2023-10-18T11:10:09.145690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.407850+0000","last_change":"2023-10-18T11:10:10.401580+0000","last_active":"2023-10-18T11:10:10.407850+0000","last_peered":"2023-10-18T11:10:10.407850+0000","last_clean":"2023-10-18T11:10:10.407850+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:10:10.407850+0000","last_undegraded":"2023-10-18T11:10:10.407850+0000","last_fullsized":"2023-10-18T11:10:10.407850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171150+0000","last_change":"2023-10-18T11:09:39.354336+0000","last_active":"2023-10-18T11:10:09.171150+0000","last_peered":"2023-10-18T11:10:09.171150+0000","last_clean":"2023-10-18T11:10:09.171150+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:10:09.171150+0000","last_undegraded":"2023-10-18T11:10:09.171150+0000","last_fullsized":"2023-10-18T11:10:09.171150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.161257+0000","last_change":"2023-10-18T11:09:39.401976+0000","last_active":"2023-10-18T11:10:09.161257+0000","last_peered":"2023-10-18T11:10:09.161257+0000","last_clean":"2023-10-18T11:10:09.161257+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:10:09.161257+0000","last_undegraded":"2023-10-18T11:10:09.161257+0000","last_fullsized":"2023-10-18T11:10:09.161257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.173957+0000","last_change":"2023-10-18T11:09:39.366222+0000","last_active":"2023-10-18T11:10:09.173957+0000","last_peered":"2023-10-18T11:10:09.173957+0000","last_clean":"2023-10-18T11:10:09.173957+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:10:09.173957+0000","last_undegraded":"2023-10-18T11:10:09.173957+0000","last_fullsized":"2023-10-18T11:10:09.173957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:52.729507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.415418+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:10:10.415418+0000","last_peered":"2023-10-18T11:10:10.415418+0000","last_clean":"2023-10-18T11:10:10.415418+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:10:10.415418+0000","last_undegraded":"2023-10-18T11:10:10.415418+0000","last_fullsized":"2023-10-18T11:10:10.415418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:37:38.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.169371+0000","last_change":"2023-10-18T11:09:39.400563+0000","last_active":"2023-10-18T11:10:09.169371+0000","last_peered":"2023-10-18T11:10:09.169371+0000","last_clean":"2023-10-18T11:10:09.169371+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:10:09.169371+0000","last_undegraded":"2023-10-18T11:10:09.169371+0000","last_fullsized":"2023-10-18T11:10:09.169371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:24.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.164720+0000","last_change":"2023-10-18T11:09:39.320580+0000","last_active":"2023-10-18T11:10:09.164720+0000","last_peered":"2023-10-18T11:10:09.164720+0000","last_clean":"2023-10-18T11:10:09.164720+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:10:09.164720+0000","last_undegraded":"2023-10-18T11:10:09.164720+0000","last_fullsized":"2023-10-18T11:10:09.164720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.165013+0000","last_change":"2023-10-18T11:09:39.320508+0000","last_active":"2023-10-18T11:10:09.165013+0000","last_peered":"2023-10-18T11:10:09.165013+0000","last_clean":"2023-10-18T11:10:09.165013+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:10:09.165013+0000","last_undegraded":"2023-10-18T11:10:09.165013+0000","last_fullsized":"2023-10-18T11:10:09.165013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.167124+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:10:09.167124+0000","last_peered":"2023-10-18T11:10:09.167124+0000","last_clean":"2023-10-18T11:10:09.167124+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:10:09.167124+0000","last_undegraded":"2023-10-18T11:10:09.167124+0000","last_fullsized":"2023-10-18T11:10:09.167124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:11.432343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.178301+0000","last_change":"2023-10-18T11:09:39.421921+0000","last_active":"2023-10-18T11:10:09.178301+0000","last_peered":"2023-10-18T11:10:09.178301+0000","last_clean":"2023-10-18T11:10:09.178301+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:10:09.178301+0000","last_undegraded":"2023-10-18T11:10:09.178301+0000","last_fullsized":"2023-10-18T11:10:09.178301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166717+0000","last_change":"2023-10-18T11:09:39.360846+0000","last_active":"2023-10-18T11:10:09.166717+0000","last_peered":"2023-10-18T11:10:09.166717+0000","last_clean":"2023-10-18T11:10:09.166717+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:10:09.166717+0000","last_undegraded":"2023-10-18T11:10:09.166717+0000","last_fullsized":"2023-10-18T11:10:09.166717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:10:10.417103+0000","last_change":"2023-10-18T11:10:10.413563+0000","last_active":"2023-10-18T11:10:10.417103+0000","last_peered":"2023-10-18T11:10:10.417103+0000","last_clean":"2023-10-18T11:10:10.417103+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:10:10.417103+0000","last_undegraded":"2023-10-18T11:10:10.417103+0000","last_fullsized":"2023-10-18T11:10:10.417103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:43.078216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166677+0000","last_change":"2023-10-18T11:09:39.355047+0000","last_active":"2023-10-18T11:10:09.166677+0000","last_peered":"2023-10-18T11:10:09.166677+0000","last_clean":"2023-10-18T11:10:09.166677+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:10:09.166677+0000","last_undegraded":"2023-10-18T11:10:09.166677+0000","last_fullsized":"2023-10-18T11:10:09.166677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.171566+0000","last_change":"2023-10-18T11:09:39.418362+0000","last_active":"2023-10-18T11:10:09.171566+0000","last_peered":"2023-10-18T11:10:09.171566+0000","last_clean":"2023-10-18T11:10:09.171566+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:10:09.171566+0000","last_undegraded":"2023-10-18T11:10:09.171566+0000","last_fullsized":"2023-10-18T11:10:09.171566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.175529+0000","last_change":"2023-10-18T11:09:39.363750+0000","last_active":"2023-10-18T11:10:09.175529+0000","last_peered":"2023-10-18T11:10:09.175529+0000","last_clean":"2023-10-18T11:10:09.175529+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:10:09.175529+0000","last_undegraded":"2023-10-18T11:10:09.175529+0000","last_fullsized":"2023-10-18T11:10:09.175529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:43.536873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.163609+0000","last_change":"2023-10-18T11:09:39.363259+0000","last_active":"2023-10-18T11:10:09.163609+0000","last_peered":"2023-10-18T11:10:09.163609+0000","last_clean":"2023-10-18T11:10:09.163609+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:10:09.163609+0000","last_undegraded":"2023-10-18T11:10:09.163609+0000","last_fullsized":"2023-10-18T11:10:09.163609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-18T11:10:09.166784+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:10:09.166784+0000","last_peered":"2023-10-18T11:10:09.166784+0000","last_clean":"2023-10-18T11:10:09.166784+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:10:09.166784+0000","last_undegraded":"2023-10-18T11:10:09.166784+0000","last_fullsized":"2023-10-18T11:10:09.166784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:34.071910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8745,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":17602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":421888,"data_stored":726556,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.374},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.754}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.432}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32900000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.38700000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":136228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.39400000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.52800000000000002}]},{"osd":3,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.86199999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34100000000000003}]},{"osd":6,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.38},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35499999999999998}]},{"osd":7,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.37},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32500000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.57099999999999995}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.69799999999999995}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41399999999999998}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55800000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":139493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.802},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.5219999999999998,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":2.0209999999999999}]},{"osd":1,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.8839999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":3.1080000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.6019999999999999,"5min":3.6019999999999999,"15min":3.6019999999999999},"last":1.921}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.81299999999999994}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":1.8340000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.109}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":3.633,"5min":3.633,"15min":3.633},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":3.661,"5min":3.661,"15min":3.661},"last":1.7569999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.84899999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.383}]},{"osd":1,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.4970000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"last":1.085}]},{"osd":4,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":1.026},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.556,"5min":3.556,"15min":3.556},"last":1.1499999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":1.2210000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.7069999999999999,"5min":3.7069999999999999,"15min":3.7069999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":4.0209999999999999,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":1.5980000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":1.4590000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":135794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.339},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":1.1080000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.04},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.9590000000000001,"5min":2.9590000000000001,"15min":2.9590000000000001},"last":1.077}]},{"osd":4,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.163},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":0.745}]},{"osd":5,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.2789999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":3.2040000000000002,"5min":3.2040000000000002,"15min":3.2040000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.998}]},{"osd":7,"last update":"Wed Oct 18 11:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.135},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.7330000000000001,"5min":2.7330000000000001,"15min":2.7330000000000001},"last":1.6399999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":725912,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.90300000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.3799999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":2.0289999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2709999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.9039999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.9550000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.93600000000000005}]},{"osd":6,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.98599999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.024},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.9910000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":139369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.52300000000000002}]},{"osd":1,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":2.1259999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.59999999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.41399999999999998}]},{"osd":3,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.9870000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.46700000000000003}]},{"osd":5,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:10:34.520 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-18T11:10:34.520 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-18T11:10:34.521 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-18T11:10:34.521 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T11:10:34.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.769+0000 7f231b755640 1 Processor -- start 2023-10-18T11:10:34.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.769+0000 7f231b755640 1 -- start start 2023-10-18T11:10:34.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.771+0000 7f231b755640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231406f280 0x7f23140c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:34.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.771+0000 7f231b755640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23140c7fa0 con 0x7f23140c50e0 2023-10-18T11:10:34.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.771+0000 7f231b755640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23140c8cd0 con 0x7f231414d690 2023-10-18T11:10:34.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.771+0000 7f231b755640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23140c6330 con 0x7f231406f280 2023-10-18T11:10:34.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.772+0000 7f2318cf0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231406f280 0x7f23140c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:34.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.772+0000 7f23194f1640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f231414d690 0x7f2314156c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50128/0 (socket says 172.21.15.151:50128) 2023-10-18T11:10:34.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.772+0000 7f23194f1640 1 -- 172.21.15.151:0/1916674285 learned_addr learned my addr 172.21.15.151:0/1916674285 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:34.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.775+0000 7f2318cf0640 1 -- 172.21.15.151:0/1916674285 >> v1:172.21.15.169:6789/0 conn(0x7f231414d690 legacy=0x7f2314156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:34.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.775+0000 7f2318cf0640 1 -- 172.21.15.151:0/1916674285 >> v1:172.21.15.151:6789/0 conn(0x7f23140c50e0 legacy=0x7f2314161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:34.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.775+0000 7f2318cf0640 1 -- 172.21.15.151:0/1916674285 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23140c6610 con 0x7f231406f280 2023-10-18T11:10:34.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.780+0000 7f2318cf0640 1 --2- 172.21.15.151:0/1916674285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231406f280 0x7f23140c4ba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f23040097d0 tx=0x7f230402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d212342689f62e99 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:34.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.786+0000 7f230bfff640 1 -- 172.21.15.151:0/1916674285 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304031890 con 0x7f231406f280 2023-10-18T11:10:34.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.786+0000 7f230bfff640 1 -- 172.21.15.151:0/1916674285 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23040319f0 con 0x7f231406f280 2023-10-18T11:10:34.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.786+0000 7f230bfff640 1 -- 172.21.15.151:0/1916674285 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304031d80 con 0x7f231406f280 2023-10-18T11:10:34.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.787+0000 7f231b755640 1 -- 172.21.15.151:0/1916674285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231406f280 msgr2=0x7f23140c4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:34.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.787+0000 7f231b755640 1 --2- 172.21.15.151:0/1916674285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231406f280 0x7f23140c4ba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f23040097d0 tx=0x7f230402b930 comp rx=0 tx=0).stop 2023-10-18T11:10:34.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.787+0000 7f231b755640 1 -- 172.21.15.151:0/1916674285 shutdown_connections 2023-10-18T11:10:34.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.787+0000 7f231b755640 1 --2- 172.21.15.151:0/1916674285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231406f280 0x7f23140c4ba0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:34.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.787+0000 7f231b755640 1 -- 172.21.15.151:0/1916674285 >> 172.21.15.151:0/1916674285 conn(0x7f231406cbf0 msgr2=0x7f231406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:34.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.788+0000 7f231b755640 1 -- 172.21.15.151:0/1916674285 shutdown_connections 2023-10-18T11:10:34.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.788+0000 7f231b755640 1 -- 172.21.15.151:0/1916674285 wait complete. 2023-10-18T11:10:34.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.790+0000 7f231b755640 1 Processor -- start 2023-10-18T11:10:34.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.790+0000 7f231b755640 1 -- start start 2023-10-18T11:10:34.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.791+0000 7f231b755640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f231406f280 0x7f231406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:34.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.791+0000 7f231b755640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23140c50e0 0x7f23140c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:34.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.791+0000 7f231b755640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231414d690 0x7f23141527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:34.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.791+0000 7f231b755640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2314151bd0 con 0x7f23140c50e0 2023-10-18T11:10:34.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.791+0000 7f231b755640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23140ca7b0 con 0x7f231406f280 2023-10-18T11:10:34.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.791+0000 7f231b755640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23141515c0 con 0x7f231414d690 2023-10-18T11:10:34.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.792+0000 7f23194f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f231406f280 0x7f231406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:34.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.792+0000 7f2319cf2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231414d690 0x7f23141527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:34.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.792+0000 7f23194f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f231406f280 0x7f231406a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:39086/0 (socket says 172.21.15.151:39086) 2023-10-18T11:10:34.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.792+0000 7f2319cf2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231414d690 0x7f23141527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57544/0 (socket says 172.21.15.151:57544) 2023-10-18T11:10:34.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.792+0000 7f23194f1640 1 -- 172.21.15.151:0/2663079404 learned_addr learned my addr 172.21.15.151:0/2663079404 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:34.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.795+0000 7f2319cf2640 1 -- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f231406f280 msgr2=0x7f231406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:34.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.796+0000 7f2319cf2640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f231406f280 0x7f231406a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:34.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.796+0000 7f2319cf2640 1 -- 172.21.15.151:0/2663079404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23140c50e0 msgr2=0x7f23140c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:34.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.796+0000 7f2319cf2640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23140c50e0 0x7f23140c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:34.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.796+0000 7f2319cf2640 1 -- 172.21.15.151:0/2663079404 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304009400 con 0x7f231414d690 2023-10-18T11:10:34.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.796+0000 7f23194f1640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f231406f280 0x7f231406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:34.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.798+0000 7f2319cf2640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231414d690 0x7f23141527c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f230c00c780 tx=0x7f230c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:34.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.802+0000 7f2309ffb640 1 -- 172.21.15.151:0/2663079404 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c003b70 con 0x7f231414d690 2023-10-18T11:10:34.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.802+0000 7f2309ffb640 1 -- 172.21.15.151:0/2663079404 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c003cf0 con 0x7f231414d690 2023-10-18T11:10:34.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.802+0000 7f2309ffb640 1 -- 172.21.15.151:0/2663079404 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c003ea0 con 0x7f231414d690 2023-10-18T11:10:34.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.802+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23141ef2f0 con 0x7f231414d690 2023-10-18T11:10:34.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.802+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23141ef5d0 con 0x7f231414d690 2023-10-18T11:10:34.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.804+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231406f710 con 0x7f231414d690 2023-10-18T11:10:34.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.834+0000 7f2309ffb640 1 -- 172.21.15.151:0/2663079404 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f230c0052b0 con 0x7f231414d690 2023-10-18T11:10:34.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.836+0000 7f2309ffb640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f22f806aef0 0x7f22f806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:34.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.836+0000 7f23194f1640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f22f806aef0 0x7f22f806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:34.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.837+0000 7f23194f1640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f22f806aef0 0x7f22f806d3b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2310005880 tx=0x7f2310009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:34.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:34.838+0000 7f2309ffb640 1 -- 172.21.15.151:0/2663079404 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f230c013e70 con 0x7f231414d690 2023-10-18T11:10:35.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.080+0000 7f2309ffb640 1 -- 172.21.15.151:0/2663079404 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f230c054370 con 0x7f231414d690 2023-10-18T11:10:35.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.322+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f231414c5f0 con 0x7f231414d690 2023-10-18T11:10:35.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.327+0000 7f2309ffb640 1 -- 172.21.15.151:0/2663079404 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f230c017040 con 0x7f231414d690 2023-10-18T11:10:35.330 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:35.330 INFO:teuthology.orchestra.run.smithi151.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-18T11:10:35.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f22f806aef0 msgr2=0x7f22f806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:35.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f22f806aef0 0x7f22f806d3b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2310005880 tx=0x7f2310009040 comp rx=0 tx=0).stop 2023-10-18T11:10:35.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231414d690 msgr2=0x7f23141527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:35.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231414d690 0x7f23141527c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f230c00c780 tx=0x7f230c00cc40 comp rx=0 tx=0).stop 2023-10-18T11:10:35.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 shutdown_connections 2023-10-18T11:10:35.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f231414d690 0x7f23141527c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:35.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23140c50e0 0x7f23140c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:35.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f22f806aef0 0x7f22f806d3b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:35.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 --2- 172.21.15.151:0/2663079404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f231406f280 0x7f231406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:35.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 >> 172.21.15.151:0/2663079404 conn(0x7f231406cbf0 msgr2=0x7f23141483b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:35.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 shutdown_connections 2023-10-18T11:10:35.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.330+0000 7f231b755640 1 -- 172.21.15.151:0/2663079404 wait complete. 2023-10-18T11:10:35.350 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-18T11:10:35.351 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:10:35.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.557+0000 7fbcb0690640 1 Processor -- start 2023-10-18T11:10:35.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.557+0000 7fbcb0690640 1 -- start start 2023-10-18T11:10:35.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.559+0000 7fbcb0690640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbca80c8a90 0x7fbca8071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:35.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.559+0000 7fbcb0690640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca80c7da0 con 0x7fbca80c4e20 2023-10-18T11:10:35.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.559+0000 7fbcb0690640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca8071e40 con 0x7fbca80c5200 2023-10-18T11:10:35.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.559+0000 7fbcb0690640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca815aac0 con 0x7fbca80c8a90 2023-10-18T11:10:35.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.560+0000 7fbcae42c640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fbca80c4e20 0x7fbca815a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54904/0 (socket says 172.21.15.151:54904) 2023-10-18T11:10:35.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.560+0000 7fbcae42c640 1 -- 172.21.15.151:0/395309562 learned_addr learned my addr 172.21.15.151:0/395309562 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:35.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.560+0000 7fbcaec2d640 1 --2- 172.21.15.151:0/395309562 >> v2:172.21.15.169:3300/0 conn(0x7fbca80c8a90 0x7fbca8071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:35.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.564+0000 7fbcad42a640 1 -- 172.21.15.151:0/395309562 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392268897 0 0) 0x7fbca80c7da0 con 0x7fbca80c4e20 2023-10-18T11:10:35.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.564+0000 7fbcad42a640 1 -- 172.21.15.151:0/395309562 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc94003520 con 0x7fbca80c4e20 2023-10-18T11:10:35.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.565+0000 7fbcaec2d640 1 -- 172.21.15.151:0/395309562 >> v1:172.21.15.169:6789/0 conn(0x7fbca80c5200 legacy=0x7fbca8150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:35.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.565+0000 7fbcaec2d640 1 -- 172.21.15.151:0/395309562 >> v1:172.21.15.151:6789/0 conn(0x7fbca80c4e20 legacy=0x7fbca815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:35.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.565+0000 7fbcaec2d640 1 -- 172.21.15.151:0/395309562 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8156f50 con 0x7fbca80c8a90 2023-10-18T11:10:35.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.569+0000 7fbcaec2d640 1 --2- 172.21.15.151:0/395309562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c8a90 0x7fbca8071900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbca00097d0 tx=0x7fbca002b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c06d36e502ac6311 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:35.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.572+0000 7fbcad42a640 1 -- 172.21.15.151:0/395309562 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0030890 con 0x7fbca80c8a90 2023-10-18T11:10:35.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.572+0000 7fbcad42a640 1 -- 172.21.15.151:0/395309562 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00309f0 con 0x7fbca80c8a90 2023-10-18T11:10:35.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.572+0000 7fbcad42a640 1 -- 172.21.15.151:0/395309562 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0030d80 con 0x7fbca80c8a90 2023-10-18T11:10:35.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.573+0000 7fbcb0690640 1 -- 172.21.15.151:0/395309562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c8a90 msgr2=0x7fbca8071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:35.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.573+0000 7fbcb0690640 1 --2- 172.21.15.151:0/395309562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c8a90 0x7fbca8071900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbca00097d0 tx=0x7fbca002b9d0 comp rx=0 tx=0).stop 2023-10-18T11:10:35.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.573+0000 7fbcb0690640 1 -- 172.21.15.151:0/395309562 shutdown_connections 2023-10-18T11:10:35.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.573+0000 7fbcb0690640 1 --2- 172.21.15.151:0/395309562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c8a90 0x7fbca8071900 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:35.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.573+0000 7fbcb0690640 1 -- 172.21.15.151:0/395309562 >> 172.21.15.151:0/395309562 conn(0x7fbca806aea0 msgr2=0x7fbca806b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:35.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.573+0000 7fbcb0690640 1 -- 172.21.15.151:0/395309562 shutdown_connections 2023-10-18T11:10:35.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.573+0000 7fbcb0690640 1 -- 172.21.15.151:0/395309562 wait complete. 2023-10-18T11:10:35.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.575+0000 7fbcb0690640 1 Processor -- start 2023-10-18T11:10:35.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.575+0000 7fbcb0690640 1 -- start start 2023-10-18T11:10:35.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.576+0000 7fbcb0690640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbca80c4e20 0x7fbca81f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:35.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.576+0000 7fbcb0690640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c5200 0x7fbca8157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:35.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.576+0000 7fbcb0690640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca80c8a90 0x7fbca80bd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:35.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.576+0000 7fbcb0690640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca8158640 con 0x7fbca80c8a90 2023-10-18T11:10:35.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.576+0000 7fbcb0690640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca815a170 con 0x7fbca80c5200 2023-10-18T11:10:35.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.576+0000 7fbcb0690640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca81ee630 con 0x7fbca80c4e20 2023-10-18T11:10:35.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.577+0000 7fbcaec2d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca80c8a90 0x7fbca80bd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:35.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.577+0000 7fbcae42c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbca80c4e20 0x7fbca81f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:35.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.577+0000 7fbcadc2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c5200 0x7fbca8157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:35.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.577+0000 7fbcadc2b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c5200 0x7fbca8157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:39114/0 (socket says 172.21.15.151:39114) 2023-10-18T11:10:35.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.577+0000 7fbcadc2b640 1 -- 172.21.15.151:0/2445808385 learned_addr learned my addr 172.21.15.151:0/2445808385 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:35.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.580+0000 7fbcadc2b640 1 -- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbca80c4e20 msgr2=0x7fbca81f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:35.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.580+0000 7fbcadc2b640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbca80c4e20 0x7fbca81f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:35.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.580+0000 7fbcadc2b640 1 -- 172.21.15.151:0/2445808385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca80c8a90 msgr2=0x7fbca80bd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:35.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.580+0000 7fbcadc2b640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca80c8a90 0x7fbca80bd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:35.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.580+0000 7fbcadc2b640 1 -- 172.21.15.151:0/2445808385 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009400 con 0x7fbca80c5200 2023-10-18T11:10:35.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.583+0000 7fbcadc2b640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c5200 0x7fbca8157fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800c450 tx=0x7fbc9800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:35.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.586+0000 7fbc9effd640 1 -- 172.21.15.151:0/2445808385 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc980052d0 con 0x7fbca80c5200 2023-10-18T11:10:35.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.587+0000 7fbc9effd640 1 -- 172.21.15.151:0/2445808385 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98005430 con 0x7fbca80c5200 2023-10-18T11:10:35.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.587+0000 7fbc9effd640 1 -- 172.21.15.151:0/2445808385 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98012870 con 0x7fbca80c5200 2023-10-18T11:10:35.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.587+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca81ee8f0 con 0x7fbca80c5200 2023-10-18T11:10:35.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.587+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca81eeeb0 con 0x7fbca80c5200 2023-10-18T11:10:35.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.588+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca81577a0 con 0x7fbca80c5200 2023-10-18T11:10:35.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.841+0000 7fbc9effd640 1 -- 172.21.15.151:0/2445808385 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbc980129d0 con 0x7fbca80c5200 2023-10-18T11:10:35.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.843+0000 7fbc9effd640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbc8c06aec0 0x7fbc8c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:35.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.843+0000 7fbc9effd640 1 -- 172.21.15.151:0/2445808385 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbc98089db0 con 0x7fbca80c5200 2023-10-18T11:10:35.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.843+0000 7fbcae42c640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbc8c06aec0 0x7fbc8c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:35.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.844+0000 7fbcae42c640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbc8c06aec0 0x7fbc8c06d380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbca4001560 tx=0x7fbca4001a90 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:35.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:35.853+0000 7fbc9effd640 1 -- 172.21.15.151:0/2445808385 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc98054c30 con 0x7fbca80c5200 2023-10-18T11:10:36.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.059+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbca80c2020 con 0x7fbca80c5200 2023-10-18T11:10:36.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.099+0000 7fbc9effd640 1 -- 172.21.15.151:0/2445808385 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7fbc98058250 con 0x7fbca80c5200 2023-10-18T11:10:36.102 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:36.102 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:36.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbc8c06aec0 msgr2=0x7fbc8c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:36.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbc8c06aec0 0x7fbc8c06d380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbca4001560 tx=0x7fbca4001a90 comp rx=0 tx=0).stop 2023-10-18T11:10:36.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c5200 msgr2=0x7fbca8157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:36.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c5200 0x7fbca8157fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800c450 tx=0x7fbc9800c910 comp rx=0 tx=0).stop 2023-10-18T11:10:36.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 shutdown_connections 2023-10-18T11:10:36.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca80c8a90 0x7fbca80bd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbc8c06aec0 0x7fbc8c06d380 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbca80c5200 0x7fbca8157fa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 --2- 172.21.15.151:0/2445808385 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbca80c4e20 0x7fbca81f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 >> 172.21.15.151:0/2445808385 conn(0x7fbca806aea0 msgr2=0x7fbca80be8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:36.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 shutdown_connections 2023-10-18T11:10:36.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.102+0000 7fbcb0690640 1 -- 172.21.15.151:0/2445808385 wait complete. 2023-10-18T11:10:36.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T11:09:16.833723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T11:09:34.803213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T11:09:37.000724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T11:09:43.858153+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T11:10:36.124 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T11:10:36.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.337+0000 7fd837e1a640 1 Processor -- start 2023-10-18T11:10:36.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.337+0000 7fd837e1a640 1 -- start start 2023-10-18T11:10:36.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.339+0000 7fd837e1a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8300c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:36.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.339+0000 7fd837e1a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd830157170 0x7fd8301575e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:36.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.339+0000 7fd837e1a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83015b3c0 con 0x7fd830151150 2023-10-18T11:10:36.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.339+0000 7fd837e1a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd830157b20 con 0x7fd830157170 2023-10-18T11:10:36.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.339+0000 7fd837e1a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83015a7b0 con 0x7fd830151530 2023-10-18T11:10:36.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.339+0000 7fd835bb6640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fd830151150 0x7fd8300c18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54914/0 (socket says 172.21.15.151:54914) 2023-10-18T11:10:36.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.339+0000 7fd835bb6640 1 -- 172.21.15.151:0/967444918 learned_addr learned my addr 172.21.15.151:0/967444918 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:36.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.339+0000 7fd8353b5640 1 --2- 172.21.15.151:0/967444918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8300c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:36.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.342+0000 7fd8353b5640 1 -- 172.21.15.151:0/967444918 >> v2:172.21.15.151:3300/0 conn(0x7fd830157170 msgr2=0x7fd8301575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:36.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.342+0000 7fd8353b5640 1 --2- 172.21.15.151:0/967444918 >> v2:172.21.15.151:3300/0 conn(0x7fd830157170 0x7fd8301575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.342+0000 7fd8353b5640 1 -- 172.21.15.151:0/967444918 >> v1:172.21.15.151:6789/0 conn(0x7fd830151150 legacy=0x7fd8300c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:36.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.342+0000 7fd8353b5640 1 -- 172.21.15.151:0/967444918 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83015aa90 con 0x7fd830151530 2023-10-18T11:10:36.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.344+0000 7fd8353b5640 1 --2- 172.21.15.151:0/967444918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8300c45b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd8200097a0 tx=0x7fd82002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ab6bacbda691215 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:36.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.348+0000 7fd834bb4640 1 -- 172.21.15.151:0/967444918 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820030800 con 0x7fd830151530 2023-10-18T11:10:36.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.348+0000 7fd834bb4640 1 -- 172.21.15.151:0/967444918 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd820030960 con 0x7fd830151530 2023-10-18T11:10:36.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.348+0000 7fd834bb4640 1 -- 172.21.15.151:0/967444918 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820030cf0 con 0x7fd830151530 2023-10-18T11:10:36.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.349+0000 7fd837e1a640 1 -- 172.21.15.151:0/967444918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 msgr2=0x7fd8300c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:36.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.349+0000 7fd837e1a640 1 --2- 172.21.15.151:0/967444918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8300c45b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd8200097a0 tx=0x7fd82002b940 comp rx=0 tx=0).stop 2023-10-18T11:10:36.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.349+0000 7fd837e1a640 1 -- 172.21.15.151:0/967444918 shutdown_connections 2023-10-18T11:10:36.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.349+0000 7fd837e1a640 1 --2- 172.21.15.151:0/967444918 >> v2:172.21.15.151:3300/0 conn(0x7fd830157170 0x7fd8301575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.349+0000 7fd837e1a640 1 --2- 172.21.15.151:0/967444918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8300c45b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.349+0000 7fd837e1a640 1 -- 172.21.15.151:0/967444918 >> 172.21.15.151:0/967444918 conn(0x7fd830069d90 msgr2=0x7fd83006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:36.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.349+0000 7fd837e1a640 1 -- 172.21.15.151:0/967444918 shutdown_connections 2023-10-18T11:10:36.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.349+0000 7fd837e1a640 1 -- 172.21.15.151:0/967444918 wait complete. 2023-10-18T11:10:36.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.351+0000 7fd837e1a640 1 Processor -- start 2023-10-18T11:10:36.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.351+0000 7fd837e1a640 1 -- start start 2023-10-18T11:10:36.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.352+0000 7fd837e1a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd830151150 0x7fd830156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:36.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.352+0000 7fd837e1a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8301eec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:36.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.352+0000 7fd837e1a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd830157170 0x7fd830071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:36.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.352+0000 7fd837e1a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd830158650 con 0x7fd830151150 2023-10-18T11:10:36.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.352+0000 7fd837e1a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8301f17d0 con 0x7fd830157170 2023-10-18T11:10:36.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.352+0000 7fd837e1a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8301ef1a0 con 0x7fd830151530 2023-10-18T11:10:36.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.352+0000 7fd835bb6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd830151150 0x7fd830156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:36.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.352+0000 7fd8353b5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8301eec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:36.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.353+0000 7fd8363b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd830157170 0x7fd830071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:36.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.353+0000 7fd835bb6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd830151150 0x7fd830156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45034/0 (socket says 172.21.15.151:45034) 2023-10-18T11:10:36.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.353+0000 7fd835bb6640 1 -- 172.21.15.151:0/2562615631 learned_addr learned my addr 172.21.15.151:0/2562615631 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:36.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.356+0000 7fd8353b5640 1 -- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd830157170 msgr2=0x7fd830071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:36.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.356+0000 7fd8353b5640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd830157170 0x7fd830071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.356+0000 7fd8353b5640 1 -- 172.21.15.151:0/2562615631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd830151150 msgr2=0x7fd830156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:36.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.356+0000 7fd8353b5640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd830151150 0x7fd830156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.356+0000 7fd8353b5640 1 -- 172.21.15.151:0/2562615631 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd820009400 con 0x7fd830151530 2023-10-18T11:10:36.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.358+0000 7fd8353b5640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8301eec60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd820033000 tx=0x7fd820004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:36.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.362+0000 7fd8267fc640 1 -- 172.21.15.151:0/2562615631 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82003e040 con 0x7fd830151530 2023-10-18T11:10:36.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.362+0000 7fd8267fc640 1 -- 172.21.15.151:0/2562615631 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd820043440 con 0x7fd830151530 2023-10-18T11:10:36.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.362+0000 7fd8267fc640 1 -- 172.21.15.151:0/2562615631 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200437f0 con 0x7fd830151530 2023-10-18T11:10:36.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.362+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8301f1a00 con 0x7fd830151530 2023-10-18T11:10:36.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.362+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8301f1fa0 con 0x7fd830151530 2023-10-18T11:10:36.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.364+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83004e160 con 0x7fd830151530 2023-10-18T11:10:36.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.612+0000 7fd8267fc640 1 -- 172.21.15.151:0/2562615631 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd820043950 con 0x7fd830151530 2023-10-18T11:10:36.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.614+0000 7fd8267fc640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd81406aec0 0x7fd81406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:36.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.614+0000 7fd8267fc640 1 -- 172.21.15.151:0/2562615631 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd8200ac2a0 con 0x7fd830151530 2023-10-18T11:10:36.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.614+0000 7fd835bb6640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd81406aec0 0x7fd81406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:36.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.615+0000 7fd835bb6640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd81406aec0 0x7fd81406d380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd82c004e40 tx=0x7fd82c007f10 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:36.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.624+0000 7fd8267fc640 1 -- 172.21.15.151:0/2562615631 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd820077140 con 0x7fd830151530 2023-10-18T11:10:36.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.823+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8300c2d50 con 0x7fd830151530 2023-10-18T11:10:36.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.828+0000 7fd8267fc640 1 -- 172.21.15.151:0/2562615631 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd82007a760 con 0x7fd830151530 2023-10-18T11:10:36.831 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-10-18T11:10:36.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.831+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd81406aec0 msgr2=0x7fd81406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:36.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.831+0000 7fd837e1a640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd81406aec0 0x7fd81406d380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd82c004e40 tx=0x7fd82c007f10 comp rx=0 tx=0).stop 2023-10-18T11:10:36.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.831+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 msgr2=0x7fd8301eec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:36.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.831+0000 7fd837e1a640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8301eec60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd820033000 tx=0x7fd820004730 comp rx=0 tx=0).stop 2023-10-18T11:10:36.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.832+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 shutdown_connections 2023-10-18T11:10:36.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.832+0000 7fd837e1a640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd81406aec0 0x7fd81406d380 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.832+0000 7fd837e1a640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd830157170 0x7fd830071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.832+0000 7fd837e1a640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd830151530 0x7fd8301eec60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.832+0000 7fd837e1a640 1 --2- 172.21.15.151:0/2562615631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd830151150 0x7fd830156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:36.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.832+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 >> 172.21.15.151:0/2562615631 conn(0x7fd830069d90 msgr2=0x7fd83014f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:36.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.832+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 shutdown_connections 2023-10-18T11:10:36.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:36.832+0000 7fd837e1a640 1 -- 172.21.15.151:0/2562615631 wait complete. 2023-10-18T11:10:36.854 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T11:10:36.981 INFO:tasks.ceph.mds.e.smithi151.stderr:2023-10-18T11:10:36.978+0000 f5b3640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-18T11:10:37.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.058+0000 7fce9f59e640 1 Processor -- start 2023-10-18T11:10:37.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.058+0000 7fce9f59e640 1 -- start start 2023-10-18T11:10:37.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.060+0000 7fce9f59e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce981510a0 0x7fce980c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.060+0000 7fce9f59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fce98157770 0x7fce9806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.060+0000 7fce9f59e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9806d430 con 0x7fce9806de00 2023-10-18T11:10:37.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.060+0000 7fce9f59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce98151480 con 0x7fce98157770 2023-10-18T11:10:37.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.060+0000 7fce9f59e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce980c27d0 con 0x7fce981510a0 2023-10-18T11:10:37.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.061+0000 7fce9d33a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce981510a0 0x7fce980c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.061+0000 7fce9db3b640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fce9806de00 0x7fce980c4e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:50146/0 (socket says 172.21.15.151:50146) 2023-10-18T11:10:37.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.061+0000 7fce9db3b640 1 -- 172.21.15.151:0/1736723700 learned_addr learned my addr 172.21.15.151:0/1736723700 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:37.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.061+0000 7fce9cb39640 1 --2- 172.21.15.151:0/1736723700 >> v2:172.21.15.151:3300/0 conn(0x7fce98157770 0x7fce9806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.063+0000 7fce8ffff640 1 -- 172.21.15.151:0/1736723700 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875450731 0 0) 0x7fce9806d430 con 0x7fce9806de00 2023-10-18T11:10:37.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.063+0000 7fce8ffff640 1 -- 172.21.15.151:0/1736723700 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce84003520 con 0x7fce9806de00 2023-10-18T11:10:37.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.064+0000 7fce9d33a640 1 -- 172.21.15.151:0/1736723700 >> v2:172.21.15.151:3300/0 conn(0x7fce98157770 msgr2=0x7fce9806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:37.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.064+0000 7fce9d33a640 1 --2- 172.21.15.151:0/1736723700 >> v2:172.21.15.151:3300/0 conn(0x7fce98157770 0x7fce9806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.064+0000 7fce9d33a640 1 -- 172.21.15.151:0/1736723700 >> v1:172.21.15.169:6789/0 conn(0x7fce9806de00 legacy=0x7fce980c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.064+0000 7fce9d33a640 1 -- 172.21.15.151:0/1736723700 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980c2a90 con 0x7fce981510a0 2023-10-18T11:10:37.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.067+0000 7fce9d33a640 1 --2- 172.21.15.151:0/1736723700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce981510a0 0x7fce980c2180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fce940097a0 tx=0x7fce9402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6fa1f4d62558460 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:37.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.070+0000 7fce8ffff640 1 -- 172.21.15.151:0/1736723700 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94030800 con 0x7fce981510a0 2023-10-18T11:10:37.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.071+0000 7fce8ffff640 1 -- 172.21.15.151:0/1736723700 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce94030960 con 0x7fce981510a0 2023-10-18T11:10:37.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.071+0000 7fce8ffff640 1 -- 172.21.15.151:0/1736723700 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94030cf0 con 0x7fce981510a0 2023-10-18T11:10:37.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.071+0000 7fce9f59e640 1 -- 172.21.15.151:0/1736723700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce981510a0 msgr2=0x7fce980c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.071+0000 7fce9f59e640 1 --2- 172.21.15.151:0/1736723700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce981510a0 0x7fce980c2180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fce940097a0 tx=0x7fce9402b940 comp rx=0 tx=0).stop 2023-10-18T11:10:37.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.072+0000 7fce9f59e640 1 -- 172.21.15.151:0/1736723700 shutdown_connections 2023-10-18T11:10:37.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.072+0000 7fce9f59e640 1 --2- 172.21.15.151:0/1736723700 >> v2:172.21.15.151:3300/0 conn(0x7fce98157770 0x7fce9806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.072+0000 7fce9f59e640 1 --2- 172.21.15.151:0/1736723700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce981510a0 0x7fce980c2180 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.072+0000 7fce9f59e640 1 -- 172.21.15.151:0/1736723700 >> 172.21.15.151:0/1736723700 conn(0x7fce98069f70 msgr2=0x7fce9806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:37.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.072+0000 7fce9f59e640 1 -- 172.21.15.151:0/1736723700 shutdown_connections 2023-10-18T11:10:37.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.072+0000 7fce9f59e640 1 -- 172.21.15.151:0/1736723700 wait complete. 2023-10-18T11:10:37.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.074+0000 7fce9f59e640 1 Processor -- start 2023-10-18T11:10:37.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.074+0000 7fce9f59e640 1 -- start start 2023-10-18T11:10:37.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.076+0000 7fce9f59e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce9806de00 0x7fce980ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.076+0000 7fce9f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce981510a0 0x7fce9815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.076+0000 7fce9f59e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce98157770 0x7fce98145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.076+0000 7fce9f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce98142c70 con 0x7fce981510a0 2023-10-18T11:10:37.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.076+0000 7fce9f59e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9815acb0 con 0x7fce98157770 2023-10-18T11:10:37.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.076+0000 7fce9f59e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce981ef900 con 0x7fce9806de00 2023-10-18T11:10:37.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.076+0000 7fce9d33a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce9806de00 0x7fce980ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.076+0000 7fce9db3b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce98157770 0x7fce98145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.077+0000 7fce9cb39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce981510a0 0x7fce9815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.077+0000 7fce9d33a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce9806de00 0x7fce980ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:57572/0 (socket says 172.21.15.151:57572) 2023-10-18T11:10:37.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.077+0000 7fce9d33a640 1 -- 172.21.15.151:0/3512068343 learned_addr learned my addr 172.21.15.151:0/3512068343 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:37.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.080+0000 7fce9d33a640 1 -- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce98157770 msgr2=0x7fce98145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.080+0000 7fce9d33a640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce98157770 0x7fce98145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.080+0000 7fce9d33a640 1 -- 172.21.15.151:0/3512068343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce981510a0 msgr2=0x7fce9815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.080+0000 7fce9d33a640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce981510a0 0x7fce9815a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.080+0000 7fce9d33a640 1 -- 172.21.15.151:0/3512068343 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94009400 con 0x7fce9806de00 2023-10-18T11:10:37.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.083+0000 7fce9d33a640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce9806de00 0x7fce980ca790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce94009890 tx=0x7fce94004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:37.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.086+0000 7fce8dffb640 1 -- 172.21.15.151:0/3512068343 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9403e040 con 0x7fce9806de00 2023-10-18T11:10:37.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.086+0000 7fce8dffb640 1 -- 172.21.15.151:0/3512068343 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce94039c60 con 0x7fce9806de00 2023-10-18T11:10:37.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.086+0000 7fce8dffb640 1 -- 172.21.15.151:0/3512068343 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94043440 con 0x7fce9806de00 2023-10-18T11:10:37.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.086+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce98146a30 con 0x7fce9806de00 2023-10-18T11:10:37.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.087+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9815af50 con 0x7fce9806de00 2023-10-18T11:10:37.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.088+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9804e160 con 0x7fce9806de00 2023-10-18T11:10:37.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.335+0000 7fce8dffb640 1 -- 172.21.15.151:0/3512068343 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fce940423e0 con 0x7fce9806de00 2023-10-18T11:10:37.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.338+0000 7fce8dffb640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fce7c06aec0 0x7fce7c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.338+0000 7fce8dffb640 1 -- 172.21.15.151:0/3512068343 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce940abee0 con 0x7fce9806de00 2023-10-18T11:10:37.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.338+0000 7fce9cb39640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fce7c06aec0 0x7fce7c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.339+0000 7fce9cb39640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fce7c06aec0 0x7fce7c06d380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce980c6d80 tx=0x7fce88009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:37.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.347+0000 7fce8dffb640 1 -- 172.21.15.151:0/3512068343 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce94076d60 con 0x7fce9806de00 2023-10-18T11:10:37.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.542+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce980c5960 con 0x7fce9806de00 2023-10-18T11:10:37.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.548+0000 7fce8dffb640 1 -- 172.21.15.151:0/3512068343 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce9407a380 con 0x7fce9806de00 2023-10-18T11:10:37.550 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:10:37.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fce7c06aec0 msgr2=0x7fce7c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fce7c06aec0 0x7fce7c06d380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce980c6d80 tx=0x7fce88009190 comp rx=0 tx=0).stop 2023-10-18T11:10:37.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce9806de00 msgr2=0x7fce980ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce9806de00 0x7fce980ca790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce94009890 tx=0x7fce94004730 comp rx=0 tx=0).stop 2023-10-18T11:10:37.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 shutdown_connections 2023-10-18T11:10:37.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fce7c06aec0 0x7fce7c06d380 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce98157770 0x7fce98145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce981510a0 0x7fce9815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 --2- 172.21.15.151:0/3512068343 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce9806de00 0x7fce980ca790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 >> 172.21.15.151:0/3512068343 conn(0x7fce98069f70 msgr2=0x7fce980c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:37.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.550+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 shutdown_connections 2023-10-18T11:10:37.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.551+0000 7fce9f59e640 1 -- 172.21.15.151:0/3512068343 wait complete. 2023-10-18T11:10:37.570 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T11:10:37.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.779+0000 7f434ffff640 1 Processor -- start 2023-10-18T11:10:37.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.780+0000 7f434ffff640 1 -- start start 2023-10-18T11:10:37.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.781+0000 7f434ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500cb450 0x7f43501646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.781+0000 7f434ffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43501597d0 con 0x7f43500c5a40 2023-10-18T11:10:37.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.781+0000 7f434ffff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435006ae10 con 0x7f43501531f0 2023-10-18T11:10:37.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.781+0000 7f434ffff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43501535d0 con 0x7f43500cb450 2023-10-18T11:10:37.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.782+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500cb450 0x7f43501646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.782+0000 7f434effd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f43501531f0 0x7f435006a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:55566/0 (socket says 172.21.15.151:55566) 2023-10-18T11:10:37.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.782+0000 7f434effd640 1 -- 172.21.15.151:0/526195558 learned_addr learned my addr 172.21.15.151:0/526195558 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:37.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.785+0000 7f434f7fe640 1 -- 172.21.15.151:0/526195558 >> v1:172.21.15.169:6789/0 conn(0x7f43501531f0 legacy=0x7f435006a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.785+0000 7f434f7fe640 1 -- 172.21.15.151:0/526195558 >> v1:172.21.15.151:6789/0 conn(0x7f43500c5a40 legacy=0x7f43500ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.785+0000 7f434f7fe640 1 -- 172.21.15.151:0/526195558 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350158ee0 con 0x7f43500cb450 2023-10-18T11:10:37.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.787+0000 7f434f7fe640 1 --2- 172.21.15.151:0/526195558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500cb450 0x7f43501646c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4348009dc0 tx=0x7f434802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9416c61ef5f98568 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:37.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.791+0000 7f434e7fc640 1 -- 172.21.15.151:0/526195558 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434802ccd0 con 0x7f43500cb450 2023-10-18T11:10:37.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.791+0000 7f434e7fc640 1 -- 172.21.15.151:0/526195558 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434802ce30 con 0x7f43500cb450 2023-10-18T11:10:37.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.791+0000 7f434e7fc640 1 -- 172.21.15.151:0/526195558 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348034660 con 0x7f43500cb450 2023-10-18T11:10:37.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.792+0000 7f434ffff640 1 -- 172.21.15.151:0/526195558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500cb450 msgr2=0x7f43501646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.792+0000 7f434ffff640 1 --2- 172.21.15.151:0/526195558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500cb450 0x7f43501646c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4348009dc0 tx=0x7f434802bf20 comp rx=0 tx=0).stop 2023-10-18T11:10:37.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.792+0000 7f434ffff640 1 -- 172.21.15.151:0/526195558 shutdown_connections 2023-10-18T11:10:37.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.792+0000 7f434ffff640 1 --2- 172.21.15.151:0/526195558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500cb450 0x7f43501646c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.792+0000 7f434ffff640 1 -- 172.21.15.151:0/526195558 >> 172.21.15.151:0/526195558 conn(0x7f4350065bb0 msgr2=0x7f4350065fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:37.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.792+0000 7f434ffff640 1 -- 172.21.15.151:0/526195558 shutdown_connections 2023-10-18T11:10:37.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.792+0000 7f434ffff640 1 -- 172.21.15.151:0/526195558 wait complete. 2023-10-18T11:10:37.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.794+0000 7f434ffff640 1 Processor -- start 2023-10-18T11:10:37.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.794+0000 7f434ffff640 1 -- start start 2023-10-18T11:10:37.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.795+0000 7f434ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500c5a40 0x7f435015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.795+0000 7f434ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43500cb450 0x7f43501f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.795+0000 7f434ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43501531f0 0x7f435015b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.795+0000 7f434ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43501f29b0 con 0x7f43501531f0 2023-10-18T11:10:37.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.795+0000 7f434ffff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4350154ae0 con 0x7f43500cb450 2023-10-18T11:10:37.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.795+0000 7f434ffff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43501f26d0 con 0x7f43500c5a40 2023-10-18T11:10:37.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.796+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43501531f0 0x7f435015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.796+0000 7f434effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500c5a40 0x7f435015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.796+0000 7f4347fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43500cb450 0x7f43501f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.796+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43501531f0 0x7f435015b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60502/0 (socket says 172.21.15.151:60502) 2023-10-18T11:10:37.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.796+0000 7f434f7fe640 1 -- 172.21.15.151:0/3353748383 learned_addr learned my addr 172.21.15.151:0/3353748383 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:37.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.800+0000 7f4347fff640 1 -- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500c5a40 msgr2=0x7f435015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.800+0000 7f4347fff640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500c5a40 0x7f435015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.800+0000 7f4347fff640 1 -- 172.21.15.151:0/3353748383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43501531f0 msgr2=0x7f435015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:37.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.800+0000 7f4347fff640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43501531f0 0x7f435015b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:37.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.800+0000 7f4347fff640 1 -- 172.21.15.151:0/3353748383 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4348009a70 con 0x7f43500cb450 2023-10-18T11:10:37.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.802+0000 7f4347fff640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43500cb450 0x7f43501f1d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f433800c390 tx=0x7f433800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:37.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.806+0000 7f43477fe640 1 -- 172.21.15.151:0/3353748383 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380052d0 con 0x7f43500cb450 2023-10-18T11:10:37.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.806+0000 7f43477fe640 1 -- 172.21.15.151:0/3353748383 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4338005430 con 0x7f43500cb450 2023-10-18T11:10:37.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.806+0000 7f43477fe640 1 -- 172.21.15.151:0/3353748383 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338003830 con 0x7f43500cb450 2023-10-18T11:10:37.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.806+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4350154490 con 0x7f43500cb450 2023-10-18T11:10:37.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.806+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43500c7470 con 0x7f43500cb450 2023-10-18T11:10:37.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.807+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435006ba70 con 0x7f43500cb450 2023-10-18T11:10:37.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.826+0000 7f43477fe640 1 -- 172.21.15.151:0/3353748383 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4338003990 con 0x7f43500cb450 2023-10-18T11:10:37.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.827+0000 7f43477fe640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f433006aec0 0x7f433006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:37.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.828+0000 7f434effd640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f433006aec0 0x7f433006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:37.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.828+0000 7f43477fe640 1 -- 172.21.15.151:0/3353748383 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4338057d90 con 0x7f43500cb450 2023-10-18T11:10:37.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:37.828+0000 7f434effd640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f433006aec0 0x7f433006d380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4340005880 tx=0x7f4340009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:38.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.070+0000 7f43477fe640 1 -- 172.21.15.151:0/3353748383 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43380540d0 con 0x7f43500cb450 2023-10-18T11:10:38.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.283+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4350068fd0 con 0x7f43500cb450 2023-10-18T11:10:38.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.291+0000 7f43477fe640 1 -- 172.21.15.151:0/3353748383 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4338017020 con 0x7f43500cb450 2023-10-18T11:10:38.293 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-10-18T11:10:38.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.293+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f433006aec0 msgr2=0x7f433006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:38.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.293+0000 7f434ffff640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f433006aec0 0x7f433006d380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4340005880 tx=0x7f4340009040 comp rx=0 tx=0).stop 2023-10-18T11:10:38.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.293+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43500cb450 msgr2=0x7f43501f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:38.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.293+0000 7f434ffff640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43500cb450 0x7f43501f1d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f433800c390 tx=0x7f433800c850 comp rx=0 tx=0).stop 2023-10-18T11:10:38.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.293+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 shutdown_connections 2023-10-18T11:10:38.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.293+0000 7f434ffff640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43501531f0 0x7f435015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:38.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.293+0000 7f434ffff640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f433006aec0 0x7f433006d380 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:38.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.293+0000 7f434ffff640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43500cb450 0x7f43501f1d10 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f433800c390 tx=0x7f433800c850 comp rx=0 tx=0).stop 2023-10-18T11:10:38.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.293+0000 7f434ffff640 1 --2- 172.21.15.151:0/3353748383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43500c5a40 0x7f435015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:38.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.294+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 >> 172.21.15.151:0/3353748383 conn(0x7f4350065bb0 msgr2=0x7f4350150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:38.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.294+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 shutdown_connections 2023-10-18T11:10:38.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.294+0000 7f434ffff640 1 -- 172.21.15.151:0/3353748383 wait complete. 2023-10-18T11:10:38.317 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T11:10:38.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.522+0000 7f16c01d5640 1 Processor -- start 2023-10-18T11:10:38.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.522+0000 7f16c01d5640 1 -- start start 2023-10-18T11:10:38.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.524+0000 7f16c01d5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f16b8159bf0 0x7f16b8069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:38.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.524+0000 7f16c01d5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16b806a2d0 0x7f16b806e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.524+0000 7f16c01d5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b80c7e20 con 0x7f16b80c5070 2023-10-18T11:10:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.524+0000 7f16c01d5640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b80c5450 con 0x7f16b8159bf0 2023-10-18T11:10:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.524+0000 7f16c01d5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b8071f40 con 0x7f16b806a2d0 2023-10-18T11:10:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.525+0000 7f16bd770640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f16b8159bf0 0x7f16b8069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.525+0000 7f16bdf71640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f16b80c5070 0x7f16b8071830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:32794/0 (socket says 172.21.15.151:32794) 2023-10-18T11:10:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.525+0000 7f16bdf71640 1 -- 172.21.15.151:0/507278289 learned_addr learned my addr 172.21.15.151:0/507278289 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.527+0000 7f16bd770640 1 -- 172.21.15.151:0/507278289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16b806a2d0 msgr2=0x7f16b806e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:38.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.527+0000 7f16bd770640 1 --2- 172.21.15.151:0/507278289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16b806a2d0 0x7f16b806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:38.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.527+0000 7f16bd770640 1 -- 172.21.15.151:0/507278289 >> v1:172.21.15.151:6789/0 conn(0x7f16b80c5070 legacy=0x7f16b8071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:38.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.527+0000 7f16bd770640 1 -- 172.21.15.151:0/507278289 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b815a040 con 0x7f16b8159bf0 2023-10-18T11:10:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.530+0000 7f16bd770640 1 --2- 172.21.15.151:0/507278289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b8159bf0 0x7f16b8069d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16a80097a0 tx=0x7f16a802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20762bc3da8e559b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:38.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.532+0000 7f16bcf6f640 1 -- 172.21.15.151:0/507278289 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a802d040 con 0x7f16b8159bf0 2023-10-18T11:10:38.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.533+0000 7f16bcf6f640 1 -- 172.21.15.151:0/507278289 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8031810 con 0x7f16b8159bf0 2023-10-18T11:10:38.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.533+0000 7f16bcf6f640 1 -- 172.21.15.151:0/507278289 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8031ba0 con 0x7f16b8159bf0 2023-10-18T11:10:38.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.534+0000 7f16c01d5640 1 -- 172.21.15.151:0/507278289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b8159bf0 msgr2=0x7f16b8069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:38.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.534+0000 7f16c01d5640 1 --2- 172.21.15.151:0/507278289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b8159bf0 0x7f16b8069d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16a80097a0 tx=0x7f16a802b8b0 comp rx=0 tx=0).stop 2023-10-18T11:10:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.534+0000 7f16c01d5640 1 -- 172.21.15.151:0/507278289 shutdown_connections 2023-10-18T11:10:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.534+0000 7f16c01d5640 1 --2- 172.21.15.151:0/507278289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16b806a2d0 0x7f16b806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.534+0000 7f16c01d5640 1 --2- 172.21.15.151:0/507278289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b8159bf0 0x7f16b8069d90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.534+0000 7f16c01d5640 1 -- 172.21.15.151:0/507278289 >> 172.21.15.151:0/507278289 conn(0x7f16b806b080 msgr2=0x7f16b806b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.534+0000 7f16c01d5640 1 -- 172.21.15.151:0/507278289 shutdown_connections 2023-10-18T11:10:38.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.534+0000 7f16c01d5640 1 -- 172.21.15.151:0/507278289 wait complete. 2023-10-18T11:10:38.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.536+0000 7f16c01d5640 1 Processor -- start 2023-10-18T11:10:38.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.537+0000 7f16c01d5640 1 -- start start 2023-10-18T11:10:38.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.538+0000 7f16c01d5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b806a2d0 0x7f16b80c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:38.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.538+0000 7f16c01d5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16b80c5070 0x7f16b81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:38.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.538+0000 7f16c01d5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16b8159bf0 0x7f16b81585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:38.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.538+0000 7f16c01d5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b8154160 con 0x7f16b80c5070 2023-10-18T11:10:38.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.538+0000 7f16c01d5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b8071d50 con 0x7f16b806a2d0 2023-10-18T11:10:38.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.538+0000 7f16c01d5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b8153e80 con 0x7f16b8159bf0 2023-10-18T11:10:38.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.539+0000 7f16bdf71640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b806a2d0 0x7f16b80c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:38.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.539+0000 7f16bdf71640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b806a2d0 0x7f16b80c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46674/0 (socket says 172.21.15.151:46674) 2023-10-18T11:10:38.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.539+0000 7f16bdf71640 1 -- 172.21.15.151:0/1054800021 learned_addr learned my addr 172.21.15.151:0/1054800021 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:38.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.539+0000 7f16be772640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16b8159bf0 0x7f16b81585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:38.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.542+0000 7f16bdf71640 1 -- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16b8159bf0 msgr2=0x7f16b81585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:38.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.542+0000 7f16bdf71640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16b8159bf0 0x7f16b81585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:38.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.542+0000 7f16bdf71640 1 -- 172.21.15.151:0/1054800021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16b80c5070 msgr2=0x7f16b81580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:38.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.542+0000 7f16bdf71640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16b80c5070 0x7f16b81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:38.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.542+0000 7f16bdf71640 1 -- 172.21.15.151:0/1054800021 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a8009400 con 0x7f16b806a2d0 2023-10-18T11:10:38.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.545+0000 7f16bdf71640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b806a2d0 0x7f16b80c6050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f16b400c400 tx=0x7f16b400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.548+0000 7f16ae7fc640 1 -- 172.21.15.151:0/1054800021 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4005ce0 con 0x7f16b806a2d0 2023-10-18T11:10:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.549+0000 7f16ae7fc640 1 -- 172.21.15.151:0/1054800021 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b4005e40 con 0x7f16b806a2d0 2023-10-18T11:10:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.549+0000 7f16ae7fc640 1 -- 172.21.15.151:0/1054800021 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b40072d0 con 0x7f16b806a2d0 2023-10-18T11:10:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.549+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b8155820 con 0x7f16b806a2d0 2023-10-18T11:10:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.549+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b8155de0 con 0x7f16b806a2d0 2023-10-18T11:10:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.550+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b804e160 con 0x7f16b806a2d0 2023-10-18T11:10:38.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.573+0000 7f16ae7fc640 1 -- 172.21.15.151:0/1054800021 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f16b40074f0 con 0x7f16b806a2d0 2023-10-18T11:10:38.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.574+0000 7f16ae7fc640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f169c06aec0 0x7f169c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:38.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.574+0000 7f16ae7fc640 1 -- 172.21.15.151:0/1054800021 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f16b40891f0 con 0x7f16b806a2d0 2023-10-18T11:10:38.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.574+0000 7f16bd770640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f169c06aec0 0x7f169c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:38.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.575+0000 7f16bd770640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f169c06aec0 0x7f169c06d380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f16a8036000 tx=0x7f16a8030000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:38.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:38.817+0000 7f16ae7fc640 1 -- 172.21.15.151:0/1054800021 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16b4053fe0 con 0x7f16b806a2d0 2023-10-18T11:10:39.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.020+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f16b80c7e20 con 0x7f16b806a2d0 2023-10-18T11:10:39.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.026+0000 7f16ae7fc640 1 -- 172.21.15.151:0/1054800021 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f16b80c7e20 con 0x7f16b806a2d0 2023-10-18T11:10:39.028 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:10:39.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f169c06aec0 msgr2=0x7f169c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f169c06aec0 0x7f169c06d380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f16a8036000 tx=0x7f16a8030000 comp rx=0 tx=0).stop 2023-10-18T11:10:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b806a2d0 msgr2=0x7f16b80c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b806a2d0 0x7f16b80c6050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f16b400c400 tx=0x7f16b400c8c0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 shutdown_connections 2023-10-18T11:10:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16b8159bf0 0x7f16b81585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16b80c5070 0x7f16b81580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f169c06aec0 0x7f169c06d380 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 --2- 172.21.15.151:0/1054800021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16b806a2d0 0x7f16b80c6050 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 >> 172.21.15.151:0/1054800021 conn(0x7f16b806b080 msgr2=0x7f16b80c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 shutdown_connections 2023-10-18T11:10:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.029+0000 7f16c01d5640 1 -- 172.21.15.151:0/1054800021 wait complete. 2023-10-18T11:10:39.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:10:39.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.258+0000 7f2a6964d640 1 Processor -- start 2023-10-18T11:10:39.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.258+0000 7f2a6964d640 1 -- start start 2023-10-18T11:10:39.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.261+0000 7f2a6964d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2a6414d8d0 0x7f2a64156c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:39.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.261+0000 7f2a6964d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2a640c5d90 0x7f2a640c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:39.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.261+0000 7f2a6964d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a640cbba0 con 0x7f2a641571a0 2023-10-18T11:10:39.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.261+0000 7f2a6964d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6406ea70 con 0x7f2a6414d8d0 2023-10-18T11:10:39.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.261+0000 7f2a6964d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a640cbe00 con 0x7f2a640c5d90 2023-10-18T11:10:39.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.262+0000 7f2a68e4c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2a640c5d90 0x7f2a640c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:39.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.262+0000 7f2a68e4c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2a640c5d90 0x7f2a640c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46686/0 (socket says 172.21.15.151:46686) 2023-10-18T11:10:39.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.262+0000 7f2a68e4c640 1 -- 172.21.15.151:0/4044598099 learned_addr learned my addr 172.21.15.151:0/4044598099 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:39.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.264+0000 7f2a68e4c640 1 -- 172.21.15.151:0/4044598099 >> v2:172.21.15.151:3300/0 conn(0x7f2a6414d8d0 msgr2=0x7f2a64156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:39.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.264+0000 7f2a68e4c640 1 --2- 172.21.15.151:0/4044598099 >> v2:172.21.15.151:3300/0 conn(0x7f2a6414d8d0 0x7f2a64156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.264+0000 7f2a68e4c640 1 -- 172.21.15.151:0/4044598099 >> v1:172.21.15.151:6789/0 conn(0x7f2a641571a0 legacy=0x7f2a640c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:39.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.264+0000 7f2a68e4c640 1 -- 172.21.15.151:0/4044598099 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6406ed10 con 0x7f2a640c5d90 2023-10-18T11:10:39.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.266+0000 7f2a68e4c640 1 --2- 172.21.15.151:0/4044598099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a640c5d90 0x7f2a640c4a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2a6406ca40 tx=0x7f2a5c02bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395de0d51f30fc5c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:39.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.270+0000 7f2a637fe640 1 -- 172.21.15.151:0/4044598099 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c02cb20 con 0x7f2a640c5d90 2023-10-18T11:10:39.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.270+0000 7f2a637fe640 1 -- 172.21.15.151:0/4044598099 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c02cc80 con 0x7f2a640c5d90 2023-10-18T11:10:39.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.270+0000 7f2a637fe640 1 -- 172.21.15.151:0/4044598099 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0343f0 con 0x7f2a640c5d90 2023-10-18T11:10:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.271+0000 7f2a6964d640 1 -- 172.21.15.151:0/4044598099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a640c5d90 msgr2=0x7f2a640c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.271+0000 7f2a6964d640 1 --2- 172.21.15.151:0/4044598099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a640c5d90 0x7f2a640c4a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2a6406ca40 tx=0x7f2a5c02bf80 comp rx=0 tx=0).stop 2023-10-18T11:10:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.271+0000 7f2a6964d640 1 -- 172.21.15.151:0/4044598099 shutdown_connections 2023-10-18T11:10:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.271+0000 7f2a6964d640 1 --2- 172.21.15.151:0/4044598099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a640c5d90 0x7f2a640c4a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.271+0000 7f2a6964d640 1 --2- 172.21.15.151:0/4044598099 >> v2:172.21.15.151:3300/0 conn(0x7f2a6414d8d0 0x7f2a64156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.271+0000 7f2a6964d640 1 -- 172.21.15.151:0/4044598099 >> 172.21.15.151:0/4044598099 conn(0x7f2a64070c00 msgr2=0x7f2a64070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:39.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.271+0000 7f2a6964d640 1 -- 172.21.15.151:0/4044598099 shutdown_connections 2023-10-18T11:10:39.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.271+0000 7f2a6964d640 1 -- 172.21.15.151:0/4044598099 wait complete. 2023-10-18T11:10:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.274+0000 7f2a6964d640 1 Processor -- start 2023-10-18T11:10:39.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.275+0000 7f2a6964d640 1 -- start start 2023-10-18T11:10:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.276+0000 7f2a6964d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a640c5d90 0x7f2a64143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.276+0000 7f2a6964d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a6414d8d0 0x7f2a64145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.276+0000 7f2a6964d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a641571a0 0x7f2a641431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.277+0000 7f2a6964d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a641f0e20 con 0x7f2a6414d8d0 2023-10-18T11:10:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.277+0000 7f2a6964d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64144c70 con 0x7f2a641571a0 2023-10-18T11:10:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.277+0000 7f2a6964d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64144380 con 0x7f2a640c5d90 2023-10-18T11:10:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.277+0000 7f2a63fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a640c5d90 0x7f2a64143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.277+0000 7f2a68e4c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a641571a0 0x7f2a641431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.278+0000 7f2a63fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a640c5d90 0x7f2a64143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41938/0 (socket says 172.21.15.151:41938) 2023-10-18T11:10:39.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.278+0000 7f2a63fff640 1 -- 172.21.15.151:0/3172902652 learned_addr learned my addr 172.21.15.151:0/3172902652 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:39.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.281+0000 7f2a63fff640 1 -- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a641571a0 msgr2=0x7f2a641431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:39.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.281+0000 7f2a63fff640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a641571a0 0x7f2a641431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.281+0000 7f2a63fff640 1 -- 172.21.15.151:0/3172902652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a6414d8d0 msgr2=0x7f2a64145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:39.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.281+0000 7f2a63fff640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a6414d8d0 0x7f2a64145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.281+0000 7f2a63fff640 1 -- 172.21.15.151:0/3172902652 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c009b30 con 0x7f2a640c5d90 2023-10-18T11:10:39.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.284+0000 7f2a63fff640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a640c5d90 0x7f2a64143910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400b500 tx=0x7f2a5400b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:39.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.286+0000 7f2a617fa640 1 -- 172.21.15.151:0/3172902652 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54010870 con 0x7f2a640c5d90 2023-10-18T11:10:39.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.286+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a641f0b40 con 0x7f2a640c5d90 2023-10-18T11:10:39.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.286+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a64144900 con 0x7f2a640c5d90 2023-10-18T11:10:39.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.288+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6404e160 con 0x7f2a640c5d90 2023-10-18T11:10:39.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.289+0000 7f2a617fa640 1 -- 172.21.15.151:0/3172902652 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a540109d0 con 0x7f2a640c5d90 2023-10-18T11:10:39.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.289+0000 7f2a617fa640 1 -- 172.21.15.151:0/3172902652 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54010d60 con 0x7f2a640c5d90 2023-10-18T11:10:39.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.324+0000 7f2a617fa640 1 -- 172.21.15.151:0/3172902652 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2a54023480 con 0x7f2a640c5d90 2023-10-18T11:10:39.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.326+0000 7f2a617fa640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2a4406ae70 0x7f2a4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:39.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.327+0000 7f2a5bfff640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2a4406ae70 0x7f2a4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:39.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.328+0000 7f2a5bfff640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2a4406ae70 0x7f2a4406d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c006fd0 tx=0x7f2a4c006bc0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:39.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.595+0000 7f2a617fa640 1 -- 172.21.15.151:0/3172902652 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a540587a0 con 0x7f2a640c5d90 2023-10-18T11:10:39.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.607+0000 7f2a617fa640 1 -- 172.21.15.151:0/3172902652 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a54058570 con 0x7f2a640c5d90 2023-10-18T11:10:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.839+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a64144a90 con 0x7f2a640c5d90 2023-10-18T11:10:39.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.852+0000 7f2a617fa640 1 -- 172.21.15.151:0/3172902652 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6561 (secure 0 0 0) 0x7f2a5401e020 con 0x7f2a640c5d90 2023-10-18T11:10:39.855 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:39.855 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2025487091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2025487091},{"type":"v1","addr":"172.21.15.169:6835","nonce":2025487091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T11:09:38.819021+0000","modified":"2023-10-18T11:10:33.837356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4288,"mds_2":4244,"mds_3":4241,"mds_4":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"f","rank":4,"incarnation":17,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6837/872383111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":872383111},{"type":"v1","addr":"172.21.15.169:6837","nonce":872383111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6839/520473080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":520473080},{"type":"v1","addr":"172.21.15.169:6839","nonce":520473080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6835/2666139932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2666139932},{"type":"v1","addr":"172.21.15.151:6835","nonce":2666139932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":15,"addr":"172.21.15.151:6833/251484638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":251484638},{"type":"v1","addr":"172.21.15.151:6833","nonce":251484638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4294":{"gid":4294,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6837/909327926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":909327926},{"type":"v1","addr":"172.21.15.151:6837","nonce":909327926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T11:10:39.855 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 18 2023-10-18T11:10:39.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2a4406ae70 msgr2=0x7f2a4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:39.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2a4406ae70 0x7f2a4406d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c006fd0 tx=0x7f2a4c006bc0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a640c5d90 msgr2=0x7f2a64143910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:39.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a640c5d90 0x7f2a64143910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400b500 tx=0x7f2a5400b9c0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 shutdown_connections 2023-10-18T11:10:39.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2a4406ae70 0x7f2a4406d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a641571a0 0x7f2a641431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a6414d8d0 0x7f2a64145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 --2- 172.21.15.151:0/3172902652 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a640c5d90 0x7f2a64143910 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:39.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 >> 172.21.15.151:0/3172902652 conn(0x7f2a64070c00 msgr2=0x7f2a64070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 shutdown_connections 2023-10-18T11:10:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:39.855+0000 7f2a6964d640 1 -- 172.21.15.151:0/3172902652 wait complete. 2023-10-18T11:10:39.877 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:10:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.086+0000 7fb4d7621640 1 Processor -- start 2023-10-18T11:10:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.086+0000 7fb4d7621640 1 -- start start 2023-10-18T11:10:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.087+0000 7fb4d7621640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d00c57a0 0x7fb4d0157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.087+0000 7fb4d7621640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d00c6820 con 0x7fb4d0150ec0 2023-10-18T11:10:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.087+0000 7fb4d7621640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d00c6b00 con 0x7fb4d00c5080 2023-10-18T11:10:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.087+0000 7fb4d7621640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d00c3b00 con 0x7fb4d00c57a0 2023-10-18T11:10:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.088+0000 7fb4d53bd640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb4d0150ec0 0x7fb4d006d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:32818/0 (socket says 172.21.15.151:32818) 2023-10-18T11:10:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.088+0000 7fb4d53bd640 1 -- 172.21.15.151:0/1772413781 learned_addr learned my addr 172.21.15.151:0/1772413781 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.088+0000 7fb4d4bbc640 1 --2- 172.21.15.151:0/1772413781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d00c57a0 0x7fb4d0157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.091+0000 7fb4c7fff640 1 -- 172.21.15.151:0/1772413781 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311378358 0 0) 0x7fb4d00c6820 con 0x7fb4d0150ec0 2023-10-18T11:10:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.091+0000 7fb4c7fff640 1 -- 172.21.15.151:0/1772413781 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4bc003520 con 0x7fb4d0150ec0 2023-10-18T11:10:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.091+0000 7fb4c7fff640 1 -- 172.21.15.151:0/1772413781 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401018177 0 0) 0x7fb4d00c6b00 con 0x7fb4d00c5080 2023-10-18T11:10:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.091+0000 7fb4d4bbc640 1 -- 172.21.15.151:0/1772413781 >> v1:172.21.15.169:6789/0 conn(0x7fb4d00c5080 legacy=0x7fb4d015a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.091+0000 7fb4d4bbc640 1 -- 172.21.15.151:0/1772413781 >> v1:172.21.15.151:6789/0 conn(0x7fb4d0150ec0 legacy=0x7fb4d006d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.091+0000 7fb4d4bbc640 1 -- 172.21.15.151:0/1772413781 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d00c1ab0 con 0x7fb4d00c57a0 2023-10-18T11:10:40.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.093+0000 7fb4d4bbc640 1 --2- 172.21.15.151:0/1772413781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d00c57a0 0x7fb4d0157790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00097d0 tx=0x7fb4c002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=876f5ddca33b4db4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:40.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.097+0000 7fb4c7fff640 1 -- 172.21.15.151:0/1772413781 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0031890 con 0x7fb4d00c57a0 2023-10-18T11:10:40.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.097+0000 7fb4c7fff640 1 -- 172.21.15.151:0/1772413781 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c00319f0 con 0x7fb4d00c57a0 2023-10-18T11:10:40.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.097+0000 7fb4c7fff640 1 -- 172.21.15.151:0/1772413781 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0031d80 con 0x7fb4d00c57a0 2023-10-18T11:10:40.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.098+0000 7fb4d7621640 1 -- 172.21.15.151:0/1772413781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d00c57a0 msgr2=0x7fb4d0157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.098+0000 7fb4d7621640 1 --2- 172.21.15.151:0/1772413781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d00c57a0 0x7fb4d0157790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00097d0 tx=0x7fb4c002b930 comp rx=0 tx=0).stop 2023-10-18T11:10:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.098+0000 7fb4d7621640 1 -- 172.21.15.151:0/1772413781 shutdown_connections 2023-10-18T11:10:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.098+0000 7fb4d7621640 1 --2- 172.21.15.151:0/1772413781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d00c57a0 0x7fb4d0157790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.098+0000 7fb4d7621640 1 -- 172.21.15.151:0/1772413781 >> 172.21.15.151:0/1772413781 conn(0x7fb4d00c6f10 msgr2=0x7fb4d00c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.098+0000 7fb4d7621640 1 -- 172.21.15.151:0/1772413781 shutdown_connections 2023-10-18T11:10:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.098+0000 7fb4d7621640 1 -- 172.21.15.151:0/1772413781 wait complete. 2023-10-18T11:10:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.100+0000 7fb4d7621640 1 Processor -- start 2023-10-18T11:10:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.100+0000 7fb4d7621640 1 -- start start 2023-10-18T11:10:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.101+0000 7fb4d7621640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4d00c5080 0x7fb4d0156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.101+0000 7fb4d7621640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4d00c57a0 0x7fb4d0147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.101+0000 7fb4d7621640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d0150ec0 0x7fb4d00c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.101+0000 7fb4d7621640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0154610 con 0x7fb4d00c57a0 2023-10-18T11:10:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.101+0000 7fb4d7621640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0153a30 con 0x7fb4d00c5080 2023-10-18T11:10:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.101+0000 7fb4d7621640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0154050 con 0x7fb4d0150ec0 2023-10-18T11:10:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.101+0000 7fb4d53bd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4d00c5080 0x7fb4d0156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.101+0000 7fb4d5bbe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d0150ec0 0x7fb4d00c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.102+0000 7fb4d5bbe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d0150ec0 0x7fb4d00c2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41958/0 (socket says 172.21.15.151:41958) 2023-10-18T11:10:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.102+0000 7fb4d5bbe640 1 -- 172.21.15.151:0/3696554291 learned_addr learned my addr 172.21.15.151:0/3696554291 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.102+0000 7fb4d4bbc640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4d00c57a0 0x7fb4d0147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.105+0000 7fb4d5bbe640 1 -- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4d00c5080 msgr2=0x7fb4d0156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.105+0000 7fb4d5bbe640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4d00c5080 0x7fb4d0156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.105+0000 7fb4d5bbe640 1 -- 172.21.15.151:0/3696554291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4d00c57a0 msgr2=0x7fb4d0147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.105+0000 7fb4d5bbe640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4d00c57a0 0x7fb4d0147100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.105+0000 7fb4d5bbe640 1 -- 172.21.15.151:0/3696554291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c0009400 con 0x7fb4d0150ec0 2023-10-18T11:10:40.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.107+0000 7fb4d5bbe640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d0150ec0 0x7fb4d00c2940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800c7e0 tx=0x7fb4c800cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:40.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.111+0000 7fb4c5ffb640 1 -- 172.21.15.151:0/3696554291 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8003da0 con 0x7fb4d0150ec0 2023-10-18T11:10:40.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.111+0000 7fb4c5ffb640 1 -- 172.21.15.151:0/3696554291 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8005070 con 0x7fb4d0150ec0 2023-10-18T11:10:40.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.111+0000 7fb4c5ffb640 1 -- 172.21.15.151:0/3696554291 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8005420 con 0x7fb4d0150ec0 2023-10-18T11:10:40.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.111+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d0154330 con 0x7fb4d0150ec0 2023-10-18T11:10:40.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.111+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d01551b0 con 0x7fb4d0150ec0 2023-10-18T11:10:40.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.112+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d014abf0 con 0x7fb4d0150ec0 2023-10-18T11:10:40.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.130+0000 7fb4c5ffb640 1 -- 172.21.15.151:0/3696554291 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb4c8005580 con 0x7fb4d0150ec0 2023-10-18T11:10:40.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.132+0000 7fb4c5ffb640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb4b406aec0 0x7fb4b406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.133+0000 7fb4c5ffb640 1 -- 172.21.15.151:0/3696554291 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb4c80580d0 con 0x7fb4d0150ec0 2023-10-18T11:10:40.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.133+0000 7fb4d53bd640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb4b406aec0 0x7fb4b406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.134+0000 7fb4d53bd640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb4b406aec0 0x7fb4b406d380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc005880 tx=0x7fb4cc009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:40.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.369+0000 7fb4c5ffb640 1 -- 172.21.15.151:0/3696554291 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4c8054410 con 0x7fb4d0150ec0 2023-10-18T11:10:40.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.576+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4d00c62c0 con 0x7fb4d0150ec0 2023-10-18T11:10:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.651+0000 7fb4c5ffb640 1 -- 172.21.15.151:0/3696554291 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7fb4c8057a30 con 0x7fb4d0150ec0 2023-10-18T11:10:40.654 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:40.655 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb4b406aec0 msgr2=0x7fb4b406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb4b406aec0 0x7fb4b406d380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc005880 tx=0x7fb4cc009040 comp rx=0 tx=0).stop 2023-10-18T11:10:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d0150ec0 msgr2=0x7fb4d00c2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d0150ec0 0x7fb4d00c2940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800c7e0 tx=0x7fb4c800cca0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 shutdown_connections 2023-10-18T11:10:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4d0150ec0 0x7fb4d00c2940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4d00c57a0 0x7fb4d0147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb4b406aec0 0x7fb4b406d380 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 --2- 172.21.15.151:0/3696554291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4d00c5080 0x7fb4d0156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.655+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 >> 172.21.15.151:0/3696554291 conn(0x7fb4d00c6f10 msgr2=0x7fb4d00c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:40.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.656+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 shutdown_connections 2023-10-18T11:10:40.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.656+0000 7fb4d7621640 1 -- 172.21.15.151:0/3696554291 wait complete. 2023-10-18T11:10:40.677 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T11:09:16.833723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T11:09:34.803213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T11:09:37.000724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T11:09:43.858153+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T11:10:40.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T11:10:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.883+0000 7fe3ff12e640 1 Processor -- start 2023-10-18T11:10:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.883+0000 7fe3ff12e640 1 -- start start 2023-10-18T11:10:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.884+0000 7fe3ff12e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe3f806aad0 0x7fe3f8156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.884+0000 7fe3ff12e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f80c1730 0x7fe3f8069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.884+0000 7fe3ff12e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f80c1ce0 con 0x7fe3f814ff20 2023-10-18T11:10:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.884+0000 7fe3ff12e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f8150300 con 0x7fe3f806aad0 2023-10-18T11:10:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.884+0000 7fe3ff12e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8156ab0 con 0x7fe3f80c1730 2023-10-18T11:10:40.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.885+0000 7fe3fe92d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f80c1730 0x7fe3f8069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.885+0000 7fe3fd92b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe3f806aad0 0x7fe3f8156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.885+0000 7fe3fe92d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f80c1730 0x7fe3f8069d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41962/0 (socket says 172.21.15.151:41962) 2023-10-18T11:10:40.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.885+0000 7fe3fe92d640 1 -- 172.21.15.151:0/3668375938 learned_addr learned my addr 172.21.15.151:0/3668375938 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.888+0000 7fe3fe92d640 1 -- 172.21.15.151:0/3668375938 >> v2:172.21.15.169:3300/0 conn(0x7fe3f806aad0 msgr2=0x7fe3f8156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.888+0000 7fe3fe92d640 1 --2- 172.21.15.151:0/3668375938 >> v2:172.21.15.169:3300/0 conn(0x7fe3f806aad0 0x7fe3f8156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.888+0000 7fe3fe92d640 1 -- 172.21.15.151:0/3668375938 >> v1:172.21.15.169:6789/0 conn(0x7fe3f814ff20 legacy=0x7fe3f806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.888+0000 7fe3fe92d640 1 -- 172.21.15.151:0/3668375938 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80c36b0 con 0x7fe3f80c1730 2023-10-18T11:10:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.890+0000 7fe3fe92d640 1 --2- 172.21.15.151:0/3668375938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f80c1730 0x7fe3f8069d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e50 tx=0x7fe3f002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1baaf06df87227d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.894+0000 7fe3fd12a640 1 -- 172.21.15.151:0/3668375938 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f002cb00 con 0x7fe3f80c1730 2023-10-18T11:10:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.894+0000 7fe3fd12a640 1 -- 172.21.15.151:0/3668375938 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f002cc60 con 0x7fe3f80c1730 2023-10-18T11:10:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.894+0000 7fe3fd12a640 1 -- 172.21.15.151:0/3668375938 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f00343f0 con 0x7fe3f80c1730 2023-10-18T11:10:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.895+0000 7fe3ff12e640 1 -- 172.21.15.151:0/3668375938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f80c1730 msgr2=0x7fe3f8069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.895+0000 7fe3ff12e640 1 --2- 172.21.15.151:0/3668375938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f80c1730 0x7fe3f8069d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e50 tx=0x7fe3f002bf60 comp rx=0 tx=0).stop 2023-10-18T11:10:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.895+0000 7fe3ff12e640 1 -- 172.21.15.151:0/3668375938 shutdown_connections 2023-10-18T11:10:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.895+0000 7fe3ff12e640 1 --2- 172.21.15.151:0/3668375938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f80c1730 0x7fe3f8069d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.895+0000 7fe3ff12e640 1 --2- 172.21.15.151:0/3668375938 >> v2:172.21.15.169:3300/0 conn(0x7fe3f806aad0 0x7fe3f8156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.895+0000 7fe3ff12e640 1 -- 172.21.15.151:0/3668375938 >> 172.21.15.151:0/3668375938 conn(0x7fe3f80ca330 msgr2=0x7fe3f80ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.895+0000 7fe3ff12e640 1 -- 172.21.15.151:0/3668375938 shutdown_connections 2023-10-18T11:10:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.895+0000 7fe3ff12e640 1 -- 172.21.15.151:0/3668375938 wait complete. 2023-10-18T11:10:40.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.897+0000 7fe3ff12e640 1 Processor -- start 2023-10-18T11:10:40.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.897+0000 7fe3ff12e640 1 -- start start 2023-10-18T11:10:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.898+0000 7fe3ff12e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f806aad0 0x7fe3f8144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.898+0000 7fe3ff12e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3f80c1730 0x7fe3f81459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.899+0000 7fe3ff12e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f814ff20 0x7fe3f813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.899+0000 7fe3ff12e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8153ea0 con 0x7fe3f80c1730 2023-10-18T11:10:40.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.899+0000 7fe3ff12e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8145510 con 0x7fe3f806aad0 2023-10-18T11:10:40.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.899+0000 7fe3ff12e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8155300 con 0x7fe3f814ff20 2023-10-18T11:10:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.899+0000 7fe3fd92b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3f80c1730 0x7fe3f81459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.899+0000 7fe3fe92d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f814ff20 0x7fe3f813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.899+0000 7fe3fe12c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f806aad0 0x7fe3f8144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.900+0000 7fe3fd92b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3f80c1730 0x7fe3f81459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60538/0 (socket says 172.21.15.151:60538) 2023-10-18T11:10:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.900+0000 7fe3fe92d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f814ff20 0x7fe3f813ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41976/0 (socket says 172.21.15.151:41976) 2023-10-18T11:10:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.900+0000 7fe3fd92b640 1 -- 172.21.15.151:0/33064939 learned_addr learned my addr 172.21.15.151:0/33064939 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.903+0000 7fe3fe12c640 1 -- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f814ff20 msgr2=0x7fe3f813ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.903+0000 7fe3fe12c640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f814ff20 0x7fe3f813ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.903+0000 7fe3fe12c640 1 -- 172.21.15.151:0/33064939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3f80c1730 msgr2=0x7fe3f81459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:40.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.903+0000 7fe3fe12c640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3f80c1730 0x7fe3f81459a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:40.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.903+0000 7fe3fe12c640 1 -- 172.21.15.151:0/33064939 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0009b30 con 0x7fe3f806aad0 2023-10-18T11:10:40.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.905+0000 7fe3fe12c640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f806aad0 0x7fe3f8144880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400c3c0 tx=0x7fe3f400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.907+0000 7fe3eeffd640 1 -- 172.21.15.151:0/33064939 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f40052d0 con 0x7fe3f806aad0 2023-10-18T11:10:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.907+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f80c8c10 con 0x7fe3f806aad0 2023-10-18T11:10:40.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.907+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f81558a0 con 0x7fe3f806aad0 2023-10-18T11:10:40.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.909+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f80c6bb0 con 0x7fe3f806aad0 2023-10-18T11:10:40.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.927+0000 7fe3eeffd640 1 -- 172.21.15.151:0/33064939 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f4001000 con 0x7fe3f806aad0 2023-10-18T11:10:40.930 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.927+0000 7fe3eeffd640 1 -- 172.21.15.151:0/33064939 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4007020 con 0x7fe3f806aad0 2023-10-18T11:10:40.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.931+0000 7fe3eeffd640 1 -- 172.21.15.151:0/33064939 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe3f4007240 con 0x7fe3f806aad0 2023-10-18T11:10:40.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.932+0000 7fe3eeffd640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe3dc06aea0 0x7fe3dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:40.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.932+0000 7fe3eeffd640 1 -- 172.21.15.151:0/33064939 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe3f4089160 con 0x7fe3f806aad0 2023-10-18T11:10:40.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.932+0000 7fe3fd92b640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe3dc06aea0 0x7fe3dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:40.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:40.933+0000 7fe3fd92b640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe3dc06aea0 0x7fe3dc06d360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8142eb0 tx=0x7fe3e8009110 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:41.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.174+0000 7fe3eeffd640 1 -- 172.21.15.151:0/33064939 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3f4053ee0 con 0x7fe3f806aad0 2023-10-18T11:10:41.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.397+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3f8155ab0 con 0x7fe3f806aad0 2023-10-18T11:10:41.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.402+0000 7fe3eeffd640 1 -- 172.21.15.151:0/33064939 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3f40200a0 con 0x7fe3f806aad0 2023-10-18T11:10:41.405 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-10-18T11:10:41.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.406+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe3dc06aea0 msgr2=0x7fe3dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:41.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.406+0000 7fe3ff12e640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe3dc06aea0 0x7fe3dc06d360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8142eb0 tx=0x7fe3e8009110 comp rx=0 tx=0).stop 2023-10-18T11:10:41.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.406+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f806aad0 msgr2=0x7fe3f8144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:41.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.406+0000 7fe3ff12e640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f806aad0 0x7fe3f8144880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400c3c0 tx=0x7fe3f400c880 comp rx=0 tx=0).stop 2023-10-18T11:10:41.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.406+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 shutdown_connections 2023-10-18T11:10:41.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.406+0000 7fe3ff12e640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3f814ff20 0x7fe3f813ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.406+0000 7fe3ff12e640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3f80c1730 0x7fe3f81459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.407+0000 7fe3ff12e640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe3dc06aea0 0x7fe3dc06d360 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.407+0000 7fe3ff12e640 1 --2- 172.21.15.151:0/33064939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3f806aad0 0x7fe3f8144880 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.407+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 >> 172.21.15.151:0/33064939 conn(0x7fe3f80ca330 msgr2=0x7fe3f814d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:41.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.407+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 shutdown_connections 2023-10-18T11:10:41.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.407+0000 7fe3ff12e640 1 -- 172.21.15.151:0/33064939 wait complete. 2023-10-18T11:10:41.436 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T11:10:41.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.643+0000 7f1a1a6fc640 1 Processor -- start 2023-10-18T11:10:41.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.643+0000 7f1a1a6fc640 1 -- start start 2023-10-18T11:10:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.645+0000 7f1a1a6fc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a140c4be0 0x7f1a140c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.645+0000 7f1a1a6fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a14155fe0 0x7f1a140c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.645+0000 7f1a1a6fc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140c98e0 con 0x7f1a140c70c0 2023-10-18T11:10:41.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.645+0000 7f1a1a6fc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a140c9700 con 0x7f1a140c4be0 2023-10-18T11:10:41.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.645+0000 7f1a1a6fc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140c6c30 con 0x7f1a14155fe0 2023-10-18T11:10:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.646+0000 7f1a18c99640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a14155fe0 0x7f1a140c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.646+0000 7f1a13fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a140c4be0 0x7f1a140c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.646+0000 7f1a18c99640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a14155fe0 0x7f1a140c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41978/0 (socket says 172.21.15.151:41978) 2023-10-18T11:10:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.646+0000 7f1a18c99640 1 -- 172.21.15.151:0/3411868999 learned_addr learned my addr 172.21.15.151:0/3411868999 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.648+0000 7f1a18c99640 1 -- 172.21.15.151:0/3411868999 >> v2:172.21.15.151:3300/0 conn(0x7f1a140c4be0 msgr2=0x7f1a140c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.648+0000 7f1a18c99640 1 --2- 172.21.15.151:0/3411868999 >> v2:172.21.15.151:3300/0 conn(0x7f1a140c4be0 0x7f1a140c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.648+0000 7f1a18c99640 1 -- 172.21.15.151:0/3411868999 >> v1:172.21.15.151:6789/0 conn(0x7f1a140c70c0 legacy=0x7f1a14069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.648+0000 7f1a18c99640 1 -- 172.21.15.151:0/3411868999 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14156490 con 0x7f1a14155fe0 2023-10-18T11:10:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.650+0000 7f1a18c99640 1 --2- 172.21.15.151:0/3411868999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a14155fe0 0x7f1a140c9ce0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009e50 tx=0x7f1a0c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9819f13d3e2b7ca server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.654+0000 7f1a12ffd640 1 -- 172.21.15.151:0/3411868999 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c02ca80 con 0x7f1a14155fe0 2023-10-18T11:10:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.654+0000 7f1a12ffd640 1 -- 172.21.15.151:0/3411868999 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c02cbe0 con 0x7f1a14155fe0 2023-10-18T11:10:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.654+0000 7f1a12ffd640 1 -- 172.21.15.151:0/3411868999 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0343f0 con 0x7f1a14155fe0 2023-10-18T11:10:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.655+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/3411868999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a14155fe0 msgr2=0x7f1a140c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.655+0000 7f1a1a6fc640 1 --2- 172.21.15.151:0/3411868999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a14155fe0 0x7f1a140c9ce0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009e50 tx=0x7f1a0c02bee0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.655+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/3411868999 shutdown_connections 2023-10-18T11:10:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.655+0000 7f1a1a6fc640 1 --2- 172.21.15.151:0/3411868999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a14155fe0 0x7f1a140c9ce0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.655+0000 7f1a1a6fc640 1 --2- 172.21.15.151:0/3411868999 >> v2:172.21.15.151:3300/0 conn(0x7f1a140c4be0 0x7f1a140c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.655+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/3411868999 >> 172.21.15.151:0/3411868999 conn(0x7f1a140cb320 msgr2=0x7f1a140c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.655+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/3411868999 shutdown_connections 2023-10-18T11:10:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.655+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/3411868999 wait complete. 2023-10-18T11:10:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.657+0000 7f1a1a6fc640 1 Processor -- start 2023-10-18T11:10:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.657+0000 7f1a1a6fc640 1 -- start start 2023-10-18T11:10:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.658+0000 7f1a1a6fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a140c4be0 0x7f1a141566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.658+0000 7f1a1a6fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a140c70c0 0x7f1a1415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.658+0000 7f1a1a6fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a14155fe0 0x7f1a1414e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.658+0000 7f1a1a6fc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14156fc0 con 0x7f1a140c4be0 2023-10-18T11:10:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.658+0000 7f1a1a6fc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14152390 con 0x7f1a14155fe0 2023-10-18T11:10:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.658+0000 7f1a1a6fc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1415ec00 con 0x7f1a140c70c0 2023-10-18T11:10:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.659+0000 7f1a13fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a140c4be0 0x7f1a141566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.659+0000 7f1a18c99640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a14155fe0 0x7f1a1414e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.659+0000 7f1a137fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a140c70c0 0x7f1a1415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.659+0000 7f1a13fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a140c4be0 0x7f1a141566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60556/0 (socket says 172.21.15.151:60556) 2023-10-18T11:10:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.659+0000 7f1a13fff640 1 -- 172.21.15.151:0/2168581678 learned_addr learned my addr 172.21.15.151:0/2168581678 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.662+0000 7f1a137fe640 1 -- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a14155fe0 msgr2=0x7f1a1414e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.662+0000 7f1a137fe640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a14155fe0 0x7f1a1414e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.662+0000 7f1a137fe640 1 -- 172.21.15.151:0/2168581678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a140c4be0 msgr2=0x7f1a141566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.662+0000 7f1a137fe640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a140c4be0 0x7f1a141566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.662+0000 7f1a137fe640 1 -- 172.21.15.151:0/2168581678 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c009b30 con 0x7f1a140c70c0 2023-10-18T11:10:41.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.664+0000 7f1a137fe640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a140c70c0 0x7f1a1415e6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800c340 tx=0x7f1a0800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:41.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.668+0000 7f1a10ff9640 1 -- 172.21.15.151:0/2168581678 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080052d0 con 0x7f1a140c70c0 2023-10-18T11:10:41.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.668+0000 7f1a10ff9640 1 -- 172.21.15.151:0/2168581678 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08005450 con 0x7f1a140c70c0 2023-10-18T11:10:41.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.668+0000 7f1a10ff9640 1 -- 172.21.15.151:0/2168581678 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08007260 con 0x7f1a140c70c0 2023-10-18T11:10:41.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.668+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a14156ce0 con 0x7f1a140c70c0 2023-10-18T11:10:41.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.668+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a14151d40 con 0x7f1a140c70c0 2023-10-18T11:10:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.670+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1404e160 con 0x7f1a140c70c0 2023-10-18T11:10:41.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.689+0000 7f1a10ff9640 1 -- 172.21.15.151:0/2168581678 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a080073c0 con 0x7f1a140c70c0 2023-10-18T11:10:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.690+0000 7f1a10ff9640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a0006aec0 0x7f1a0006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.690+0000 7f1a13fff640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a0006aec0 0x7f1a0006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.691+0000 7f1a13fff640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a0006aec0 0x7f1a0006d380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009c00 tx=0x7f1a04009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.691+0000 7f1a10ff9640 1 -- 172.21.15.151:0/2168581678 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1a08057b90 con 0x7f1a140c70c0 2023-10-18T11:10:41.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:41.929+0000 7f1a10ff9640 1 -- 172.21.15.151:0/2168581678 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a08053ed0 con 0x7f1a140c70c0 2023-10-18T11:10:42.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.144+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a140c5ac0 con 0x7f1a140c70c0 2023-10-18T11:10:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.149+0000 7f1a10ff9640 1 -- 172.21.15.151:0/2168581678 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a080200a0 con 0x7f1a140c70c0 2023-10-18T11:10:42.152 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:10:42.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a0006aec0 msgr2=0x7f1a0006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a0006aec0 0x7f1a0006d380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009c00 tx=0x7f1a04009190 comp rx=0 tx=0).stop 2023-10-18T11:10:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a140c70c0 msgr2=0x7f1a1415e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a140c70c0 0x7f1a1415e6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800c340 tx=0x7f1a0800c800 comp rx=0 tx=0).stop 2023-10-18T11:10:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 shutdown_connections 2023-10-18T11:10:42.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1a0006aec0 0x7f1a0006d380 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a14155fe0 0x7f1a1414e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a140c70c0 0x7f1a1415e6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 --2- 172.21.15.151:0/2168581678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a140c4be0 0x7f1a141566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 >> 172.21.15.151:0/2168581678 conn(0x7f1a140cb320 msgr2=0x7f1a1414f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:42.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 shutdown_connections 2023-10-18T11:10:42.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.152+0000 7f1a1a6fc640 1 -- 172.21.15.151:0/2168581678 wait complete. 2023-10-18T11:10:42.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T11:10:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.378+0000 7f41433d0640 1 Processor -- start 2023-10-18T11:10:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.378+0000 7f41433d0640 1 -- start start 2023-10-18T11:10:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.380+0000 7f41433d0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c14fe20 0x7f413c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.380+0000 7f41433d0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f413c070790 0x7f413c0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.380+0000 7f41433d0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413c0c18e0 con 0x7f413c070ee0 2023-10-18T11:10:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.380+0000 7f41433d0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413c0c5350 con 0x7f413c070790 2023-10-18T11:10:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.380+0000 7f41433d0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c0c20f0 con 0x7f413c14fe20 2023-10-18T11:10:42.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.381+0000 7f414116c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c14fe20 0x7f413c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:42.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.381+0000 7f414096b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f413c070790 0x7f413c0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:42.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.381+0000 7f414196d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f413c070ee0 0x7f413c0718e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:55584/0 (socket says 172.21.15.151:55584) 2023-10-18T11:10:42.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.381+0000 7f414196d640 1 -- 172.21.15.151:0/1753816787 learned_addr learned my addr 172.21.15.151:0/1753816787 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.384+0000 7f414116c640 1 -- 172.21.15.151:0/1753816787 >> v2:172.21.15.151:3300/0 conn(0x7f413c070790 msgr2=0x7f413c0c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.384+0000 7f414116c640 1 --2- 172.21.15.151:0/1753816787 >> v2:172.21.15.151:3300/0 conn(0x7f413c070790 0x7f413c0c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.384+0000 7f414116c640 1 -- 172.21.15.151:0/1753816787 >> v1:172.21.15.169:6789/0 conn(0x7f413c070ee0 legacy=0x7f413c0718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:42.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.384+0000 7f414116c640 1 -- 172.21.15.151:0/1753816787 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c0c1b30 con 0x7f413c14fe20 2023-10-18T11:10:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.386+0000 7f414116c640 1 --2- 172.21.15.151:0/1753816787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c14fe20 0x7f413c1566f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f41380097a0 tx=0x7f413802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794908ebeeaf1cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:42.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.389+0000 7f4133fff640 1 -- 172.21.15.151:0/1753816787 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413802d040 con 0x7f413c14fe20 2023-10-18T11:10:42.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.390+0000 7f4133fff640 1 -- 172.21.15.151:0/1753816787 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4138031810 con 0x7f413c14fe20 2023-10-18T11:10:42.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.390+0000 7f4133fff640 1 -- 172.21.15.151:0/1753816787 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138031ba0 con 0x7f413c14fe20 2023-10-18T11:10:42.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.390+0000 7f41433d0640 1 -- 172.21.15.151:0/1753816787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c14fe20 msgr2=0x7f413c1566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:42.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.390+0000 7f41433d0640 1 --2- 172.21.15.151:0/1753816787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c14fe20 0x7f413c1566f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f41380097a0 tx=0x7f413802b8b0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.390+0000 7f41433d0640 1 -- 172.21.15.151:0/1753816787 shutdown_connections 2023-10-18T11:10:42.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.390+0000 7f41433d0640 1 --2- 172.21.15.151:0/1753816787 >> v2:172.21.15.151:3300/0 conn(0x7f413c070790 0x7f413c0c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.390+0000 7f41433d0640 1 --2- 172.21.15.151:0/1753816787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c14fe20 0x7f413c1566f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.390+0000 7f41433d0640 1 -- 172.21.15.151:0/1753816787 >> 172.21.15.151:0/1753816787 conn(0x7f413c069f70 msgr2=0x7f413c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.390+0000 7f41433d0640 1 -- 172.21.15.151:0/1753816787 shutdown_connections 2023-10-18T11:10:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.391+0000 7f41433d0640 1 -- 172.21.15.151:0/1753816787 wait complete. 2023-10-18T11:10:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.393+0000 7f41433d0640 1 Processor -- start 2023-10-18T11:10:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.393+0000 7f41433d0640 1 -- start start 2023-10-18T11:10:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.394+0000 7f41433d0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c070790 0x7f413c1407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.394+0000 7f41433d0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f413c070ee0 0x7f413c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.394+0000 7f41433d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413c14fe20 0x7f413c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.394+0000 7f41433d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c14ded0 con 0x7f413c14fe20 2023-10-18T11:10:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.394+0000 7f41433d0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c14e7e0 con 0x7f413c070ee0 2023-10-18T11:10:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.394+0000 7f41433d0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c13fb10 con 0x7f413c070790 2023-10-18T11:10:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.395+0000 7f414116c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c070790 0x7f413c1407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.395+0000 7f414096b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f413c070ee0 0x7f413c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.395+0000 7f414116c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c070790 0x7f413c1407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:42016/0 (socket says 172.21.15.151:42016) 2023-10-18T11:10:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.395+0000 7f414116c640 1 -- 172.21.15.151:0/2363379668 learned_addr learned my addr 172.21.15.151:0/2363379668 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.397+0000 7f414196d640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413c14fe20 0x7f413c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:42.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.398+0000 7f414116c640 1 -- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f413c070ee0 msgr2=0x7f413c153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:42.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.398+0000 7f414116c640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f413c070ee0 0x7f413c153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.398+0000 7f414116c640 1 -- 172.21.15.151:0/2363379668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413c14fe20 msgr2=0x7f413c153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:42.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.398+0000 7f414116c640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413c14fe20 0x7f413c153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:42.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.398+0000 7f414116c640 1 -- 172.21.15.151:0/2363379668 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009400 con 0x7f413c070790 2023-10-18T11:10:42.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.401+0000 7f414116c640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c070790 0x7f413c1407e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f413802bec0 tx=0x7f41380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.405+0000 7f4131ffb640 1 -- 172.21.15.151:0/2363379668 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413803ad60 con 0x7f413c070790 2023-10-18T11:10:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.405+0000 7f4131ffb640 1 -- 172.21.15.151:0/2363379668 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41380423f0 con 0x7f413c070790 2023-10-18T11:10:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.405+0000 7f4131ffb640 1 -- 172.21.15.151:0/2363379668 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380427a0 con 0x7f413c070790 2023-10-18T11:10:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.405+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413c155570 con 0x7f413c070790 2023-10-18T11:10:42.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.405+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413c13f1e0 con 0x7f413c070790 2023-10-18T11:10:42.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.406+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413c04e160 con 0x7f413c070790 2023-10-18T11:10:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.424+0000 7f4131ffb640 1 -- 172.21.15.151:0/2363379668 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f413804b3b0 con 0x7f413c070790 2023-10-18T11:10:42.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.426+0000 7f4131ffb640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f412006aef0 0x7f412006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:42.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.426+0000 7f414096b640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f412006aef0 0x7f412006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.427+0000 7f414096b640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f412006aef0 0x7f412006d3b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f413c141090 tx=0x7f412c009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.427+0000 7f4131ffb640 1 -- 172.21.15.151:0/2363379668 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f413807aa20 con 0x7f413c070790 2023-10-18T11:10:42.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.665+0000 7f4131ffb640 1 -- 172.21.15.151:0/2363379668 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4138076d60 con 0x7f413c070790 2023-10-18T11:10:42.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:42.869+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f413c0731a0 con 0x7f413c070790 2023-10-18T11:10:43.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.036+0000 7f4131ffb640 1 -- 172.21.15.151:0/2363379668 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41380470a0 con 0x7f413c070790 2023-10-18T11:10:43.038 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-10-18T11:10:43.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f412006aef0 msgr2=0x7f412006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:43.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f412006aef0 0x7f412006d3b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f413c141090 tx=0x7f412c009190 comp rx=0 tx=0).stop 2023-10-18T11:10:43.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c070790 msgr2=0x7f413c1407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:43.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c070790 0x7f413c1407e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f413802bec0 tx=0x7f41380046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 shutdown_connections 2023-10-18T11:10:43.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413c14fe20 0x7f413c153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f412006aef0 0x7f412006d3b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f413c070ee0 0x7f413c153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 --2- 172.21.15.151:0/2363379668 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f413c070790 0x7f413c1407e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 >> 172.21.15.151:0/2363379668 conn(0x7f413c069f70 msgr2=0x7f413c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 shutdown_connections 2023-10-18T11:10:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.039+0000 7f41433d0640 1 -- 172.21.15.151:0/2363379668 wait complete. 2023-10-18T11:10:43.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T11:10:43.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.275+0000 7f35de697640 1 Processor -- start 2023-10-18T11:10:43.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.275+0000 7f35de697640 1 -- start start 2023-10-18T11:10:43.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.276+0000 7f35de697640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f35d81510c0 0x7f35d8157890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:43.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.276+0000 7f35de697640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:43.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.277+0000 7f35de697640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d815a5a0 con 0x7f35d80c4c00 2023-10-18T11:10:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.277+0000 7f35de697640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d80c70b0 con 0x7f35d81510c0 2023-10-18T11:10:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.277+0000 7f35de697640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8157dd0 con 0x7f35d815b040 2023-10-18T11:10:43.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.277+0000 7f35d7fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f35d81510c0 0x7f35d8157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:43.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.277+0000 7f35d77fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.277+0000 7f35dcc34640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f35d80c4c00 0x7f35d8069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:32840/0 (socket says 172.21.15.151:32840) 2023-10-18T11:10:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.277+0000 7f35dcc34640 1 -- 172.21.15.151:0/934953700 learned_addr learned my addr 172.21.15.151:0/934953700 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.280+0000 7f35d77fe640 1 -- 172.21.15.151:0/934953700 >> v2:172.21.15.169:3300/0 conn(0x7f35d81510c0 msgr2=0x7f35d8157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.280+0000 7f35d77fe640 1 --2- 172.21.15.151:0/934953700 >> v2:172.21.15.169:3300/0 conn(0x7f35d81510c0 0x7f35d8157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.280+0000 7f35d77fe640 1 -- 172.21.15.151:0/934953700 >> v1:172.21.15.151:6789/0 conn(0x7f35d80c4c00 legacy=0x7f35d8069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.280+0000 7f35d77fe640 1 -- 172.21.15.151:0/934953700 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d80c66d0 con 0x7f35d815b040 2023-10-18T11:10:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.282+0000 7f35d77fe640 1 --2- 172.21.15.151:0/934953700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8070e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f35c00097a0 tx=0x7f35c002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc58aad6d1103589 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.286+0000 7f35d6ffd640 1 -- 172.21.15.151:0/934953700 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0030800 con 0x7f35d815b040 2023-10-18T11:10:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.286+0000 7f35d6ffd640 1 -- 172.21.15.151:0/934953700 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0030960 con 0x7f35d815b040 2023-10-18T11:10:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.286+0000 7f35d6ffd640 1 -- 172.21.15.151:0/934953700 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0030cf0 con 0x7f35d815b040 2023-10-18T11:10:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.287+0000 7f35de697640 1 -- 172.21.15.151:0/934953700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 msgr2=0x7f35d8070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.287+0000 7f35de697640 1 --2- 172.21.15.151:0/934953700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8070e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f35c00097a0 tx=0x7f35c002b940 comp rx=0 tx=0).stop 2023-10-18T11:10:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.287+0000 7f35de697640 1 -- 172.21.15.151:0/934953700 shutdown_connections 2023-10-18T11:10:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.287+0000 7f35de697640 1 --2- 172.21.15.151:0/934953700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8070e00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.287+0000 7f35de697640 1 --2- 172.21.15.151:0/934953700 >> v2:172.21.15.169:3300/0 conn(0x7f35d81510c0 0x7f35d8157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.287+0000 7f35de697640 1 -- 172.21.15.151:0/934953700 >> 172.21.15.151:0/934953700 conn(0x7f35d806b080 msgr2=0x7f35d806b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:43.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.287+0000 7f35de697640 1 -- 172.21.15.151:0/934953700 shutdown_connections 2023-10-18T11:10:43.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.287+0000 7f35de697640 1 -- 172.21.15.151:0/934953700 wait complete. 2023-10-18T11:10:43.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.289+0000 7f35de697640 1 Processor -- start 2023-10-18T11:10:43.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.289+0000 7f35de697640 1 -- start start 2023-10-18T11:10:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.290+0000 7f35de697640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d80c4c00 0x7f35d806b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.290+0000 7f35de697640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d81510c0 0x7f35d80bcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.290+0000 7f35de697640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.290+0000 7f35de697640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80bbec0 con 0x7f35d81510c0 2023-10-18T11:10:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.290+0000 7f35de697640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80bdb90 con 0x7f35d80c4c00 2023-10-18T11:10:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.290+0000 7f35de697640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80be150 con 0x7f35d815b040 2023-10-18T11:10:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.291+0000 7f35dcc34640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.291+0000 7f35d77fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d81510c0 0x7f35d80bcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:43.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.292+0000 7f35dcc34640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:42028/0 (socket says 172.21.15.151:42028) 2023-10-18T11:10:43.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.292+0000 7f35dcc34640 1 -- 172.21.15.151:0/1227098472 learned_addr learned my addr 172.21.15.151:0/1227098472 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:43.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.294+0000 7f35d7fff640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d80c4c00 0x7f35d806b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.296+0000 7f35dcc34640 1 -- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d80c4c00 msgr2=0x7f35d806b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.296+0000 7f35dcc34640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d80c4c00 0x7f35d806b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.296+0000 7f35dcc34640 1 -- 172.21.15.151:0/1227098472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d81510c0 msgr2=0x7f35d80bcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.296+0000 7f35dcc34640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d81510c0 0x7f35d80bcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.296+0000 7f35dcc34640 1 -- 172.21.15.151:0/1227098472 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0009400 con 0x7f35d815b040 2023-10-18T11:10:43.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.298+0000 7f35dcc34640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8156190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c450 tx=0x7f35d000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:43.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.302+0000 7f35d4ff9640 1 -- 172.21.15.151:0/1227098472 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0005ce0 con 0x7f35d815b040 2023-10-18T11:10:43.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.302+0000 7f35d4ff9640 1 -- 172.21.15.151:0/1227098472 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d0005e40 con 0x7f35d815b040 2023-10-18T11:10:43.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.302+0000 7f35d4ff9640 1 -- 172.21.15.151:0/1227098472 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0007270 con 0x7f35d815b040 2023-10-18T11:10:43.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.302+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d81f23a0 con 0x7f35d815b040 2023-10-18T11:10:43.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.302+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d80bdde0 con 0x7f35d815b040 2023-10-18T11:10:43.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.303+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d804e160 con 0x7f35d815b040 2023-10-18T11:10:43.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.321+0000 7f35d4ff9640 1 -- 172.21.15.151:0/1227098472 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f35d00073d0 con 0x7f35d815b040 2023-10-18T11:10:43.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.321+0000 7f35d4ff9640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f35b806aec0 0x7f35b806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:43.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.322+0000 7f35d7fff640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f35b806aec0 0x7f35b806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:43.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.323+0000 7f35d7fff640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f35b806aec0 0x7f35b806d380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f35c80113e0 tx=0x7f35c800b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:43.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.323+0000 7f35d4ff9640 1 -- 172.21.15.151:0/1227098472 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f35d00580b0 con 0x7f35d815b040 2023-10-18T11:10:43.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.563+0000 7f35d4ff9640 1 -- 172.21.15.151:0/1227098472 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35d00543f0 con 0x7f35d815b040 2023-10-18T11:10:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.760+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f35d80c14e0 con 0x7f35d815b040 2023-10-18T11:10:43.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.765+0000 7f35d4ff9640 1 -- 172.21.15.151:0/1227098472 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f35d00210a0 con 0x7f35d815b040 2023-10-18T11:10:43.768 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:10:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f35b806aec0 msgr2=0x7f35b806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f35b806aec0 0x7f35b806d380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f35c80113e0 tx=0x7f35c800b040 comp rx=0 tx=0).stop 2023-10-18T11:10:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 msgr2=0x7f35d8156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8156190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c450 tx=0x7f35d000c910 comp rx=0 tx=0).stop 2023-10-18T11:10:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 shutdown_connections 2023-10-18T11:10:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35d815b040 0x7f35d8156190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d81510c0 0x7f35d80bcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f35b806aec0 0x7f35b806d380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 --2- 172.21.15.151:0/1227098472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35d80c4c00 0x7f35d806b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 >> 172.21.15.151:0/1227098472 conn(0x7f35d806b080 msgr2=0x7f35d806f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 shutdown_connections 2023-10-18T11:10:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.768+0000 7f35de697640 1 -- 172.21.15.151:0/1227098472 wait complete. 2023-10-18T11:10:43.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:10:43.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.996+0000 7f20f19f0640 1 Processor -- start 2023-10-18T11:10:43.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.996+0000 7f20f19f0640 1 -- start start 2023-10-18T11:10:44.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.997+0000 7f20f19f0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f20ec0c9a90 0x7f20ec0c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.998+0000 7f20f19f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec0ca5d0 0x7f20ec06ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.998+0000 7f20f19f0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0ca3b0 con 0x7f20ec06b040 2023-10-18T11:10:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.998+0000 7f20f19f0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec159960 con 0x7f20ec0c9a90 2023-10-18T11:10:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.998+0000 7f20f19f0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0caac0 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.998+0000 7f20eaffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f20ec0c9a90 0x7f20ec0c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:44.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.999+0000 7f20eb7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f20ec06b040 0x7f20ec15c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:55596/0 (socket says 172.21.15.151:55596) 2023-10-18T11:10:44.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:43.999+0000 7f20eb7fe640 1 -- 172.21.15.151:0/559388939 learned_addr learned my addr 172.21.15.151:0/559388939 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:44.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.003+0000 7f20eaffd640 1 -- 172.21.15.151:0/559388939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec0ca5d0 msgr2=0x7f20ec06ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:44.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.003+0000 7f20eaffd640 1 --2- 172.21.15.151:0/559388939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec0ca5d0 0x7f20ec06ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.003+0000 7f20eaffd640 1 -- 172.21.15.151:0/559388939 >> v1:172.21.15.169:6789/0 conn(0x7f20ec06b040 legacy=0x7f20ec15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.003+0000 7f20eaffd640 1 -- 172.21.15.151:0/559388939 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0cad80 con 0x7f20ec0c9a90 2023-10-18T11:10:44.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.009+0000 7f20eaffd640 1 --2- 172.21.15.151:0/559388939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0c9a90 0x7f20ec0c9e70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0097a0 tx=0x7f20dc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8f9521d2d19f205 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:44.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.013+0000 7f20e9ffb640 1 -- 172.21.15.151:0/559388939 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc02e070 con 0x7f20ec0c9a90 2023-10-18T11:10:44.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.013+0000 7f20e9ffb640 1 -- 172.21.15.151:0/559388939 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0315a0 con 0x7f20ec0c9a90 2023-10-18T11:10:44.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.013+0000 7f20e9ffb640 1 -- 172.21.15.151:0/559388939 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc031930 con 0x7f20ec0c9a90 2023-10-18T11:10:44.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.014+0000 7f20f19f0640 1 -- 172.21.15.151:0/559388939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0c9a90 msgr2=0x7f20ec0c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.014+0000 7f20f19f0640 1 --2- 172.21.15.151:0/559388939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0c9a90 0x7f20ec0c9e70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0097a0 tx=0x7f20dc02b840 comp rx=0 tx=0).stop 2023-10-18T11:10:44.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.014+0000 7f20f19f0640 1 -- 172.21.15.151:0/559388939 shutdown_connections 2023-10-18T11:10:44.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.014+0000 7f20f19f0640 1 --2- 172.21.15.151:0/559388939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec0ca5d0 0x7f20ec06ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.014+0000 7f20f19f0640 1 --2- 172.21.15.151:0/559388939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0c9a90 0x7f20ec0c9e70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.014+0000 7f20f19f0640 1 -- 172.21.15.151:0/559388939 >> 172.21.15.151:0/559388939 conn(0x7f20ec0714c0 msgr2=0x7f20ec0659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.014+0000 7f20f19f0640 1 -- 172.21.15.151:0/559388939 shutdown_connections 2023-10-18T11:10:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.014+0000 7f20f19f0640 1 -- 172.21.15.151:0/559388939 wait complete. 2023-10-18T11:10:44.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.017+0000 7f20f19f0640 1 Processor -- start 2023-10-18T11:10:44.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.017+0000 7f20f19f0640 1 -- start start 2023-10-18T11:10:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.018+0000 7f20f19f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec06b040 0x7f20ec0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.018+0000 7f20f19f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ec0c9a90 0x7f20ec1f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.018+0000 7f20f19f0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0ca5d0 0x7f20ec14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.018+0000 7f20f19f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec150030 con 0x7f20ec0c9a90 2023-10-18T11:10:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.019+0000 7f20f19f0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0cf6b0 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.019+0000 7f20f19f0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0cd8d0 con 0x7f20ec06b040 2023-10-18T11:10:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.019+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0ca5d0 0x7f20ec14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:44.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.019+0000 7f20eaffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec06b040 0x7f20ec0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:44.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.019+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0ca5d0 0x7f20ec14eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46746/0 (socket says 172.21.15.151:46746) 2023-10-18T11:10:44.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.020+0000 7f20eb7fe640 1 -- 172.21.15.151:0/4191460430 learned_addr learned my addr 172.21.15.151:0/4191460430 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.023+0000 7f20eb7fe640 1 -- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec06b040 msgr2=0x7f20ec0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.023+0000 7f20eb7fe640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec06b040 0x7f20ec0cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.023+0000 7f20eb7fe640 1 -- 172.21.15.151:0/4191460430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ec0c9a90 msgr2=0x7f20ec1f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.023+0000 7f20eb7fe640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ec0c9a90 0x7f20ec1f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.023+0000 7f20eb7fe640 1 -- 172.21.15.151:0/4191460430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc009400 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.023+0000 7f20eaffd640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec06b040 0x7f20ec0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:44.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.025+0000 7f20eb7fe640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0ca5d0 0x7f20ec14eb80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f20e400cb10 tx=0x7f20e400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:44.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.029+0000 7f20d3fff640 1 -- 172.21.15.151:0/4191460430 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400ac70 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.029+0000 7f20d3fff640 1 -- 172.21.15.151:0/4191460430 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e400add0 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.029+0000 7f20d3fff640 1 -- 172.21.15.151:0/4191460430 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4012600 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.029+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec0cf3d0 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.029+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec0cd550 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.031+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec0cda10 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.049+0000 7f20d3fff640 1 -- 172.21.15.151:0/4191460430 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f20e4007070 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.050+0000 7f20d3fff640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f20d806aec0 0x7f20d806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.051+0000 7f20eaffd640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f20d806aec0 0x7f20d806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.052+0000 7f20d3fff640 1 -- 172.21.15.151:0/4191460430 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20e4058650 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.052+0000 7f20eaffd640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f20d806aec0 0x7f20d806d380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f20dc036000 tx=0x7f20dc03d040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:44.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.298+0000 7f20d3fff640 1 -- 172.21.15.151:0/4191460430 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20e4054990 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.549+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20ec0c9870 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.562+0000 7f20d3fff640 1 -- 172.21.15.151:0/4191460430 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6561 (secure 0 0 0) 0x7f20e4017090 con 0x7f20ec0ca5d0 2023-10-18T11:10:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:44.565 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2025487091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2025487091},{"type":"v1","addr":"172.21.15.169:6835","nonce":2025487091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T11:09:38.819021+0000","modified":"2023-10-18T11:10:33.837356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4288,"mds_2":4244,"mds_3":4241,"mds_4":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"f","rank":4,"incarnation":17,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6837/872383111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":872383111},{"type":"v1","addr":"172.21.15.169:6837","nonce":872383111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6839/520473080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":520473080},{"type":"v1","addr":"172.21.15.169:6839","nonce":520473080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6835/2666139932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2666139932},{"type":"v1","addr":"172.21.15.151:6835","nonce":2666139932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":15,"addr":"172.21.15.151:6833/251484638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":251484638},{"type":"v1","addr":"172.21.15.151:6833","nonce":251484638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4294":{"gid":4294,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6837/909327926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":909327926},{"type":"v1","addr":"172.21.15.151:6837","nonce":909327926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T11:10:44.566 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 18 2023-10-18T11:10:44.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.565+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f20d806aec0 msgr2=0x7f20d806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.565+0000 7f20f19f0640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f20d806aec0 0x7f20d806d380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f20dc036000 tx=0x7f20dc03d040 comp rx=0 tx=0).stop 2023-10-18T11:10:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.565+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0ca5d0 msgr2=0x7f20ec14eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.565+0000 7f20f19f0640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0ca5d0 0x7f20ec14eb80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f20e400cb10 tx=0x7f20e400a060 comp rx=0 tx=0).stop 2023-10-18T11:10:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.565+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 shutdown_connections 2023-10-18T11:10:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.565+0000 7f20f19f0640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f20d806aec0 0x7f20d806d380 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.565+0000 7f20f19f0640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20ec0ca5d0 0x7f20ec14eb80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.566+0000 7f20f19f0640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ec0c9a90 0x7f20ec1f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.566+0000 7f20f19f0640 1 --2- 172.21.15.151:0/4191460430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20ec06b040 0x7f20ec0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.566+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 >> 172.21.15.151:0/4191460430 conn(0x7f20ec0714c0 msgr2=0x7f20ec1523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.566+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 shutdown_connections 2023-10-18T11:10:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.566+0000 7f20f19f0640 1 -- 172.21.15.151:0/4191460430 wait complete. 2023-10-18T11:10:44.587 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:10:44.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.790+0000 7fa85631d640 1 Processor -- start 2023-10-18T11:10:44.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.790+0000 7fa85631d640 1 -- start start 2023-10-18T11:10:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.792+0000 7fa85631d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa8500706f0 0x7fa850159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.792+0000 7fa85631d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 0x7fa85006db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.792+0000 7fa85631d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85015d3e0 con 0x7fa85006d760 2023-10-18T11:10:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.792+0000 7fa85631d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85006e080 con 0x7fa8500706f0 2023-10-18T11:10:44.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.792+0000 7fa85631d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8500c4fd0 con 0x7fa850072060 2023-10-18T11:10:44.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.792+0000 7fa84f7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa8500706f0 0x7fa850159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:44.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.792+0000 7fa84ffff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa85006d760 0x7fa85006ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:32848/0 (socket says 172.21.15.151:32848) 2023-10-18T11:10:44.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.792+0000 7fa84ffff640 1 -- 172.21.15.151:0/3700482522 learned_addr learned my addr 172.21.15.151:0/3700482522 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:44.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.793+0000 7fa8548ba640 1 --2- 172.21.15.151:0/3700482522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 0x7fa85006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:44.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.795+0000 7fa84f7fe640 1 -- 172.21.15.151:0/3700482522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 msgr2=0x7fa85006db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:44.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.795+0000 7fa84f7fe640 1 --2- 172.21.15.151:0/3700482522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 0x7fa85006db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.795+0000 7fa84f7fe640 1 -- 172.21.15.151:0/3700482522 >> v1:172.21.15.151:6789/0 conn(0x7fa85006d760 legacy=0x7fa85006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.795+0000 7fa84f7fe640 1 -- 172.21.15.151:0/3700482522 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85015c4f0 con 0x7fa8500706f0 2023-10-18T11:10:44.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.797+0000 7fa84f7fe640 1 --2- 172.21.15.151:0/3700482522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 0x7fa850159980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa8440097a0 tx=0x7fa84402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=169b144ae4369785 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:44.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.801+0000 7fa84effd640 1 -- 172.21.15.151:0/3700482522 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844030800 con 0x7fa8500706f0 2023-10-18T11:10:44.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.801+0000 7fa84effd640 1 -- 172.21.15.151:0/3700482522 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844030960 con 0x7fa8500706f0 2023-10-18T11:10:44.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.801+0000 7fa84effd640 1 -- 172.21.15.151:0/3700482522 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844030cf0 con 0x7fa8500706f0 2023-10-18T11:10:44.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.802+0000 7fa85631d640 1 -- 172.21.15.151:0/3700482522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 msgr2=0x7fa850159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.802+0000 7fa85631d640 1 --2- 172.21.15.151:0/3700482522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 0x7fa850159980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa8440097a0 tx=0x7fa84402b940 comp rx=0 tx=0).stop 2023-10-18T11:10:44.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.802+0000 7fa85631d640 1 -- 172.21.15.151:0/3700482522 shutdown_connections 2023-10-18T11:10:44.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.802+0000 7fa85631d640 1 --2- 172.21.15.151:0/3700482522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 0x7fa85006db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.802+0000 7fa85631d640 1 --2- 172.21.15.151:0/3700482522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 0x7fa850159980 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.802+0000 7fa85631d640 1 -- 172.21.15.151:0/3700482522 >> 172.21.15.151:0/3700482522 conn(0x7fa8500c6f10 msgr2=0x7fa8500c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:44.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.802+0000 7fa85631d640 1 -- 172.21.15.151:0/3700482522 shutdown_connections 2023-10-18T11:10:44.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.802+0000 7fa85631d640 1 -- 172.21.15.151:0/3700482522 wait complete. 2023-10-18T11:10:44.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.804+0000 7fa85631d640 1 Processor -- start 2023-10-18T11:10:44.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.804+0000 7fa85631d640 1 -- start start 2023-10-18T11:10:44.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.805+0000 7fa85631d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa85006d760 0x7fa850155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.805+0000 7fa85631d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 0x7fa8501e2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.805+0000 7fa85631d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 0x7fa8501e2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:44.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.805+0000 7fa85631d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8501e5030 con 0x7fa85006d760 2023-10-18T11:10:44.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.805+0000 7fa85631d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8501ee9d0 con 0x7fa8500706f0 2023-10-18T11:10:44.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.805+0000 7fa85631d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8501eebe0 con 0x7fa850072060 2023-10-18T11:10:44.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.806+0000 7fa84ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa85006d760 0x7fa850155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:44.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.806+0000 7fa8548ba640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 0x7fa8501e2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:44.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.806+0000 7fa84ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa85006d760 0x7fa850155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60608/0 (socket says 172.21.15.151:60608) 2023-10-18T11:10:44.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.806+0000 7fa84ffff640 1 -- 172.21.15.151:0/50813500 learned_addr learned my addr 172.21.15.151:0/50813500 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:44.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.807+0000 7fa84f7fe640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 0x7fa8501e2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:44.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.810+0000 7fa84f7fe640 1 -- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 msgr2=0x7fa8501e2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.810+0000 7fa84f7fe640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 0x7fa8501e2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.810+0000 7fa84f7fe640 1 -- 172.21.15.151:0/50813500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa85006d760 msgr2=0x7fa850155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:44.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.810+0000 7fa84f7fe640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa85006d760 0x7fa850155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:44.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.810+0000 7fa84f7fe640 1 -- 172.21.15.151:0/50813500 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844009400 con 0x7fa8500706f0 2023-10-18T11:10:44.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.812+0000 7fa84f7fe640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 0x7fa8501e2980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa844033000 tx=0x7fa8440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:44.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.816+0000 7fa84cff9640 1 -- 172.21.15.151:0/50813500 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84403e070 con 0x7fa8500706f0 2023-10-18T11:10:44.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.816+0000 7fa84cff9640 1 -- 172.21.15.151:0/50813500 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844039a10 con 0x7fa8500706f0 2023-10-18T11:10:44.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.816+0000 7fa84cff9640 1 -- 172.21.15.151:0/50813500 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844039da0 con 0x7fa8500706f0 2023-10-18T11:10:44.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.816+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8501eeec0 con 0x7fa8500706f0 2023-10-18T11:10:44.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.816+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8501ef480 con 0x7fa8500706f0 2023-10-18T11:10:44.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:44.817+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa850073710 con 0x7fa8500706f0 2023-10-18T11:10:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.069+0000 7fa84cff9640 1 -- 172.21.15.151:0/50813500 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa84404a3f0 con 0x7fa8500706f0 2023-10-18T11:10:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.071+0000 7fa84cff9640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa83c06aec0 0x7fa83c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.071+0000 7fa84ffff640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa83c06aec0 0x7fa83c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.071+0000 7fa84cff9640 1 -- 172.21.15.151:0/50813500 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa84407a150 con 0x7fa8500706f0 2023-10-18T11:10:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.072+0000 7fa84ffff640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa83c06aec0 0x7fa83c06d380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa840005880 tx=0x7fa840009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:45.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.084+0000 7fa84cff9640 1 -- 172.21.15.151:0/50813500 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa844076490 con 0x7fa8500706f0 2023-10-18T11:10:45.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.298+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8500c5f80 con 0x7fa8500706f0 2023-10-18T11:10:45.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.402+0000 7fa84cff9640 1 -- 172.21.15.151:0/50813500 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7fa844034090 con 0x7fa8500706f0 2023-10-18T11:10:45.406 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:45.406 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:10:45.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.407+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa83c06aec0 msgr2=0x7fa83c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:45.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.407+0000 7fa85631d640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa83c06aec0 0x7fa83c06d380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa840005880 tx=0x7fa840009040 comp rx=0 tx=0).stop 2023-10-18T11:10:45.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.407+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 msgr2=0x7fa8501e2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:45.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.407+0000 7fa85631d640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 0x7fa8501e2980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa844033000 tx=0x7fa8440046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.407+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 shutdown_connections 2023-10-18T11:10:45.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.407+0000 7fa85631d640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa850072060 0x7fa8501e2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.407+0000 7fa85631d640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa83c06aec0 0x7fa83c06d380 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.407+0000 7fa85631d640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8500706f0 0x7fa8501e2980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.407+0000 7fa85631d640 1 --2- 172.21.15.151:0/50813500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa85006d760 0x7fa850155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.408+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 >> 172.21.15.151:0/50813500 conn(0x7fa8500c6f10 msgr2=0x7fa850147f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:45.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.408+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 shutdown_connections 2023-10-18T11:10:45.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.408+0000 7fa85631d640 1 -- 172.21.15.151:0/50813500 wait complete. 2023-10-18T11:10:45.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:10:45.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.632+0000 7f94757c9640 1 Processor -- start 2023-10-18T11:10:45.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.633+0000 7f94757c9640 1 -- start start 2023-10-18T11:10:45.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.634+0000 7f94757c9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f947006d760 0x7f9470159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:45.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.635+0000 7f94757c9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f94700706f0 0x7f947006db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:45.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.635+0000 7f94757c9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947015d3e0 con 0x7f9470072060 2023-10-18T11:10:45.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.635+0000 7f94757c9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947006e080 con 0x7f94700706f0 2023-10-18T11:10:45.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.635+0000 7f94757c9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94700c4fd0 con 0x7f947006d760 2023-10-18T11:10:45.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.635+0000 7f946effd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f947006d760 0x7f9470159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:45.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.636+0000 7f946f7fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f94700706f0 0x7f947006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:45.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.636+0000 7f946effd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f947006d760 0x7f9470159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46772/0 (socket says 172.21.15.151:46772) 2023-10-18T11:10:45.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.636+0000 7f946effd640 1 -- 172.21.15.151:0/2188352711 learned_addr learned my addr 172.21.15.151:0/2188352711 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:45.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.638+0000 7f946effd640 1 -- 172.21.15.151:0/2188352711 >> v2:172.21.15.151:3300/0 conn(0x7f94700706f0 msgr2=0x7f947006db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:45.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.638+0000 7f946effd640 1 --2- 172.21.15.151:0/2188352711 >> v2:172.21.15.151:3300/0 conn(0x7f94700706f0 0x7f947006db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.638+0000 7f946effd640 1 -- 172.21.15.151:0/2188352711 >> v1:172.21.15.151:6789/0 conn(0x7f9470072060 legacy=0x7f947006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:45.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.638+0000 7f946effd640 1 -- 172.21.15.151:0/2188352711 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947015c4f0 con 0x7f947006d760 2023-10-18T11:10:45.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.640+0000 7f946effd640 1 --2- 172.21.15.151:0/2188352711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 0x7f9470159980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f947006c1d0 tx=0x7f946002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f4fab3651a5c99e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:45.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.644+0000 7f946e7fc640 1 -- 172.21.15.151:0/2188352711 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946002f850 con 0x7f947006d760 2023-10-18T11:10:45.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.644+0000 7f946e7fc640 1 -- 172.21.15.151:0/2188352711 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946002f9b0 con 0x7f947006d760 2023-10-18T11:10:45.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.644+0000 7f946e7fc640 1 -- 172.21.15.151:0/2188352711 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946002fd40 con 0x7f947006d760 2023-10-18T11:10:45.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.644+0000 7f94757c9640 1 -- 172.21.15.151:0/2188352711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 msgr2=0x7f9470159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:45.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.644+0000 7f94757c9640 1 --2- 172.21.15.151:0/2188352711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 0x7f9470159980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f947006c1d0 tx=0x7f946002ba30 comp rx=0 tx=0).stop 2023-10-18T11:10:45.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.645+0000 7f94757c9640 1 -- 172.21.15.151:0/2188352711 shutdown_connections 2023-10-18T11:10:45.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.645+0000 7f94757c9640 1 --2- 172.21.15.151:0/2188352711 >> v2:172.21.15.151:3300/0 conn(0x7f94700706f0 0x7f947006db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.645+0000 7f94757c9640 1 --2- 172.21.15.151:0/2188352711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 0x7f9470159980 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.645+0000 7f94757c9640 1 -- 172.21.15.151:0/2188352711 >> 172.21.15.151:0/2188352711 conn(0x7f94700c6f10 msgr2=0x7f94700c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:45.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.645+0000 7f94757c9640 1 -- 172.21.15.151:0/2188352711 shutdown_connections 2023-10-18T11:10:45.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.645+0000 7f94757c9640 1 -- 172.21.15.151:0/2188352711 wait complete. 2023-10-18T11:10:45.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.647+0000 7f94757c9640 1 Processor -- start 2023-10-18T11:10:45.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.647+0000 7f94757c9640 1 -- start start 2023-10-18T11:10:45.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.649+0000 7f94757c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 0x7f94700ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:45.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.649+0000 7f94757c9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94700706f0 0x7f94700ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:45.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.649+0000 7f94757c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9470072060 0x7f947015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:45.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.649+0000 7f94757c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947015a0c0 con 0x7f9470072060 2023-10-18T11:10:45.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.649+0000 7f94757c9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947014e180 con 0x7f947006d760 2023-10-18T11:10:45.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.649+0000 7f94757c9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9470143ec0 con 0x7f94700706f0 2023-10-18T11:10:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.649+0000 7f946effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 0x7f94700ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.649+0000 7f94667fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94700706f0 0x7f94700ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.650+0000 7f946f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9470072060 0x7f947015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.650+0000 7f946effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 0x7f94700ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46782/0 (socket says 172.21.15.151:46782) 2023-10-18T11:10:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.650+0000 7f946effd640 1 -- 172.21.15.151:0/3732106478 learned_addr learned my addr 172.21.15.151:0/3732106478 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.653+0000 7f946effd640 1 -- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94700706f0 msgr2=0x7f94700ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.653+0000 7f946effd640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94700706f0 0x7f94700ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.653+0000 7f946effd640 1 -- 172.21.15.151:0/3732106478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9470072060 msgr2=0x7f947015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.653+0000 7f946effd640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9470072060 0x7f947015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.653+0000 7f946effd640 1 -- 172.21.15.151:0/3732106478 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94600094d0 con 0x7f947006d760 2023-10-18T11:10:45.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.656+0000 7f946effd640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 0x7f94700ca470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f946002ba70 tx=0x7f9460004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:45.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.659+0000 7f9467fff640 1 -- 172.21.15.151:0/3732106478 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460037c40 con 0x7f947006d760 2023-10-18T11:10:45.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.659+0000 7f9467fff640 1 -- 172.21.15.151:0/3732106478 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9460037dc0 con 0x7f947006d760 2023-10-18T11:10:45.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.659+0000 7f9467fff640 1 -- 172.21.15.151:0/3732106478 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460041640 con 0x7f947006d760 2023-10-18T11:10:45.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.660+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9470144160 con 0x7f947006d760 2023-10-18T11:10:45.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.660+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947014e3f0 con 0x7f947006d760 2023-10-18T11:10:45.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.661+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947015a230 con 0x7f947006d760 2023-10-18T11:10:45.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.680+0000 7f9467fff640 1 -- 172.21.15.151:0/3732106478 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f94600417a0 con 0x7f947006d760 2023-10-18T11:10:45.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.681+0000 7f9467fff640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f945006aef0 0x7f945006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:45.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.681+0000 7f94667fc640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f945006aef0 0x7f945006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:45.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.682+0000 7f9467fff640 1 -- 172.21.15.151:0/3732106478 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f946003c070 con 0x7f947006d760 2023-10-18T11:10:45.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.682+0000 7f94667fc640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f945006aef0 0x7f945006d3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f94700734c0 tx=0x7f9458009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:45.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:45.926+0000 7f9467fff640 1 -- 172.21.15.151:0/3732106478 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9460077e90 con 0x7f947006d760 2023-10-18T11:10:46.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.171+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f947014d390 con 0x7f947006d760 2023-10-18T11:10:46.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.331+0000 7f9467fff640 1 -- 172.21.15.151:0/3732106478 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6561 (secure 0 0 0) 0x7f946007b4b0 con 0x7f947006d760 2023-10-18T11:10:46.334 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:10:46.334 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2025487091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2025487091},{"type":"v1","addr":"172.21.15.169:6835","nonce":2025487091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T11:09:38.819021+0000","modified":"2023-10-18T11:10:33.837356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4288,"mds_2":4244,"mds_3":4241,"mds_4":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"f","rank":4,"incarnation":17,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6837/872383111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":872383111},{"type":"v1","addr":"172.21.15.169:6837","nonce":872383111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6839/520473080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":520473080},{"type":"v1","addr":"172.21.15.169:6839","nonce":520473080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6835/2666139932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2666139932},{"type":"v1","addr":"172.21.15.151:6835","nonce":2666139932}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":15,"addr":"172.21.15.151:6833/251484638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":251484638},{"type":"v1","addr":"172.21.15.151:6833","nonce":251484638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4294":{"gid":4294,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6837/909327926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":909327926},{"type":"v1","addr":"172.21.15.151:6837","nonce":909327926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T11:10:46.335 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 18 2023-10-18T11:10:46.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f945006aef0 msgr2=0x7f945006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:46.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f945006aef0 0x7f945006d3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f94700734c0 tx=0x7f9458009040 comp rx=0 tx=0).stop 2023-10-18T11:10:46.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 msgr2=0x7f94700ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:46.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 0x7f94700ca470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f946002ba70 tx=0x7f9460004730 comp rx=0 tx=0).stop 2023-10-18T11:10:46.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 shutdown_connections 2023-10-18T11:10:46.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9470072060 0x7f947015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:46.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f94700706f0 0x7f94700ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:46.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f945006aef0 0x7f945006d3b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:46.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 --2- 172.21.15.151:0/3732106478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f947006d760 0x7f94700ca470 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:46.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 >> 172.21.15.151:0/3732106478 conn(0x7f94700c6f10 msgr2=0x7f9470071660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:46.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 shutdown_connections 2023-10-18T11:10:46.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:46.335+0000 7f94757c9640 1 -- 172.21.15.151:0/3732106478 wait complete. 2023-10-18T11:10:46.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18T11:09:38.819021+0000', 'modified': '2023-10-18T11:10:33.837356+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4294, 'mds_1': 4288, 'mds_2': 4244, 'mds_3': 4241, 'mds_4': 4238}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4238': {'gid': 4238, 'name': 'f', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.169:6837/872383111', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 872383111}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 872383111}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4241': {'gid': 4241, 'name': 'd', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.169:6839/520473080', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 520473080}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 520473080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4244': {'gid': 4244, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.151:6835/2666139932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 2666139932}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 2666139932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4288': {'gid': 4288, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.151:6833/251484638', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 251484638}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 251484638}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4294': {'gid': 4294, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.151:6837/909327926', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 909327926}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 909327926}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-18T11:10:46.962 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-18T11:10:46.962 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-18T11:10:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.196+0000 7fe918b6c640 1 Processor -- start 2023-10-18T11:10:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.196+0000 7fe918b6c640 1 -- start start 2023-10-18T11:10:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.198+0000 7fe918b6c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe91406e730 0x7fe91406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.199+0000 7fe918b6c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe914071800 0x7fe914071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.199+0000 7fe918b6c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9140c53c0 con 0x7fe9140c4fe0 2023-10-18T11:10:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.199+0000 7fe918b6c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9140c7f40 con 0x7fe91406e730 2023-10-18T11:10:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.199+0000 7fe918b6c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140c8220 con 0x7fe914071800 2023-10-18T11:10:47.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.215+0000 7fe912d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe914071800 0x7fe914071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.215+0000 7fe912d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe914071800 0x7fe914071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:42094/0 (socket says 172.21.15.151:42094) 2023-10-18T11:10:47.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.215+0000 7fe912d9d640 1 -- 172.21.15.151:0/3403727055 learned_addr learned my addr 172.21.15.151:0/3403727055 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:47.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.217+0000 7fe912d9d640 1 -- 172.21.15.151:0/3403727055 >> v2:172.21.15.151:3300/0 conn(0x7fe91406e730 msgr2=0x7fe91406eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.217+0000 7fe912d9d640 1 --2- 172.21.15.151:0/3403727055 >> v2:172.21.15.151:3300/0 conn(0x7fe91406e730 0x7fe91406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.217+0000 7fe912d9d640 1 -- 172.21.15.151:0/3403727055 >> v1:172.21.15.169:6789/0 conn(0x7fe9140c4fe0 legacy=0x7fe914069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.217+0000 7fe912d9d640 1 -- 172.21.15.151:0/3403727055 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9140c8500 con 0x7fe914071800 2023-10-18T11:10:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.219+0000 7fe912d9d640 1 --2- 172.21.15.151:0/3403727055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe914071800 0x7fe914071c90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9140c2670 tx=0x7fe90c02bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d056357cd64dd353 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.222+0000 7fe91159a640 1 -- 172.21.15.151:0/3403727055 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c02caf0 con 0x7fe914071800 2023-10-18T11:10:47.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.224+0000 7fe91159a640 1 -- 172.21.15.151:0/3403727055 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c02cc50 con 0x7fe914071800 2023-10-18T11:10:47.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.225+0000 7fe91159a640 1 -- 172.21.15.151:0/3403727055 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0343f0 con 0x7fe914071800 2023-10-18T11:10:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.225+0000 7fe918b6c640 1 -- 172.21.15.151:0/3403727055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe914071800 msgr2=0x7fe914071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.225+0000 7fe918b6c640 1 --2- 172.21.15.151:0/3403727055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe914071800 0x7fe914071c90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9140c2670 tx=0x7fe90c02bf50 comp rx=0 tx=0).stop 2023-10-18T11:10:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.225+0000 7fe918b6c640 1 -- 172.21.15.151:0/3403727055 shutdown_connections 2023-10-18T11:10:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.225+0000 7fe918b6c640 1 --2- 172.21.15.151:0/3403727055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe914071800 0x7fe914071c90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.225+0000 7fe918b6c640 1 --2- 172.21.15.151:0/3403727055 >> v2:172.21.15.151:3300/0 conn(0x7fe91406e730 0x7fe91406eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.225+0000 7fe918b6c640 1 -- 172.21.15.151:0/3403727055 >> 172.21.15.151:0/3403727055 conn(0x7fe91406b080 msgr2=0x7fe91406b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.226+0000 7fe918b6c640 1 -- 172.21.15.151:0/3403727055 shutdown_connections 2023-10-18T11:10:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.226+0000 7fe918b6c640 1 -- 172.21.15.151:0/3403727055 wait complete. 2023-10-18T11:10:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.228+0000 7fe918b6c640 1 Processor -- start 2023-10-18T11:10:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.228+0000 7fe918b6c640 1 -- start start 2023-10-18T11:10:47.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.229+0000 7fe918b6c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe91406e730 0x7fe914155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.229+0000 7fe918b6c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe914071800 0x7fe914151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.229+0000 7fe918b6c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9140c4fe0 0x7fe91406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.229+0000 7fe918b6c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140be8c0 con 0x7fe91406e730 2023-10-18T11:10:47.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.229+0000 7fe918b6c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9141ef160 con 0x7fe914071800 2023-10-18T11:10:47.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.229+0000 7fe918b6c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9141ef440 con 0x7fe9140c4fe0 2023-10-18T11:10:47.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.230+0000 7fe912d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9140c4fe0 0x7fe91406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.230+0000 7fe911d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe914071800 0x7fe914151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.230+0000 7fe912d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9140c4fe0 0x7fe91406ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:42106/0 (socket says 172.21.15.151:42106) 2023-10-18T11:10:47.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.230+0000 7fe912d9d640 1 -- 172.21.15.151:0/294138595 learned_addr learned my addr 172.21.15.151:0/294138595 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:47.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.234+0000 7fe91259c640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe91406e730 0x7fe914155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.235+0000 7fe912d9d640 1 -- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe914071800 msgr2=0x7fe914151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.235+0000 7fe912d9d640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe914071800 0x7fe914151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.235+0000 7fe912d9d640 1 -- 172.21.15.151:0/294138595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe91406e730 msgr2=0x7fe914155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.235+0000 7fe912d9d640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe91406e730 0x7fe914155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.235+0000 7fe912d9d640 1 -- 172.21.15.151:0/294138595 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c009b30 con 0x7fe9140c4fe0 2023-10-18T11:10:47.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.238+0000 7fe912d9d640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9140c4fe0 0x7fe91406ec70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe90c036040 tx=0x7fe90c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.241+0000 7fe902ffd640 1 -- 172.21.15.151:0/294138595 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0094d0 con 0x7fe9140c4fe0 2023-10-18T11:10:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.241+0000 7fe902ffd640 1 -- 172.21.15.151:0/294138595 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c03e450 con 0x7fe9140c4fe0 2023-10-18T11:10:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.241+0000 7fe902ffd640 1 -- 172.21.15.151:0/294138595 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c03e800 con 0x7fe9140c4fe0 2023-10-18T11:10:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.241+0000 7fe918b6c640 1 -- 172.21.15.151:0/294138595 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9140c1b20 con 0x7fe9140c4fe0 2023-10-18T11:10:47.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.242+0000 7fe918b6c640 1 -- 172.21.15.151:0/294138595 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9140c20e0 con 0x7fe9140c4fe0 2023-10-18T11:10:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.245+0000 7fe91b7d3740 1 Processor -- start 2023-10-18T11:10:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.245+0000 7fe91b7d3740 1 -- start start 2023-10-18T11:10:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.246+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103db9980 0x55a103db9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.246+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103e03800 0x55a103dba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.246+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db83e0 0x55a103df91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.246+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103cd47a0 con 0x55a103e03800 2023-10-18T11:10:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.246+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103d26740 con 0x55a103db83e0 2023-10-18T11:10:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.246+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a103d23e30 con 0x55a103db9980 2023-10-18T11:10:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.247+0000 7fe911d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db83e0 0x55a103df91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.247+0000 7fe911d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db83e0 0x55a103df91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46792/0 (socket says 172.21.15.151:46792) 2023-10-18T11:10:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.247+0000 7fe911d9b640 1 -- 172.21.15.151:0/1739867577 learned_addr learned my addr 172.21.15.151:0/1739867577 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:47.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.250+0000 7fe911d9b640 1 -- 172.21.15.151:0/1739867577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103db9980 msgr2=0x55a103db9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.250+0000 7fe911d9b640 1 --2- 172.21.15.151:0/1739867577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103db9980 0x55a103db9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.250+0000 7fe911d9b640 1 -- 172.21.15.151:0/1739867577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103e03800 msgr2=0x55a103dba2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.250+0000 7fe911d9b640 1 --2- 172.21.15.151:0/1739867577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103e03800 0x55a103dba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.250+0000 7fe911d9b640 1 -- 172.21.15.151:0/1739867577 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a103ce3910 con 0x55a103db83e0 2023-10-18T11:10:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.252+0000 7fe911d9b640 1 --2- 172.21.15.151:0/1739867577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db83e0 0x55a103df91e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe908009a50 tx=0x7fe908009f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ce5b8a6e7e63b29 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.255+0000 7fe8f3fff640 1 -- 172.21.15.151:0/1739867577 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908010ba0 con 0x55a103db83e0 2023-10-18T11:10:47.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.256+0000 7fe8f3fff640 1 -- 172.21.15.151:0/1739867577 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908010d00 con 0x55a103db83e0 2023-10-18T11:10:47.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.256+0000 7fe8f3fff640 1 -- 172.21.15.151:0/1739867577 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908014670 con 0x55a103db83e0 2023-10-18T11:10:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.256+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1739867577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db83e0 msgr2=0x55a103df91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.256+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1739867577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db83e0 0x55a103df91e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe908009a50 tx=0x7fe908009f10 comp rx=0 tx=0).stop 2023-10-18T11:10:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.256+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1739867577 shutdown_connections 2023-10-18T11:10:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.256+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1739867577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db83e0 0x55a103df91e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.256+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1739867577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103e03800 0x55a103dba2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.256+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1739867577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103db9980 0x55a103db9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.256+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1739867577 >> 172.21.15.151:0/1739867577 conn(0x55a103db60f0 msgr2=0x55a103db8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:47.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.257+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1739867577 shutdown_connections 2023-10-18T11:10:47.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.257+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1739867577 wait complete. 2023-10-18T11:10:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.257+0000 7fe91b7d3740 1 -- start start 2023-10-18T11:10:47.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.257+0000 7fe91b7d3740 1 Processor -- start 2023-10-18T11:10:47.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.258+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103db9980 0x55a103ddeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.258+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 0x55a103e0b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.258+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103df7720 0x55a103df4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.258+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103d1f720 con 0x55a103db9980 2023-10-18T11:10:47.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.258+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103cbd970 con 0x55a103df7720 2023-10-18T11:10:47.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.258+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a103cbd610 con 0x55a103e03800 2023-10-18T11:10:47.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.259+0000 7fe91b7d3740 10 client.0 _ll_register_callbacks cb 0x55a103cdf9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:47.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.259+0000 7fe911d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103df7720 0x55a103df4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.260+0000 7fe911d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103df7720 0x55a103df4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46806/0 (socket says 172.21.15.151:46806) 2023-10-18T11:10:47.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.260+0000 7fe911d9b640 1 -- 172.21.15.151:0/1255346232 learned_addr learned my addr 172.21.15.151:0/1255346232 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:47.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.263+0000 7fe911d9b640 1 -- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 msgr2=0x55a103e0b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.263+0000 7fe911d9b640 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 0x55a103e0b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.263+0000 7fe911d9b640 1 -- 172.21.15.151:0/1255346232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103db9980 msgr2=0x55a103ddeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.263+0000 7fe911d9b640 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103db9980 0x55a103ddeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.263+0000 7fe911d9b640 1 -- 172.21.15.151:0/1255346232 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe908009730 con 0x55a103df7720 2023-10-18T11:10:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.265+0000 7fe902ffd640 1 -- 172.21.15.151:0/294138595 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe90c03e960 con 0x7fe9140c4fe0 2023-10-18T11:10:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.265+0000 7fe911d9b640 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103df7720 0x55a103df4b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a103db81a0 tx=0x7fe9080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3a8baf746757785 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.265+0000 7fe8f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2023-10-18T11:10:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.265+0000 7fe902ffd640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe8f406ae60 0x7fe8f406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.266+0000 7fe91259c640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe8f406ae60 0x7fe8f406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.266+0000 7fe91259c640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe8f406ae60 0x7fe8f406d320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55a103e03c00 tx=0x7fe904008040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.267+0000 7fe902ffd640 1 -- 172.21.15.151:0/294138595 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe90c07b530 con 0x7fe9140c4fe0 2023-10-18T11:10:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.269+0000 7fe8f17fa640 1 -- 172.21.15.151:0/1255346232 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90801e630 con 0x55a103df7720 2023-10-18T11:10:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.269+0000 7fe8f17fa640 1 -- 172.21.15.151:0/1255346232 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe908000e40 con 0x55a103df7720 2023-10-18T11:10:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.269+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1255346232 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a103d46160 con 0x55a103df7720 2023-10-18T11:10:47.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.343+0000 7fe8f17fa640 1 -- 172.21.15.151:0/1255346232 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe90801e790 con 0x55a103df7720 2023-10-18T11:10:47.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.343+0000 7fe91b7d3740 10 client.4756 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:47.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.343+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1255346232 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55a103d1dda0 con 0x55a103df7720 2023-10-18T11:10:47.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.351+0000 7fe8f17fa640 1 -- 172.21.15.151:0/1255346232 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a103d46160 con 0x55a103df7720 2023-10-18T11:10:47.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.351+0000 7fe8f17fa640 1 -- 172.21.15.151:0/1255346232 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fe90801e8f0 con 0x55a103df7720 2023-10-18T11:10:47.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.351+0000 7fe91b7d3740 10 client.4756 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:47.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.351+0000 7fe91b7d3740 10 client.4756 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-18T11:10:47.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.351+0000 7fe91b7d3740 20 client.4756 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:47.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.351+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] conn(0x55a103dde770 0x55a103e0e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.351+0000 7fe91b7d3740 4 client.4756 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T11:10:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.351+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1255346232 --> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a103cf1cc0 con 0x55a103dde770 2023-10-18T11:10:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.352+0000 7fe911d9b640 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] conn(0x55a103dde770 0x55a103e0e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.392+0000 7fe911d9b640 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] conn(0x55a103dde770 0x55a103e0e160 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9133a7b1e7c0eff0 server_cookie=1aaa7074ecd0bdd3 in_seq=0 out_seq=0 2023-10-18T11:10:47.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.392+0000 7fe8f17fa640 10 client.4756 ms_handle_connect on v2:172.21.15.169:6836/872383111 2023-10-18T11:10:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.491+0000 7fe8f17fa640 1 -- 172.21.15.151:0/1255346232 <== mds.4 v2:172.21.15.169:6836/872383111 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a103cf1cc0 con 0x55a103dde770 2023-10-18T11:10:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.491+0000 7fe8f17fa640 10 client.4756 handle_command_reply: tid=0 2023-10-18T11:10:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.491+0000 7fe91b7d3740 1 client.4756 shutdown 2023-10-18T11:10:47.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103df7720 msgr2=0x55a103df4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103df7720 0x55a103df4b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a103db81a0 tx=0x7fe9080046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1255346232 shutdown_connections 2023-10-18T11:10:47.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] conn(0x55a103dde770 0x55a103e0e160 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103df7720 0x55a103df4b10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 0x55a103e0b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/1255346232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103db9980 0x55a103ddeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1255346232 >> 172.21.15.151:0/1255346232 conn(0x55a103db83e0 msgr2=0x55a103df9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe8f17fa640 0 client.4756 ms_handle_reset on v2:172.21.15.169:6836/872383111 2023-10-18T11:10:47.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1255346232 shutdown_connections 2023-10-18T11:10:47.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.492+0000 7fe91b7d3740 1 -- 172.21.15.151:0/1255346232 wait complete. 2023-10-18T11:10:47.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.493+0000 7fe91b7d3740 20 client.4756 trim_cache size 0 max 16384 2023-10-18T11:10:47.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.540+0000 7fe91b7d3740 1 Processor -- start 2023-10-18T11:10:47.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.540+0000 7fe91b7d3740 1 -- start start 2023-10-18T11:10:47.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.542+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103dfaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.542+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103df7720 0x55a103dfaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.542+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103e03800 0x55a103e01fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.542+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103a83f20 con 0x55a103e03800 2023-10-18T11:10:47.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.542+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103db4ec0 con 0x55a103db9980 2023-10-18T11:10:47.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.542+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a103dfb4d0 con 0x55a103df7720 2023-10-18T11:10:47.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.543+0000 7fe91259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103dfaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.543+0000 7fe911d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103df7720 0x55a103dfaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.543+0000 7fe911d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103df7720 0x55a103dfaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:42142/0 (socket says 172.21.15.151:42142) 2023-10-18T11:10:47.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.543+0000 7fe911d9b640 1 -- 172.21.15.151:0/3308472817 learned_addr learned my addr 172.21.15.151:0/3308472817 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:47.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.543+0000 7fe91259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103dfaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46814/0 (socket says 172.21.15.151:46814) 2023-10-18T11:10:47.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.543+0000 7fe912d9d640 1 --2- 172.21.15.151:0/3308472817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103e03800 0x55a103e01fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.545+0000 7fe911d9b640 1 -- 172.21.15.151:0/3308472817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 msgr2=0x55a103dfaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.545+0000 7fe911d9b640 1 --2- 172.21.15.151:0/3308472817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103dfaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.545+0000 7fe911d9b640 1 -- 172.21.15.151:0/3308472817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103e03800 msgr2=0x55a103e01fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.545+0000 7fe911d9b640 1 --2- 172.21.15.151:0/3308472817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103e03800 0x55a103e01fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.545+0000 7fe911d9b640 1 -- 172.21.15.151:0/3308472817 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a103cbcb80 con 0x55a103df7720 2023-10-18T11:10:47.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.548+0000 7fe911d9b640 1 --2- 172.21.15.151:0/3308472817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103df7720 0x55a103dfaf90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe908011010 tx=0x7fe908022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1537a8161d1a2fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.551+0000 7fe900ff9640 1 -- 172.21.15.151:0/3308472817 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080106e0 con 0x55a103df7720 2023-10-18T11:10:47.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.551+0000 7fe900ff9640 1 -- 172.21.15.151:0/3308472817 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908029e90 con 0x55a103df7720 2023-10-18T11:10:47.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.551+0000 7fe900ff9640 1 -- 172.21.15.151:0/3308472817 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908014980 con 0x55a103df7720 2023-10-18T11:10:47.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.553+0000 7fe91b7d3740 1 -- 172.21.15.151:0/3308472817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103df7720 msgr2=0x55a103dfaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.553+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/3308472817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103df7720 0x55a103dfaf90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe908011010 tx=0x7fe908022000 comp rx=0 tx=0).stop 2023-10-18T11:10:47.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.553+0000 7fe91b7d3740 1 -- 172.21.15.151:0/3308472817 shutdown_connections 2023-10-18T11:10:47.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.553+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/3308472817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103e03800 0x55a103e01fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.553+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/3308472817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103df7720 0x55a103dfaf90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.553+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/3308472817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103dfaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.553+0000 7fe91b7d3740 1 -- 172.21.15.151:0/3308472817 >> 172.21.15.151:0/3308472817 conn(0x55a103db83e0 msgr2=0x55a103ddec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:47.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.554+0000 7fe91b7d3740 1 -- 172.21.15.151:0/3308472817 shutdown_connections 2023-10-18T11:10:47.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.554+0000 7fe91b7d3740 1 -- 172.21.15.151:0/3308472817 wait complete. 2023-10-18T11:10:47.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.556+0000 7fe91b7d3740 1 -- start start 2023-10-18T11:10:47.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.556+0000 7fe91b7d3740 1 Processor -- start 2023-10-18T11:10:47.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.559+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103ddf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.559+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103df7720 0x55a103df5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.559+0000 7fe91b7d3740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 0x55a103de0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.559+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103de0780 con 0x55a103df7720 2023-10-18T11:10:47.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.559+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a103db7c10 con 0x55a103db9980 2023-10-18T11:10:47.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.559+0000 7fe91b7d3740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a103db9d60 con 0x55a103e03800 2023-10-18T11:10:47.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.560+0000 7fe91b7d3740 10 client.0 _ll_register_callbacks cb 0x7fe908009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:47.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.560+0000 7fe91259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103ddf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.560+0000 7fe912d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 0x55a103de0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.560+0000 7fe91259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103ddf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:46830/0 (socket says 172.21.15.151:46830) 2023-10-18T11:10:47.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.560+0000 7fe912d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 0x55a103de0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:42146/0 (socket says 172.21.15.151:42146) 2023-10-18T11:10:47.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.560+0000 7fe91259c640 1 -- 172.21.15.151:0/2854354253 learned_addr learned my addr 172.21.15.151:0/2854354253 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:47.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.561+0000 7fe911d9b640 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103df7720 0x55a103df5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.564+0000 7fe91259c640 1 -- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 msgr2=0x55a103de0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.564+0000 7fe91259c640 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 0x55a103de0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.564+0000 7fe91259c640 1 -- 172.21.15.151:0/2854354253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103df7720 msgr2=0x55a103df5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.564+0000 7fe91259c640 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103df7720 0x55a103df5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.564+0000 7fe91259c640 1 -- 172.21.15.151:0/2854354253 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a103d1dda0 con 0x55a103db9980 2023-10-18T11:10:47.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.566+0000 7fe91259c640 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103ddf3d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe90400dd10 tx=0x7fe9040046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa7eceed4cca276 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.566+0000 7fe8f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2023-10-18T11:10:47.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.570+0000 7fe8f17fa640 1 -- 172.21.15.151:0/2854354253 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040203f0 con 0x55a103db9980 2023-10-18T11:10:47.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.570+0000 7fe8f17fa640 1 -- 172.21.15.151:0/2854354253 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe904020550 con 0x55a103db9980 2023-10-18T11:10:47.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.570+0000 7fe91b7d3740 1 -- 172.21.15.151:0/2854354253 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe908010d00 con 0x55a103db9980 2023-10-18T11:10:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.571+0000 7fe8f17fa640 1 -- 172.21.15.151:0/2854354253 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe904020710 con 0x55a103db9980 2023-10-18T11:10:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.572+0000 7fe91b7d3740 10 client.4762 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.572+0000 7fe91b7d3740 1 -- 172.21.15.151:0/2854354253 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55a103ce2170 con 0x55a103db9980 2023-10-18T11:10:47.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.576+0000 7fe8f17fa640 1 -- 172.21.15.151:0/2854354253 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908010d00 con 0x55a103db9980 2023-10-18T11:10:47.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.576+0000 7fe8f17fa640 1 -- 172.21.15.151:0/2854354253 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fe90401f070 con 0x55a103db9980 2023-10-18T11:10:47.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.576+0000 7fe91b7d3740 10 client.4762 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:47.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.576+0000 7fe91b7d3740 10 client.4762 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-18T11:10:47.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.576+0000 7fe91b7d3740 20 client.4762 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:47.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.576+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] conn(0x55a103e65ce0 0x55a103e660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.576+0000 7fe91b7d3740 4 client.4762 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T11:10:47.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.576+0000 7fe91b7d3740 1 -- 172.21.15.151:0/2854354253 --> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a103d18700 con 0x55a103e65ce0 2023-10-18T11:10:47.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.577+0000 7fe911d9b640 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] conn(0x55a103e65ce0 0x55a103e660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.580+0000 7fe911d9b640 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] conn(0x55a103e65ce0 0x55a103e660c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=23caca379e19828e server_cookie=662cdd9d7e615914 in_seq=0 out_seq=0 2023-10-18T11:10:47.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.580+0000 7fe8f17fa640 10 client.4762 ms_handle_connect on v2:172.21.15.169:6836/872383111 2023-10-18T11:10:47.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe8f17fa640 1 -- 172.21.15.151:0/2854354253 <== mds.4 v2:172.21.15.169:6836/872383111 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a103d18700 con 0x55a103e65ce0 2023-10-18T11:10:47.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe8f17fa640 10 client.4762 handle_command_reply: tid=0 2023-10-18T11:10:47.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe91b7d3740 1 client.4762 shutdown 2023-10-18T11:10:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe91b7d3740 1 -- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 msgr2=0x55a103ddf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103ddf3d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe90400dd10 tx=0x7fe9040046b0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe91b7d3740 1 -- 172.21.15.151:0/2854354253 shutdown_connections 2023-10-18T11:10:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:6836/872383111,v1:172.21.15.169:6837/872383111] conn(0x55a103e65ce0 0x55a103e660c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a103e03800 0x55a103de0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a103df7720 0x55a103df5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe8f17fa640 0 client.4762 ms_handle_reset on v2:172.21.15.169:6836/872383111 2023-10-18T11:10:47.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe91b7d3740 1 --2- 172.21.15.151:0/2854354253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a103db9980 0x55a103ddf3d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.600+0000 7fe91b7d3740 1 -- 172.21.15.151:0/2854354253 >> 172.21.15.151:0/2854354253 conn(0x55a103db83e0 msgr2=0x55a103e14190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:47.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.601+0000 7fe91b7d3740 1 -- 172.21.15.151:0/2854354253 shutdown_connections 2023-10-18T11:10:47.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.601+0000 7fe91b7d3740 1 -- 172.21.15.151:0/2854354253 wait complete. 2023-10-18T11:10:47.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.601+0000 7fe91b7d3740 20 client.4762 trim_cache size 0 max 16384 2023-10-18T11:10:47.606 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:10:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "31f501b1-61b9-452b-813c-bb68ad49056d", 2023-10-18T11:10:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 4, 2023-10-18T11:10:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4238, 2023-10-18T11:10:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-10-18T11:10:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-10-18T11:10:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-10-18T11:10:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 14.812490089000001, 2023-10-18T11:10:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 18, 2023-10-18T11:10:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 31, 2023-10-18T11:10:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 31, 2023-10-18T11:10:47.608 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 77.861262987000003 2023-10-18T11:10:47.608 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:10:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.602+0000 7fe918b6c640 1 -- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe8f406ae60 msgr2=0x7fe8f406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.602+0000 7fe918b6c640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe8f406ae60 0x7fe8f406d320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55a103e03c00 tx=0x7fe904008040 comp rx=0 tx=0).stop 2023-10-18T11:10:47.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.602+0000 7fe918b6c640 1 -- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9140c4fe0 msgr2=0x7fe91406ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.602+0000 7fe918b6c640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9140c4fe0 0x7fe91406ec70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe90c036040 tx=0x7fe90c004a40 comp rx=0 tx=0).stop 2023-10-18T11:10:47.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.603+0000 7fe918b6c640 1 -- 172.21.15.151:0/294138595 shutdown_connections 2023-10-18T11:10:47.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.603+0000 7fe918b6c640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9140c4fe0 0x7fe91406ec70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.603+0000 7fe918b6c640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe8f406ae60 0x7fe8f406d320 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.603+0000 7fe918b6c640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe914071800 0x7fe914151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.603+0000 7fe918b6c640 1 --2- 172.21.15.151:0/294138595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe91406e730 0x7fe914155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.603+0000 7fe918b6c640 1 -- 172.21.15.151:0/294138595 >> 172.21.15.151:0/294138595 conn(0x7fe91406b080 msgr2=0x7fe9140c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:47.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.603+0000 7fe918b6c640 1 -- 172.21.15.151:0/294138595 shutdown_connections 2023-10-18T11:10:47.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.603+0000 7fe918b6c640 1 -- 172.21.15.151:0/294138595 wait complete. 2023-10-18T11:10:47.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-18T11:10:47.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.852+0000 7ff878355640 1 Processor -- start 2023-10-18T11:10:47.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.853+0000 7ff878355640 1 -- start start 2023-10-18T11:10:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.854+0000 7ff878355640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff87014fe20 0x7ff8701566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.854+0000 7ff878355640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff870070ee0 0x7ff8700718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.854+0000 7ff878355640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8700c18e0 con 0x7ff870070790 2023-10-18T11:10:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.854+0000 7ff878355640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8700c5350 con 0x7ff870070ee0 2023-10-18T11:10:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.854+0000 7ff878355640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700c20f0 con 0x7ff87014fe20 2023-10-18T11:10:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.855+0000 7ff8760f1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff87014fe20 0x7ff8701566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.855+0000 7ff8768f2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff870070ee0 0x7ff8700718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.855+0000 7ff8758f0640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff870070790 0x7ff8700c57e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54572/0 (socket says 172.21.15.151:54572) 2023-10-18T11:10:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.855+0000 7ff8758f0640 1 -- 172.21.15.151:0/909173296 learned_addr learned my addr 172.21.15.151:0/909173296 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.857+0000 7ff8768f2640 1 -- 172.21.15.151:0/909173296 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff87014fe20 msgr2=0x7ff8701566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.857+0000 7ff8768f2640 1 --2- 172.21.15.151:0/909173296 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff87014fe20 0x7ff8701566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.857+0000 7ff8768f2640 1 -- 172.21.15.151:0/909173296 >> v1:172.21.15.151:6789/0 conn(0x7ff870070790 legacy=0x7ff8700c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.857+0000 7ff8768f2640 1 -- 172.21.15.151:0/909173296 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700c1b30 con 0x7ff870070ee0 2023-10-18T11:10:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.857+0000 7ff8760f1640 1 --2- 172.21.15.151:0/909173296 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff87014fe20 0x7ff8701566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:47.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.859+0000 7ff8768f2640 1 --2- 172.21.15.151:0/909173296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070ee0 0x7ff8700718e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff868009d90 tx=0x7ff86802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5f42aab6a6dd616 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.863+0000 7ff8750ef640 1 -- 172.21.15.151:0/909173296 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86802cc50 con 0x7ff870070ee0 2023-10-18T11:10:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.863+0000 7ff8750ef640 1 -- 172.21.15.151:0/909173296 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86802cdb0 con 0x7ff870070ee0 2023-10-18T11:10:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.863+0000 7ff8750ef640 1 -- 172.21.15.151:0/909173296 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868034660 con 0x7ff870070ee0 2023-10-18T11:10:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.864+0000 7ff878355640 1 -- 172.21.15.151:0/909173296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070ee0 msgr2=0x7ff8700718e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.864+0000 7ff878355640 1 --2- 172.21.15.151:0/909173296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070ee0 0x7ff8700718e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff868009d90 tx=0x7ff86802bea0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.864+0000 7ff878355640 1 -- 172.21.15.151:0/909173296 shutdown_connections 2023-10-18T11:10:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.864+0000 7ff878355640 1 --2- 172.21.15.151:0/909173296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070ee0 0x7ff8700718e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.864+0000 7ff878355640 1 --2- 172.21.15.151:0/909173296 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff87014fe20 0x7ff8701566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.864+0000 7ff878355640 1 -- 172.21.15.151:0/909173296 >> 172.21.15.151:0/909173296 conn(0x7ff870069f70 msgr2=0x7ff87006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.864+0000 7ff878355640 1 -- 172.21.15.151:0/909173296 shutdown_connections 2023-10-18T11:10:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.864+0000 7ff878355640 1 -- 172.21.15.151:0/909173296 wait complete. 2023-10-18T11:10:47.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.866+0000 7ff878355640 1 Processor -- start 2023-10-18T11:10:47.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.866+0000 7ff878355640 1 -- start start 2023-10-18T11:10:47.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.867+0000 7ff878355640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070790 0x7ff870159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.867+0000 7ff878355640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff870070ee0 0x7ff8701e25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.867+0000 7ff878355640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff87014fe20 0x7ff870158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.867+0000 7ff878355640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff870157fd0 con 0x7ff87014fe20 2023-10-18T11:10:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.867+0000 7ff878355640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8701459a0 con 0x7ff870070790 2023-10-18T11:10:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.867+0000 7ff878355640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700ca340 con 0x7ff870070ee0 2023-10-18T11:10:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.868+0000 7ff8768f2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff87014fe20 0x7ff870158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.868+0000 7ff8758f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff870070ee0 0x7ff8701e25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.868+0000 7ff8760f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070790 0x7ff870159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.868+0000 7ff8768f2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff87014fe20 0x7ff870158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59160/0 (socket says 172.21.15.151:59160) 2023-10-18T11:10:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.868+0000 7ff8768f2640 1 -- 172.21.15.151:0/2074389887 learned_addr learned my addr 172.21.15.151:0/2074389887 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:47.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.872+0000 7ff8760f1640 1 -- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff870070ee0 msgr2=0x7ff8701e25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.872+0000 7ff8760f1640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff870070ee0 0x7ff8701e25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.872+0000 7ff8760f1640 1 -- 172.21.15.151:0/2074389887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff87014fe20 msgr2=0x7ff870158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.872+0000 7ff8760f1640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff87014fe20 0x7ff870158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.872+0000 7ff8760f1640 1 -- 172.21.15.151:0/2074389887 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c009400 con 0x7ff870070790 2023-10-18T11:10:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.872+0000 7ff8758f0640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff870070ee0 0x7ff8701e25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.874+0000 7ff8760f1640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070790 0x7ff870159b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00e870 tx=0x7ff86c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.877+0000 7ff866ffd640 1 -- 172.21.15.151:0/2074389887 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00c940 con 0x7ff870070790 2023-10-18T11:10:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.878+0000 7ff866ffd640 1 -- 172.21.15.151:0/2074389887 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c00caa0 con 0x7ff870070790 2023-10-18T11:10:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.878+0000 7ff866ffd640 1 -- 172.21.15.151:0/2074389887 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00ce30 con 0x7ff870070790 2023-10-18T11:10:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.878+0000 7ff878355640 1 -- 172.21.15.151:0/2074389887 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff868009a70 con 0x7ff870070790 2023-10-18T11:10:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.878+0000 7ff878355640 1 -- 172.21.15.151:0/2074389887 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff870157c60 con 0x7ff870070790 2023-10-18T11:10:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.881+0000 7ff87afbe740 1 Processor -- start 2023-10-18T11:10:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.882+0000 7ff87afbe740 1 -- start start 2023-10-18T11:10:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.882+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd50473170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.882+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 0x55dd504736b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.882+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504717f0 0x55dd504b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.882+0000 7ff87afbe740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd503897a0 con 0x55dd504717f0 2023-10-18T11:10:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.882+0000 7ff87afbe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd503db740 con 0x55dd504bcc10 2023-10-18T11:10:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.882+0000 7ff87afbe740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd503d8e30 con 0x55dd50472d90 2023-10-18T11:10:47.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.883+0000 7ff8768f2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd50473170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.883+0000 7ff8758f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504717f0 0x55dd504b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.883+0000 7ff8768f2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd50473170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:60914/0 (socket says 172.21.15.151:60914) 2023-10-18T11:10:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.883+0000 7ff8768f2640 1 -- 172.21.15.151:0/3942392167 learned_addr learned my addr 172.21.15.151:0/3942392167 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.885+0000 7ff8768f2640 1 -- 172.21.15.151:0/3942392167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 msgr2=0x55dd504736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.885+0000 7ff8768f2640 1 --2- 172.21.15.151:0/3942392167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 0x55dd504736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.885+0000 7ff8768f2640 1 -- 172.21.15.151:0/3942392167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504717f0 msgr2=0x55dd504b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.885+0000 7ff8768f2640 1 --2- 172.21.15.151:0/3942392167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504717f0 0x55dd504b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.885+0000 7ff8768f2640 1 -- 172.21.15.151:0/3942392167 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd50398910 con 0x55dd50472d90 2023-10-18T11:10:47.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.887+0000 7ff8768f2640 1 --2- 172.21.15.151:0/3942392167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd50473170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff86802cae0 tx=0x7ff86802e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7ea32db81bbcfca server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.891+0000 7ff853fff640 1 -- 172.21.15.151:0/3942392167 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868049680 con 0x55dd50472d90 2023-10-18T11:10:47.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.892+0000 7ff853fff640 1 -- 172.21.15.151:0/3942392167 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868044070 con 0x55dd50472d90 2023-10-18T11:10:47.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.892+0000 7ff853fff640 1 -- 172.21.15.151:0/3942392167 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868049a00 con 0x55dd50472d90 2023-10-18T11:10:47.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.892+0000 7ff87afbe740 1 -- 172.21.15.151:0/3942392167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 msgr2=0x55dd50473170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:47.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.892+0000 7ff87afbe740 1 --2- 172.21.15.151:0/3942392167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd50473170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff86802cae0 tx=0x7ff86802e000 comp rx=0 tx=0).stop 2023-10-18T11:10:47.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.893+0000 7ff87afbe740 1 -- 172.21.15.151:0/3942392167 shutdown_connections 2023-10-18T11:10:47.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.893+0000 7ff87afbe740 1 --2- 172.21.15.151:0/3942392167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504717f0 0x55dd504b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.893+0000 7ff87afbe740 1 --2- 172.21.15.151:0/3942392167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 0x55dd504736b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.893+0000 7ff87afbe740 1 --2- 172.21.15.151:0/3942392167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd50473170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.893+0000 7ff87afbe740 1 -- 172.21.15.151:0/3942392167 >> 172.21.15.151:0/3942392167 conn(0x55dd5046f500 msgr2=0x55dd50471e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.893+0000 7ff87afbe740 1 -- 172.21.15.151:0/3942392167 shutdown_connections 2023-10-18T11:10:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.893+0000 7ff87afbe740 1 -- 172.21.15.151:0/3942392167 wait complete. 2023-10-18T11:10:47.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.893+0000 7ff87afbe740 1 -- start start 2023-10-18T11:10:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.894+0000 7ff87afbe740 1 Processor -- start 2023-10-18T11:10:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.895+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 0x55dd504bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.895+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 0x55dd504b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.895+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd504af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.895+0000 7ff87afbe740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd503d4720 con 0x55dd504bcc10 2023-10-18T11:10:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.895+0000 7ff87afbe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd50372970 con 0x55dd50472d90 2023-10-18T11:10:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.895+0000 7ff87afbe740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd50372610 con 0x55dd504b0a70 2023-10-18T11:10:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.895+0000 7ff87afbe740 10 client.0 _ll_register_callbacks cb 0x55dd503949d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.895+0000 7ff8758f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd504af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.895+0000 7ff8760f1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 0x55dd504b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.896+0000 7ff8758f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd504af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:60916/0 (socket says 172.21.15.151:60916) 2023-10-18T11:10:47.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.896+0000 7ff8758f0640 1 -- 172.21.15.151:0/2788280475 learned_addr learned my addr 172.21.15.151:0/2788280475 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.898+0000 7ff866ffd640 1 -- 172.21.15.151:0/2074389887 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff86c005990 con 0x7ff870070790 2023-10-18T11:10:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.898+0000 7ff8758f0640 1 -- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 msgr2=0x55dd504bdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.898+0000 7ff866ffd640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff85406ae60 0x7ff85406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.898+0000 7ff8758f0640 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 0x55dd504bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.898+0000 7ff8758f0640 1 -- 172.21.15.151:0/2788280475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 msgr2=0x55dd504b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.898+0000 7ff8758f0640 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 0x55dd504b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.898+0000 7ff8758f0640 1 -- 172.21.15.151:0/2788280475 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8700c1b30 con 0x55dd504b0a70 2023-10-18T11:10:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.899+0000 7ff8768f2640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff85406ae60 0x7ff85406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.899+0000 7ff8768f2640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff85406ae60 0x7ff85406d320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff868009d90 tx=0x7ff868031000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.901+0000 7ff8758f0640 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd504af180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff8600077b0 tx=0x7ff860001940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c9cab911149cc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:47.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.901+0000 7ff8517fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3301/0 2023-10-18T11:10:47.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.902+0000 7ff866ffd640 1 -- 172.21.15.151:0/2074389887 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff86c05dd10 con 0x7ff870070790 2023-10-18T11:10:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.904+0000 7ff8517fa640 1 -- 172.21.15.151:0/2788280475 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600126f0 con 0x55dd504b0a70 2023-10-18T11:10:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.904+0000 7ff8517fa640 1 -- 172.21.15.151:0/2788280475 <== mon.2 v2:172.21.15.169:3301/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff860012850 con 0x55dd504b0a70 2023-10-18T11:10:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.904+0000 7ff87afbe740 1 -- 172.21.15.151:0/2788280475 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd503fb160 con 0x55dd504b0a70 2023-10-18T11:10:47.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.906+0000 7ff8517fa640 1 -- 172.21.15.151:0/2788280475 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff860012a10 con 0x55dd504b0a70 2023-10-18T11:10:47.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.906+0000 7ff87afbe740 10 client.4619 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:47.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.906+0000 7ff87afbe740 1 -- 172.21.15.151:0/2788280475 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55dd503d2da0 con 0x55dd504b0a70 2023-10-18T11:10:47.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.915+0000 7ff8517fa640 1 -- 172.21.15.151:0/2788280475 <== mon.2 v2:172.21.15.169:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dd503fb160 con 0x55dd504b0a70 2023-10-18T11:10:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.915+0000 7ff8517fa640 1 -- 172.21.15.151:0/2788280475 <== mon.2 v2:172.21.15.169:3301/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7ff860012b70 con 0x55dd504b0a70 2023-10-18T11:10:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.915+0000 7ff87afbe740 10 client.4619 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.915+0000 7ff87afbe740 10 client.4619 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-18T11:10:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.915+0000 7ff87afbe740 20 client.4619 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.915+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] conn(0x55dd504c73c0 0x55dd50495520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.915+0000 7ff87afbe740 4 client.4619 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T11:10:47.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.915+0000 7ff87afbe740 1 -- 172.21.15.151:0/2788280475 --> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd503a6cc0 con 0x55dd504c73c0 2023-10-18T11:10:47.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.916+0000 7ff8760f1640 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] conn(0x55dd504c73c0 0x55dd50495520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:47.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.955+0000 7ff8760f1640 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] conn(0x55dd504c73c0 0x55dd50495520 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6fed2a6bb74500a0 server_cookie=64447ffb894c604b in_seq=0 out_seq=0 2023-10-18T11:10:47.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:47.955+0000 7ff8517fa640 10 client.4619 ms_handle_connect on v2:172.21.15.169:6838/520473080 2023-10-18T11:10:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.057+0000 7ff8517fa640 1 -- 172.21.15.151:0/2788280475 <== mds.3 v2:172.21.15.169:6838/520473080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dd503a6cc0 con 0x55dd504c73c0 2023-10-18T11:10:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.057+0000 7ff8517fa640 10 client.4619 handle_command_reply: tid=0 2023-10-18T11:10:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.057+0000 7ff87afbe740 1 client.4619 shutdown 2023-10-18T11:10:48.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.058+0000 7ff87afbe740 1 -- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 msgr2=0x55dd504af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.058+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd504af180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff8600077b0 tx=0x7ff860001940 comp rx=0 tx=0).stop 2023-10-18T11:10:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.058+0000 7ff87afbe740 1 -- 172.21.15.151:0/2788280475 shutdown_connections 2023-10-18T11:10:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.058+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd504af180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.058+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 0x55dd504b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.058+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] conn(0x55dd504c73c0 0x55dd50495520 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.058+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2788280475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 0x55dd504bdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.058+0000 7ff8517fa640 0 client.4619 ms_handle_reset on v2:172.21.15.169:6838/520473080 2023-10-18T11:10:48.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.058+0000 7ff87afbe740 1 -- 172.21.15.151:0/2788280475 >> 172.21.15.151:0/2788280475 conn(0x55dd504717f0 msgr2=0x55dd50473170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.059+0000 7ff87afbe740 1 -- 172.21.15.151:0/2788280475 shutdown_connections 2023-10-18T11:10:48.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.059+0000 7ff87afbe740 1 -- 172.21.15.151:0/2788280475 wait complete. 2023-10-18T11:10:48.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.060+0000 7ff87afbe740 20 client.4619 trim_cache size 0 max 16384 2023-10-18T11:10:48.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.107+0000 7ff87afbe740 1 Processor -- start 2023-10-18T11:10:48.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.107+0000 7ff87afbe740 1 -- start start 2023-10-18T11:10:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.109+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd5049c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.109+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504b0a70 0x55dd50467e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.109+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 0x55dd50468380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.109+0000 7ff87afbe740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd504b18a0 con 0x55dd504b0a70 2023-10-18T11:10:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.109+0000 7ff87afbe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd50138f20 con 0x55dd504bcc10 2023-10-18T11:10:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.109+0000 7ff87afbe740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd504ad870 con 0x55dd50472d90 2023-10-18T11:10:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.110+0000 7ff8760f1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd5049c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.110+0000 7ff8768f2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 0x55dd50468380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.110+0000 7ff8768f2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 0x55dd50468380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:52364/0 (socket says 172.21.15.151:52364) 2023-10-18T11:10:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.110+0000 7ff8768f2640 1 -- 172.21.15.151:0/892664554 learned_addr learned my addr 172.21.15.151:0/892664554 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.110+0000 7ff8758f0640 1 --2- 172.21.15.151:0/892664554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504b0a70 0x55dd50467e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.112+0000 7ff8760f1640 1 -- 172.21.15.151:0/892664554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 msgr2=0x55dd50468380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.112+0000 7ff8760f1640 1 --2- 172.21.15.151:0/892664554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 0x55dd50468380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.112+0000 7ff8760f1640 1 -- 172.21.15.151:0/892664554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504b0a70 msgr2=0x55dd50467e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.112+0000 7ff8760f1640 1 --2- 172.21.15.151:0/892664554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504b0a70 0x55dd50467e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.112+0000 7ff8760f1640 1 -- 172.21.15.151:0/892664554 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd50371b80 con 0x55dd50472d90 2023-10-18T11:10:48.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.114+0000 7ff8760f1640 1 --2- 172.21.15.151:0/892664554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd5049c140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff86c08d480 tx=0x7ff86c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c680b19ebc1acf6b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:48.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.118+0000 7ff864e01640 1 -- 172.21.15.151:0/892664554 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c061db0 con 0x55dd50472d90 2023-10-18T11:10:48.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.118+0000 7ff864e01640 1 -- 172.21.15.151:0/892664554 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c065ff0 con 0x55dd50472d90 2023-10-18T11:10:48.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.118+0000 7ff864e01640 1 -- 172.21.15.151:0/892664554 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c05c0b0 con 0x55dd50472d90 2023-10-18T11:10:48.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.119+0000 7ff87afbe740 1 -- 172.21.15.151:0/892664554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 msgr2=0x55dd5049c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.119+0000 7ff87afbe740 1 --2- 172.21.15.151:0/892664554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd5049c140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff86c08d480 tx=0x7ff86c014000 comp rx=0 tx=0).stop 2023-10-18T11:10:48.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.119+0000 7ff87afbe740 1 -- 172.21.15.151:0/892664554 shutdown_connections 2023-10-18T11:10:48.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.119+0000 7ff87afbe740 1 --2- 172.21.15.151:0/892664554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd504bcc10 0x55dd50468380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.119+0000 7ff87afbe740 1 --2- 172.21.15.151:0/892664554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504b0a70 0x55dd50467e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.119+0000 7ff87afbe740 1 --2- 172.21.15.151:0/892664554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd50472d90 0x55dd5049c140 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.119+0000 7ff87afbe740 1 -- 172.21.15.151:0/892664554 >> 172.21.15.151:0/892664554 conn(0x55dd504717f0 msgr2=0x55dd504b8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.119+0000 7ff87afbe740 1 -- 172.21.15.151:0/892664554 shutdown_connections 2023-10-18T11:10:48.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.119+0000 7ff87afbe740 1 -- 172.21.15.151:0/892664554 wait complete. 2023-10-18T11:10:48.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.120+0000 7ff87afbe740 1 -- start start 2023-10-18T11:10:48.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.121+0000 7ff87afbe740 1 Processor -- start 2023-10-18T11:10:48.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.122+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 0x55dd50516c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.122+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd5046dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.122+0000 7ff87afbe740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 0x55dd504bd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.122+0000 7ff87afbe740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5046e190 con 0x55dd504bcc10 2023-10-18T11:10:48.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.122+0000 7ff87afbe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd505202f0 con 0x55dd50472d90 2023-10-18T11:10:48.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.122+0000 7ff87afbe740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd505200e0 con 0x55dd504b0a70 2023-10-18T11:10:48.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.122+0000 7ff87afbe740 10 client.0 _ll_register_callbacks cb 0x7ff860004a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:48.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.123+0000 7ff8760f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 0x55dd50516c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.123+0000 7ff8758f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd5046dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.123+0000 7ff8768f2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 0x55dd504bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.123+0000 7ff8760f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 0x55dd50516c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:52374/0 (socket says 172.21.15.151:52374) 2023-10-18T11:10:48.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.123+0000 7ff8760f1640 1 -- 172.21.15.151:0/2520593323 learned_addr learned my addr 172.21.15.151:0/2520593323 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:48.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.126+0000 7ff8758f0640 1 -- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 msgr2=0x55dd50516c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.126+0000 7ff8758f0640 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 0x55dd50516c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.126+0000 7ff8758f0640 1 -- 172.21.15.151:0/2520593323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 msgr2=0x55dd504bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.126+0000 7ff8758f0640 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 0x55dd504bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.126+0000 7ff8758f0640 1 -- 172.21.15.151:0/2520593323 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff870157c60 con 0x55dd504b0a70 2023-10-18T11:10:48.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.126+0000 7ff8760f1640 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 0x55dd50516c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:48.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.128+0000 7ff8758f0640 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd5046dc50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff860000ea0 tx=0x7ff860015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51b498f30879e9a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:48.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.128+0000 7ff8517fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3301/0 2023-10-18T11:10:48.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.131+0000 7ff8517fa640 1 -- 172.21.15.151:0/2520593323 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86001d740 con 0x55dd504b0a70 2023-10-18T11:10:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.131+0000 7ff8517fa640 1 -- 172.21.15.151:0/2520593323 <== mon.2 v2:172.21.15.169:3301/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff86001d8a0 con 0x55dd504b0a70 2023-10-18T11:10:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.131+0000 7ff87afbe740 1 -- 172.21.15.151:0/2520593323 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff868044070 con 0x55dd504b0a70 2023-10-18T11:10:48.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.133+0000 7ff8517fa640 1 -- 172.21.15.151:0/2520593323 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff860012cb0 con 0x55dd504b0a70 2023-10-18T11:10:48.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.133+0000 7ff87afbe740 10 client.4625 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:48.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.133+0000 7ff87afbe740 1 -- 172.21.15.151:0/2520593323 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55dd50397170 con 0x55dd504b0a70 2023-10-18T11:10:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.138+0000 7ff8517fa640 1 -- 172.21.15.151:0/2520593323 <== mon.2 v2:172.21.15.169:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868044070 con 0x55dd504b0a70 2023-10-18T11:10:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.138+0000 7ff8517fa640 1 -- 172.21.15.151:0/2520593323 <== mon.2 v2:172.21.15.169:3301/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7ff860012040 con 0x55dd504b0a70 2023-10-18T11:10:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.138+0000 7ff87afbe740 10 client.4625 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:48.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.138+0000 7ff87afbe740 10 client.4625 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-18T11:10:48.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.138+0000 7ff87afbe740 20 client.4625 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:48.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.138+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] conn(0x55dd504b97d0 0x55dd504b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.138+0000 7ff87afbe740 4 client.4625 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T11:10:48.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.138+0000 7ff87afbe740 1 -- 172.21.15.151:0/2520593323 --> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dd503cd700 con 0x55dd504b97d0 2023-10-18T11:10:48.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.139+0000 7ff8760f1640 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] conn(0x55dd504b97d0 0x55dd504b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.142+0000 7ff8760f1640 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] conn(0x55dd504b97d0 0x55dd504b9bb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a31bcae4dede480c server_cookie=4e64679f8a0de99d in_seq=0 out_seq=0 2023-10-18T11:10:48.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.142+0000 7ff8517fa640 10 client.4625 ms_handle_connect on v2:172.21.15.169:6838/520473080 2023-10-18T11:10:48.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.160+0000 7ff8517fa640 1 -- 172.21.15.151:0/2520593323 <== mds.3 v2:172.21.15.169:6838/520473080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55dd503cd700 con 0x55dd504b97d0 2023-10-18T11:10:48.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.160+0000 7ff8517fa640 10 client.4625 handle_command_reply: tid=0 2023-10-18T11:10:48.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.160+0000 7ff87afbe740 1 client.4625 shutdown 2023-10-18T11:10:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.160+0000 7ff87afbe740 1 -- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 msgr2=0x55dd5046dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.160+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd5046dc50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff860000ea0 tx=0x7ff860015000 comp rx=0 tx=0).stop 2023-10-18T11:10:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff87afbe740 1 -- 172.21.15.151:0/2520593323 shutdown_connections 2023-10-18T11:10:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dd504bcc10 0x55dd504bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55dd504b0a70 0x55dd5046dc50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:6838/520473080,v1:172.21.15.169:6839/520473080] conn(0x55dd504b97d0 0x55dd504b9bb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff87afbe740 1 --2- 172.21.15.151:0/2520593323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd50472d90 0x55dd50516c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff87afbe740 1 -- 172.21.15.151:0/2520593323 >> 172.21.15.151:0/2520593323 conn(0x55dd504717f0 msgr2=0x55dd50467e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff8517fa640 0 client.4625 ms_handle_reset on v2:172.21.15.169:6838/520473080 2023-10-18T11:10:48.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff87afbe740 1 -- 172.21.15.151:0/2520593323 shutdown_connections 2023-10-18T11:10:48.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff87afbe740 1 -- 172.21.15.151:0/2520593323 wait complete. 2023-10-18T11:10:48.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.161+0000 7ff87afbe740 20 client.4625 trim_cache size 0 max 16384 2023-10-18T11:10:48.166 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:10:48.166 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "31f501b1-61b9-452b-813c-bb68ad49056d", 2023-10-18T11:10:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 3, 2023-10-18T11:10:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4241, 2023-10-18T11:10:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-10-18T11:10:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-10-18T11:10:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-10-18T11:10:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 18.814036990000002, 2023-10-18T11:10:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 18, 2023-10-18T11:10:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 31, 2023-10-18T11:10:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 31, 2023-10-18T11:10:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 78.336610187999995 2023-10-18T11:10:48.169 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:10:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.162+0000 7ff878355640 1 -- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff85406ae60 msgr2=0x7ff85406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.162+0000 7ff878355640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff85406ae60 0x7ff85406d320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff868009d90 tx=0x7ff868031000 comp rx=0 tx=0).stop 2023-10-18T11:10:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.162+0000 7ff878355640 1 -- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070790 msgr2=0x7ff870159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.162+0000 7ff878355640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070790 0x7ff870159b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00e870 tx=0x7ff86c00ed30 comp rx=0 tx=0).stop 2023-10-18T11:10:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.163+0000 7ff878355640 1 -- 172.21.15.151:0/2074389887 shutdown_connections 2023-10-18T11:10:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.163+0000 7ff878355640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff87014fe20 0x7ff870158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.163+0000 7ff878355640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff870070ee0 0x7ff8701e25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.163+0000 7ff878355640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7ff85406ae60 0x7ff85406d320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.163+0000 7ff878355640 1 --2- 172.21.15.151:0/2074389887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff870070790 0x7ff870159b90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.163+0000 7ff878355640 1 -- 172.21.15.151:0/2074389887 >> 172.21.15.151:0/2074389887 conn(0x7ff870069f70 msgr2=0x7ff8700718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.163+0000 7ff878355640 1 -- 172.21.15.151:0/2074389887 shutdown_connections 2023-10-18T11:10:48.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.163+0000 7ff878355640 1 -- 172.21.15.151:0/2074389887 wait complete. 2023-10-18T11:10:48.197 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-18T11:10:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.412+0000 7fd3619d0640 1 Processor -- start 2023-10-18T11:10:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.412+0000 7fd3619d0640 1 -- start start 2023-10-18T11:10:48.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.414+0000 7fd3619d0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c070790 0x7fd35c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.414+0000 7fd3619d0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd35c070ee0 0x7fd35c0718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.414+0000 7fd3619d0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c0c18e0 con 0x7fd35c14fe20 2023-10-18T11:10:48.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.414+0000 7fd3619d0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35c0c5350 con 0x7fd35c070ee0 2023-10-18T11:10:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.414+0000 7fd3619d0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c0c20f0 con 0x7fd35c070790 2023-10-18T11:10:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.414+0000 7fd35b7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd35c070ee0 0x7fd35c0718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.414+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c070790 0x7fd35c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.414+0000 7fd35affd640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fd35c14fe20 0x7fd35c0c57e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54584/0 (socket says 172.21.15.151:54584) 2023-10-18T11:10:48.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.415+0000 7fd35affd640 1 -- 172.21.15.151:0/847759466 learned_addr learned my addr 172.21.15.151:0/847759466 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:48.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.417+0000 7fd35b7fe640 1 -- 172.21.15.151:0/847759466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c070790 msgr2=0x7fd35c1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.417+0000 7fd35b7fe640 1 --2- 172.21.15.151:0/847759466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c070790 0x7fd35c1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.417+0000 7fd35b7fe640 1 -- 172.21.15.151:0/847759466 >> v1:172.21.15.151:6789/0 conn(0x7fd35c14fe20 legacy=0x7fd35c0c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.417+0000 7fd35b7fe640 1 -- 172.21.15.151:0/847759466 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c0c1b30 con 0x7fd35c070ee0 2023-10-18T11:10:48.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.419+0000 7fd35b7fe640 1 --2- 172.21.15.151:0/847759466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c070ee0 0x7fd35c0718e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3540097a0 tx=0x7fd35402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fdaa0f59592d8a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:48.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd359ffb640 1 -- 172.21.15.151:0/847759466 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35402d040 con 0x7fd35c070ee0 2023-10-18T11:10:48.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd359ffb640 1 -- 172.21.15.151:0/847759466 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd354031810 con 0x7fd35c070ee0 2023-10-18T11:10:48.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd359ffb640 1 -- 172.21.15.151:0/847759466 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354031ba0 con 0x7fd35c070ee0 2023-10-18T11:10:48.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd3619d0640 1 -- 172.21.15.151:0/847759466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c070ee0 msgr2=0x7fd35c0718e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd3619d0640 1 --2- 172.21.15.151:0/847759466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c070ee0 0x7fd35c0718e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3540097a0 tx=0x7fd35402b8b0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd3619d0640 1 -- 172.21.15.151:0/847759466 shutdown_connections 2023-10-18T11:10:48.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd3619d0640 1 --2- 172.21.15.151:0/847759466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c070ee0 0x7fd35c0718e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd3619d0640 1 --2- 172.21.15.151:0/847759466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c070790 0x7fd35c1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd3619d0640 1 -- 172.21.15.151:0/847759466 >> 172.21.15.151:0/847759466 conn(0x7fd35c069f70 msgr2=0x7fd35c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.423+0000 7fd3619d0640 1 -- 172.21.15.151:0/847759466 shutdown_connections 2023-10-18T11:10:48.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.424+0000 7fd3619d0640 1 -- 172.21.15.151:0/847759466 wait complete. 2023-10-18T11:10:48.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.425+0000 7fd3619d0640 1 Processor -- start 2023-10-18T11:10:48.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.425+0000 7fd3619d0640 1 -- start start 2023-10-18T11:10:48.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.426+0000 7fd3619d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd35c070790 0x7fd35c14ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.426+0000 7fd3619d0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c070ee0 0x7fd35c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.426+0000 7fd3619d0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c14fe20 0x7fd35c1ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.426+0000 7fd3619d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c14c190 con 0x7fd35c070790 2023-10-18T11:10:48.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.426+0000 7fd3619d0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c14bbd0 con 0x7fd35c070ee0 2023-10-18T11:10:48.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.426+0000 7fd3619d0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c14beb0 con 0x7fd35c14fe20 2023-10-18T11:10:48.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.427+0000 7fd35affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd35c070790 0x7fd35c14ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.427+0000 7fd35b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c14fe20 0x7fd35c1ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.427+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c070ee0 0x7fd35c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.427+0000 7fd35affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd35c070790 0x7fd35c14ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59204/0 (socket says 172.21.15.151:59204) 2023-10-18T11:10:48.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.427+0000 7fd35affd640 1 -- 172.21.15.151:0/4117128565 learned_addr learned my addr 172.21.15.151:0/4117128565 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:48.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.431+0000 7fd35b7fe640 1 -- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c070ee0 msgr2=0x7fd35c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.431+0000 7fd35b7fe640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c070ee0 0x7fd35c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.431+0000 7fd35b7fe640 1 -- 172.21.15.151:0/4117128565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd35c070790 msgr2=0x7fd35c14ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.431+0000 7fd35b7fe640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd35c070790 0x7fd35c14ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.431+0000 7fd35b7fe640 1 -- 172.21.15.151:0/4117128565 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354009400 con 0x7fd35c14fe20 2023-10-18T11:10:48.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.433+0000 7fd35b7fe640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c14fe20 0x7fd35c1ee0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd354033000 tx=0x7fd3540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:48.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.437+0000 7fd353fff640 1 -- 172.21.15.151:0/4117128565 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354006e10 con 0x7fd35c14fe20 2023-10-18T11:10:48.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.437+0000 7fd353fff640 1 -- 172.21.15.151:0/4117128565 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35403ace0 con 0x7fd35c14fe20 2023-10-18T11:10:48.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.437+0000 7fd353fff640 1 -- 172.21.15.151:0/4117128565 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354044630 con 0x7fd35c14fe20 2023-10-18T11:10:48.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.437+0000 7fd3619d0640 1 -- 172.21.15.151:0/4117128565 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c0ca4c0 con 0x7fd35c14fe20 2023-10-18T11:10:48.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.437+0000 7fd3619d0640 1 -- 172.21.15.151:0/4117128565 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c0caa80 con 0x7fd35c14fe20 2023-10-18T11:10:48.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.441+0000 7fd3641fd740 1 Processor -- start 2023-10-18T11:10:48.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.441+0000 7fd3641fd740 1 -- start start 2023-10-18T11:10:48.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.442+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf5d4980 0x55e1cf5d4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.442+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 0x55e1cf5d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.442+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d33e0 0x55e1cf6141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.442+0000 7fd3641fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf4ef7a0 con 0x55e1cf61e800 2023-10-18T11:10:48.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.442+0000 7fd3641fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf541740 con 0x55e1cf5d4980 2023-10-18T11:10:48.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.442+0000 7fd3641fd740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf53ee30 con 0x55e1cf5d33e0 2023-10-18T11:10:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.443+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf5d4980 0x55e1cf5d4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.443+0000 7fd35affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 0x55e1cf5d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.443+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf5d4980 0x55e1cf5d4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:52400/0 (socket says 172.21.15.151:52400) 2023-10-18T11:10:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.443+0000 7fd35a7fc640 1 -- 172.21.15.151:0/23931957 learned_addr learned my addr 172.21.15.151:0/23931957 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:48.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.445+0000 7fd35a7fc640 1 -- 172.21.15.151:0/23931957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d33e0 msgr2=0x55e1cf6141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.445+0000 7fd35a7fc640 1 --2- 172.21.15.151:0/23931957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d33e0 0x55e1cf6141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.445+0000 7fd35a7fc640 1 -- 172.21.15.151:0/23931957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 msgr2=0x55e1cf5d52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.445+0000 7fd35a7fc640 1 --2- 172.21.15.151:0/23931957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 0x55e1cf5d52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.445+0000 7fd35a7fc640 1 -- 172.21.15.151:0/23931957 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1cf4fe910 con 0x55e1cf5d4980 2023-10-18T11:10:48.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.447+0000 7fd35a7fc640 1 --2- 172.21.15.151:0/23931957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf5d4980 0x55e1cf5d4d60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd344009c50 tx=0x7fd344013710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b207500134106717 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:48.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.451+0000 7fd3517fa640 1 -- 172.21.15.151:0/23931957 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344004030 con 0x55e1cf5d4980 2023-10-18T11:10:48.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.451+0000 7fd3517fa640 1 -- 172.21.15.151:0/23931957 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd344004190 con 0x55e1cf5d4980 2023-10-18T11:10:48.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.451+0000 7fd3517fa640 1 -- 172.21.15.151:0/23931957 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344003610 con 0x55e1cf5d4980 2023-10-18T11:10:48.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.452+0000 7fd3641fd740 1 -- 172.21.15.151:0/23931957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf5d4980 msgr2=0x55e1cf5d4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.452+0000 7fd3641fd740 1 --2- 172.21.15.151:0/23931957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf5d4980 0x55e1cf5d4d60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd344009c50 tx=0x7fd344013710 comp rx=0 tx=0).stop 2023-10-18T11:10:48.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.452+0000 7fd3641fd740 1 -- 172.21.15.151:0/23931957 shutdown_connections 2023-10-18T11:10:48.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.452+0000 7fd3641fd740 1 --2- 172.21.15.151:0/23931957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d33e0 0x55e1cf6141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.452+0000 7fd3641fd740 1 --2- 172.21.15.151:0/23931957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 0x55e1cf5d52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.452+0000 7fd3641fd740 1 --2- 172.21.15.151:0/23931957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf5d4980 0x55e1cf5d4d60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.452+0000 7fd3641fd740 1 -- 172.21.15.151:0/23931957 >> 172.21.15.151:0/23931957 conn(0x55e1cf5d10f0 msgr2=0x55e1cf5d3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.452+0000 7fd3641fd740 1 -- 172.21.15.151:0/23931957 shutdown_connections 2023-10-18T11:10:48.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.452+0000 7fd3641fd740 1 -- 172.21.15.151:0/23931957 wait complete. 2023-10-18T11:10:48.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.453+0000 7fd3641fd740 1 -- start start 2023-10-18T11:10:48.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.453+0000 7fd3641fd740 1 Processor -- start 2023-10-18T11:10:48.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.454+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf5d4980 0x55e1cf625580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.454+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf610eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.454+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf619e30 0x55e1cf5fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.454+0000 7fd3641fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf53a720 con 0x55e1cf5d4980 2023-10-18T11:10:48.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.454+0000 7fd3641fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf4d8970 con 0x55e1cf61e800 2023-10-18T11:10:48.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.454+0000 7fd3641fd740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf4d8610 con 0x55e1cf619e30 2023-10-18T11:10:48.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.454+0000 7fd3641fd740 10 client.0 _ll_register_callbacks cb 0x55e1cf4fa9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:48.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.455+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf5d4980 0x55e1cf625580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.455+0000 7fd35affd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf610eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.455+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf5d4980 0x55e1cf625580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59208/0 (socket says 172.21.15.151:59208) 2023-10-18T11:10:48.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.455+0000 7fd35a7fc640 1 -- 172.21.15.151:0/647930332 learned_addr learned my addr 172.21.15.151:0/647930332 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:48.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.458+0000 7fd353fff640 1 -- 172.21.15.151:0/4117128565 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd35404d450 con 0x7fd35c14fe20 2023-10-18T11:10:48.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.458+0000 7fd35affd640 1 -- 172.21.15.151:0/647930332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf619e30 msgr2=0x55e1cf5fdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.458+0000 7fd35affd640 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf619e30 0x55e1cf5fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.458+0000 7fd35affd640 1 -- 172.21.15.151:0/647930332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf5d4980 msgr2=0x55e1cf625580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.458+0000 7fd35affd640 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf5d4980 0x55e1cf625580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.458+0000 7fd35affd640 1 -- 172.21.15.151:0/647930332 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd344009900 con 0x55e1cf61e800 2023-10-18T11:10:48.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.459+0000 7fd353fff640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33c06ae30 0x7fd33c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.459+0000 7fd35a7fc640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33c06ae30 0x7fd33c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.459+0000 7fd35a7fc640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33c06ae30 0x7fd33c06d2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd344013750 tx=0x7fd344016000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:48.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.460+0000 7fd35affd640 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf610eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd34c005c00 tx=0x7fd34c010610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9028c6c289815b23 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:48.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.460+0000 7fd33a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2023-10-18T11:10:48.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.462+0000 7fd353fff640 1 -- 172.21.15.151:0/4117128565 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd354009110 con 0x7fd35c14fe20 2023-10-18T11:10:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.464+0000 7fd33a7fc640 1 -- 172.21.15.151:0/647930332 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c001e50 con 0x55e1cf61e800 2023-10-18T11:10:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.464+0000 7fd33a7fc640 1 -- 172.21.15.151:0/647930332 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd34c001fb0 con 0x55e1cf61e800 2023-10-18T11:10:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.464+0000 7fd3641fd740 1 -- 172.21.15.151:0/647930332 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1cf561160 con 0x55e1cf61e800 2023-10-18T11:10:48.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.466+0000 7fd33a7fc640 1 -- 172.21.15.151:0/647930332 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd34c0070d0 con 0x55e1cf61e800 2023-10-18T11:10:48.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.466+0000 7fd3641fd740 10 client.4786 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:48.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.466+0000 7fd3641fd740 1 -- 172.21.15.151:0/647930332 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e1cf538da0 con 0x55e1cf61e800 2023-10-18T11:10:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.470+0000 7fd33a7fc640 1 -- 172.21.15.151:0/647930332 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e1cf561160 con 0x55e1cf61e800 2023-10-18T11:10:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.470+0000 7fd33a7fc640 1 -- 172.21.15.151:0/647930332 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fd34c01e3f0 con 0x55e1cf61e800 2023-10-18T11:10:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.470+0000 7fd3641fd740 10 client.4786 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.470+0000 7fd3641fd740 10 client.4786 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-18T11:10:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.470+0000 7fd3641fd740 20 client.4786 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:48.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.470+0000 7fd3641fd740 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] conn(0x55e1cf629070 0x55e1cf629450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.470+0000 7fd3641fd740 4 client.4786 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T11:10:48.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.470+0000 7fd3641fd740 1 -- 172.21.15.151:0/647930332 --> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1cf50ccc0 con 0x55e1cf629070 2023-10-18T11:10:48.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.471+0000 7fd35a7fc640 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] conn(0x55e1cf629070 0x55e1cf629450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.515+0000 7fd35a7fc640 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] conn(0x55e1cf629070 0x55e1cf629450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2f3e806ea3f19b7 server_cookie=f355b5d4b2d65a4f in_seq=0 out_seq=0 2023-10-18T11:10:48.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.515+0000 7fd33a7fc640 10 client.4786 ms_handle_connect on v2:172.21.15.151:6834/2666139932 2023-10-18T11:10:48.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.696+0000 7fd33a7fc640 1 -- 172.21.15.151:0/647930332 <== mds.2 v2:172.21.15.151:6834/2666139932 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e1cf50ccc0 con 0x55e1cf629070 2023-10-18T11:10:48.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.696+0000 7fd33a7fc640 10 client.4786 handle_command_reply: tid=0 2023-10-18T11:10:48.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.696+0000 7fd3641fd740 1 client.4786 shutdown 2023-10-18T11:10:48.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.697+0000 7fd3641fd740 1 -- 172.21.15.151:0/647930332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 msgr2=0x55e1cf610eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.697+0000 7fd3641fd740 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf610eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd34c005c00 tx=0x7fd34c010610 comp rx=0 tx=0).stop 2023-10-18T11:10:48.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.697+0000 7fd3641fd740 1 -- 172.21.15.151:0/647930332 shutdown_connections 2023-10-18T11:10:48.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.697+0000 7fd3641fd740 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] conn(0x55e1cf629070 0x55e1cf629450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.697+0000 7fd3641fd740 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf619e30 0x55e1cf5fdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.697+0000 7fd3641fd740 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf610eb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.697+0000 7fd3641fd740 1 --2- 172.21.15.151:0/647930332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf5d4980 0x55e1cf625580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.697+0000 7fd3641fd740 1 -- 172.21.15.151:0/647930332 >> 172.21.15.151:0/647930332 conn(0x55e1cf5d33e0 msgr2=0x55e1cf5d4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.697+0000 7fd33a7fc640 0 client.4786 ms_handle_reset on v2:172.21.15.151:6834/2666139932 2023-10-18T11:10:48.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.698+0000 7fd3641fd740 1 -- 172.21.15.151:0/647930332 shutdown_connections 2023-10-18T11:10:48.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.698+0000 7fd3641fd740 1 -- 172.21.15.151:0/647930332 wait complete. 2023-10-18T11:10:48.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.698+0000 7fd3641fd740 20 client.4786 trim_cache size 0 max 16384 2023-10-18T11:10:48.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.733+0000 7fd3641fd740 1 Processor -- start 2023-10-18T11:10:48.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.733+0000 7fd3641fd740 1 -- start start 2023-10-18T11:10:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.734+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf6119c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.734+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf619e30 0x55e1cf611f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.734+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 0x55e1cf5d4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.734+0000 7fd3641fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf29ef20 con 0x55e1cf61e800 2023-10-18T11:10:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.734+0000 7fd3641fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf5fef20 con 0x55e1cf619e30 2023-10-18T11:10:48.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.734+0000 7fd3641fd740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf5d2870 con 0x55e1cf5d4980 2023-10-18T11:10:48.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.735+0000 7fd35affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf6119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.735+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf619e30 0x55e1cf611f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.736+0000 7fd35b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 0x55e1cf5d4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.736+0000 7fd35affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf6119c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:60972/0 (socket says 172.21.15.151:60972) 2023-10-18T11:10:48.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.736+0000 7fd35affd640 1 -- 172.21.15.151:0/3730528953 learned_addr learned my addr 172.21.15.151:0/3730528953 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:48.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.738+0000 7fd35affd640 1 -- 172.21.15.151:0/3730528953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf619e30 msgr2=0x55e1cf611f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.738+0000 7fd35affd640 1 --2- 172.21.15.151:0/3730528953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf619e30 0x55e1cf611f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.738+0000 7fd35affd640 1 -- 172.21.15.151:0/3730528953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 msgr2=0x55e1cf5d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.738+0000 7fd35affd640 1 --2- 172.21.15.151:0/3730528953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 0x55e1cf5d4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.738+0000 7fd35affd640 1 -- 172.21.15.151:0/3730528953 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1cf4d7b80 con 0x55e1cf5d4980 2023-10-18T11:10:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.740+0000 7fd35affd640 1 --2- 172.21.15.151:0/3730528953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf6119c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd34c013010 tx=0x7fd34c00c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9548a7af54d43c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.743+0000 7fd351ffb640 1 -- 172.21.15.151:0/3730528953 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c01ec60 con 0x55e1cf5d4980 2023-10-18T11:10:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.743+0000 7fd351ffb640 1 -- 172.21.15.151:0/3730528953 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0012c0 con 0x55e1cf5d4980 2023-10-18T11:10:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.743+0000 7fd351ffb640 1 -- 172.21.15.151:0/3730528953 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c01e3f0 con 0x55e1cf5d4980 2023-10-18T11:10:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.744+0000 7fd3641fd740 1 -- 172.21.15.151:0/3730528953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 msgr2=0x55e1cf6119c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.744+0000 7fd3641fd740 1 --2- 172.21.15.151:0/3730528953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf6119c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd34c013010 tx=0x7fd34c00c000 comp rx=0 tx=0).stop 2023-10-18T11:10:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.744+0000 7fd3641fd740 1 -- 172.21.15.151:0/3730528953 shutdown_connections 2023-10-18T11:10:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.744+0000 7fd3641fd740 1 --2- 172.21.15.151:0/3730528953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf61e800 0x55e1cf5d4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.744+0000 7fd3641fd740 1 --2- 172.21.15.151:0/3730528953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf619e30 0x55e1cf611f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.744+0000 7fd3641fd740 1 --2- 172.21.15.151:0/3730528953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf6119c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.744+0000 7fd3641fd740 1 -- 172.21.15.151:0/3730528953 >> 172.21.15.151:0/3730528953 conn(0x55e1cf5d33e0 msgr2=0x55e1cf61dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.745+0000 7fd3641fd740 1 -- 172.21.15.151:0/3730528953 shutdown_connections 2023-10-18T11:10:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.745+0000 7fd3641fd740 1 -- 172.21.15.151:0/3730528953 wait complete. 2023-10-18T11:10:48.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.745+0000 7fd3641fd740 1 -- start start 2023-10-18T11:10:48.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.746+0000 7fd3641fd740 1 Processor -- start 2023-10-18T11:10:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.747+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf610470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.747+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf619e30 0x55e1cf680f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.747+0000 7fd3641fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf6872a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.747+0000 7fd3641fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf68a1d0 con 0x55e1cf619e30 2023-10-18T11:10:48.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.747+0000 7fd3641fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf5fd890 con 0x55e1cf61e800 2023-10-18T11:10:48.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.747+0000 7fd3641fd740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1cf686e10 con 0x55e1cf5d4980 2023-10-18T11:10:48.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.748+0000 7fd3641fd740 10 client.0 _ll_register_callbacks cb 0x7fd34c001c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.748+0000 7fd35b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf6872a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.748+0000 7fd35affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf610470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.748+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf619e30 0x55e1cf680f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.748+0000 7fd35affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf610470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:60978/0 (socket says 172.21.15.151:60978) 2023-10-18T11:10:48.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.748+0000 7fd35affd640 1 -- 172.21.15.151:0/2100785163 learned_addr learned my addr 172.21.15.151:0/2100785163 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:48.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.751+0000 7fd35b7fe640 1 -- 172.21.15.151:0/2100785163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 msgr2=0x55e1cf610470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.751+0000 7fd35b7fe640 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf610470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.751+0000 7fd35b7fe640 1 -- 172.21.15.151:0/2100785163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf619e30 msgr2=0x55e1cf680f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:48.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.751+0000 7fd35b7fe640 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf619e30 0x55e1cf680f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.751+0000 7fd35b7fe640 1 -- 172.21.15.151:0/2100785163 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1cf538da0 con 0x55e1cf61e800 2023-10-18T11:10:48.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.753+0000 7fd35b7fe640 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf6872a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3540097a0 tx=0x7fd3540827c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7033cef9f1e57d9a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.753+0000 7fd33a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2023-10-18T11:10:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.757+0000 7fd33a7fc640 1 -- 172.21.15.151:0/2100785163 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3540a7070 con 0x55e1cf61e800 2023-10-18T11:10:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.757+0000 7fd33a7fc640 1 -- 172.21.15.151:0/2100785163 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd35407e160 con 0x55e1cf61e800 2023-10-18T11:10:48.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.757+0000 7fd3641fd740 1 -- 172.21.15.151:0/2100785163 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd344004190 con 0x55e1cf61e800 2023-10-18T11:10:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.759+0000 7fd33a7fc640 1 -- 172.21.15.151:0/2100785163 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd35407e320 con 0x55e1cf61e800 2023-10-18T11:10:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.760+0000 7fd3641fd740 10 client.4792 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.760+0000 7fd3641fd740 1 -- 172.21.15.151:0/2100785163 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e1cf4fd170 con 0x55e1cf61e800 2023-10-18T11:10:48.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.764+0000 7fd33a7fc640 1 -- 172.21.15.151:0/2100785163 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd344004190 con 0x55e1cf61e800 2023-10-18T11:10:48.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.764+0000 7fd33a7fc640 1 -- 172.21.15.151:0/2100785163 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fd354082200 con 0x55e1cf61e800 2023-10-18T11:10:48.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.764+0000 7fd3641fd740 10 client.4792 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:48.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.764+0000 7fd3641fd740 10 client.4792 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-18T11:10:48.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.764+0000 7fd3641fd740 20 client.4792 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:48.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.764+0000 7fd3641fd740 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] conn(0x55e1cf60d920 0x55e1cf60dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:48.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.764+0000 7fd3641fd740 4 client.4792 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T11:10:48.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.764+0000 7fd3641fd740 1 -- 172.21.15.151:0/2100785163 --> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e1cf533700 con 0x55e1cf60d920 2023-10-18T11:10:48.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.766+0000 7fd35affd640 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] conn(0x55e1cf60d920 0x55e1cf60dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:48.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.773+0000 7fd35affd640 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] conn(0x55e1cf60d920 0x55e1cf60dd00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae959af90590813 server_cookie=e4e9bd65c78a33 in_seq=0 out_seq=0 2023-10-18T11:10:48.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.773+0000 7fd33a7fc640 10 client.4792 ms_handle_connect on v2:172.21.15.151:6834/2666139932 2023-10-18T11:10:48.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.797+0000 7fd33a7fc640 1 -- 172.21.15.151:0/2100785163 <== mds.2 v2:172.21.15.151:6834/2666139932 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e1cf533700 con 0x55e1cf60d920 2023-10-18T11:10:48.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.797+0000 7fd33a7fc640 10 client.4792 handle_command_reply: tid=0 2023-10-18T11:10:48.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.797+0000 7fd3641fd740 1 client.4792 shutdown 2023-10-18T11:10:48.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 -- 172.21.15.151:0/2100785163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 msgr2=0x55e1cf6872a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf6872a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3540097a0 tx=0x7fd3540827c0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 -- 172.21.15.151:0/2100785163 shutdown_connections 2023-10-18T11:10:48.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.151:6834/2666139932,v1:172.21.15.151:6835/2666139932] conn(0x55e1cf60d920 0x55e1cf60dd00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e1cf61e800 0x55e1cf6872a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e1cf619e30 0x55e1cf680f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd33a7fc640 0 client.4792 ms_handle_reset on v2:172.21.15.151:6834/2666139932 2023-10-18T11:10:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 --2- 172.21.15.151:0/2100785163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e1cf5d4980 0x55e1cf610470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 -- 172.21.15.151:0/2100785163 >> 172.21.15.151:0/2100785163 conn(0x55e1cf5d33e0 msgr2=0x55e1cf61dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 -- 172.21.15.151:0/2100785163 shutdown_connections 2023-10-18T11:10:48.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.798+0000 7fd3641fd740 1 -- 172.21.15.151:0/2100785163 wait complete. 2023-10-18T11:10:48.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.799+0000 7fd3641fd740 20 client.4792 trim_cache size 0 max 16384 2023-10-18T11:10:48.804 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:10:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "31f501b1-61b9-452b-813c-bb68ad49056d", 2023-10-18T11:10:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 2, 2023-10-18T11:10:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4244, 2023-10-18T11:10:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-10-18T11:10:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-10-18T11:10:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-10-18T11:10:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 21.587908639999998, 2023-10-18T11:10:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 18, 2023-10-18T11:10:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 31, 2023-10-18T11:10:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 31, 2023-10-18T11:10:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 78.420090328000001 2023-10-18T11:10:48.806 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:10:48.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 -- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33c06ae30 msgr2=0x7fd33c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33c06ae30 0x7fd33c06d2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd344013750 tx=0x7fd344016000 comp rx=0 tx=0).stop 2023-10-18T11:10:48.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 -- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c14fe20 msgr2=0x7fd35c1ee0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:48.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c14fe20 0x7fd35c1ee0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd354033000 tx=0x7fd3540046c0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 -- 172.21.15.151:0/4117128565 shutdown_connections 2023-10-18T11:10:48.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd35c14fe20 0x7fd35c1ee0f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd33c06ae30 0x7fd33c06d2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c070ee0 0x7fd35c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 --2- 172.21.15.151:0/4117128565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd35c070790 0x7fd35c14ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:48.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 -- 172.21.15.151:0/4117128565 >> 172.21.15.151:0/4117128565 conn(0x7fd35c069f70 msgr2=0x7fd35c0c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:48.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.800+0000 7fd3619d0640 1 -- 172.21.15.151:0/4117128565 shutdown_connections 2023-10-18T11:10:48.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:48.801+0000 7fd3619d0640 1 -- 172.21.15.151:0/4117128565 wait complete. 2023-10-18T11:10:48.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-18T11:10:49.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.039+0000 7fe163725640 1 Processor -- start 2023-10-18T11:10:49.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.039+0000 7fe163725640 1 -- start start 2023-10-18T11:10:49.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.040+0000 7fe163725640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe15c0c4e60 0x7fe15c0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.041+0000 7fe163725640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c06d430 con 0x7fe15c1510a0 2023-10-18T11:10:49.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.041+0000 7fe163725640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c151480 con 0x7fe15c0c2180 2023-10-18T11:10:49.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.041+0000 7fe163725640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c0c57b0 con 0x7fe15c0c4e60 2023-10-18T11:10:49.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.041+0000 7fe160cc0640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fe15c0c2180 0x7fe15c06d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47194/0 (socket says 172.21.15.151:47194) 2023-10-18T11:10:49.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.041+0000 7fe160cc0640 1 -- 172.21.15.151:0/3306080563 learned_addr learned my addr 172.21.15.151:0/3306080563 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:49.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.042+0000 7fe161cc2640 1 --2- 172.21.15.151:0/3306080563 >> v2:172.21.15.151:3300/0 conn(0x7fe15c0c4e60 0x7fe15c0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.044+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501422820 0 0) 0x7fe15c151480 con 0x7fe15c0c2180 2023-10-18T11:10:49.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.044+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe148003520 con 0x7fe15c0c2180 2023-10-18T11:10:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4270295260 0 0) 0x7fe148003520 con 0x7fe15c0c2180 2023-10-18T11:10:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 >> v2:172.21.15.151:3300/0 conn(0x7fe15c0c4e60 msgr2=0x7fe15c0c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 --2- 172.21.15.151:0/3306080563 >> v2:172.21.15.151:3300/0 conn(0x7fe15c0c4e60 0x7fe15c0c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 >> v1:172.21.15.151:6789/0 conn(0x7fe15c1510a0 legacy=0x7fe15c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0c27d0 con 0x7fe15c0c2180 2023-10-18T11:10:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7fe14c001670 con 0x7fe15c0c2180 2023-10-18T11:10:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 >> v1:172.21.15.169:6789/0 conn(0x7fe15c0c2180 legacy=0x7fe15c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1480039c0 0x7fe148003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1480047c0 0x7fe148004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe148005180 0x7fe14800fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0c57b0 con 0x7fe148005180 2023-10-18T11:10:49.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148010470 con 0x7fe1480047c0 2023-10-18T11:10:49.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.047+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe148010630 con 0x7fe1480039c0 2023-10-18T11:10:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.048+0000 7fe1614c1640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1480039c0 0x7fe148003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.050+0000 7fe160cc0640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1480047c0 0x7fe148004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.051+0000 7fe1614c1640 1 -- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1480047c0 msgr2=0x7fe148004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.051+0000 7fe1614c1640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1480047c0 0x7fe148004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.051+0000 7fe1614c1640 1 -- 172.21.15.151:0/3306080563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe148005180 msgr2=0x7fe14800fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.051+0000 7fe1614c1640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe148005180 0x7fe14800fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.051+0000 7fe1614c1640 1 -- 172.21.15.151:0/3306080563 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148003520 con 0x7fe1480039c0 2023-10-18T11:10:49.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.051+0000 7fe161cc2640 1 -- 172.21.15.151:0/3306080563 reap_dead start 2023-10-18T11:10:49.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.054+0000 7fe1614c1640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1480039c0 0x7fe148003de0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe158001750 tx=0x7fe1480057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23c6138eb3443aaf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.057+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1580052d0 con 0x7fe1480039c0 2023-10-18T11:10:49.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.057+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15802e050 con 0x7fe1480039c0 2023-10-18T11:10:49.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.057+0000 7fe153fff640 1 -- 172.21.15.151:0/3306080563 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158003830 con 0x7fe1480039c0 2023-10-18T11:10:49.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.058+0000 7fe163725640 1 -- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1480039c0 msgr2=0x7fe148003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.058+0000 7fe163725640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1480039c0 0x7fe148003de0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe158001750 tx=0x7fe1480057f0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.058+0000 7fe163725640 1 -- 172.21.15.151:0/3306080563 shutdown_connections 2023-10-18T11:10:49.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.058+0000 7fe163725640 1 --2- 172.21.15.151:0/3306080563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1480039c0 0x7fe148003de0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.058+0000 7fe163725640 1 -- 172.21.15.151:0/3306080563 >> 172.21.15.151:0/3306080563 conn(0x7fe15c069f70 msgr2=0x7fe15c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.058+0000 7fe163725640 1 -- 172.21.15.151:0/3306080563 shutdown_connections 2023-10-18T11:10:49.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.058+0000 7fe163725640 1 -- 172.21.15.151:0/3306080563 wait complete. 2023-10-18T11:10:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.060+0000 7fe163725640 1 Processor -- start 2023-10-18T11:10:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.061+0000 7fe163725640 1 -- start start 2023-10-18T11:10:49.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.062+0000 7fe163725640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1480039c0 0x7fe15c1ee330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.062+0000 7fe163725640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe15c1449e0 0x7fe15c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.062+0000 7fe163725640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15c1439f0 0x7fe15c143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.062+0000 7fe163725640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c1ee870 con 0x7fe15c1439f0 2023-10-18T11:10:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.062+0000 7fe163725640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c158560 con 0x7fe1480039c0 2023-10-18T11:10:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.062+0000 7fe163725640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c144fb0 con 0x7fe15c1449e0 2023-10-18T11:10:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.063+0000 7fe1614c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1480039c0 0x7fe15c1ee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.063+0000 7fe161cc2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15c1439f0 0x7fe15c143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.063+0000 7fe160cc0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe15c1449e0 0x7fe15c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.063+0000 7fe160cc0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe15c1449e0 0x7fe15c070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:60998/0 (socket says 172.21.15.151:60998) 2023-10-18T11:10:49.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.063+0000 7fe160cc0640 1 -- 172.21.15.151:0/4264753415 learned_addr learned my addr 172.21.15.151:0/4264753415 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.066+0000 7fe160cc0640 1 -- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1480039c0 msgr2=0x7fe15c1ee330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.066+0000 7fe160cc0640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1480039c0 0x7fe15c1ee330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.066+0000 7fe160cc0640 1 -- 172.21.15.151:0/4264753415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15c1439f0 msgr2=0x7fe15c143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.066+0000 7fe160cc0640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15c1439f0 0x7fe15c143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.066+0000 7fe160cc0640 1 -- 172.21.15.151:0/4264753415 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c157fa0 con 0x7fe15c1449e0 2023-10-18T11:10:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.069+0000 7fe160cc0640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe15c1449e0 0x7fe15c070ee0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0072c0 tx=0x7fe14c007780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.072+0000 7fe151ffb640 1 -- 172.21.15.151:0/4264753415 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c001430 con 0x7fe15c1449e0 2023-10-18T11:10:49.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.073+0000 7fe151ffb640 1 -- 172.21.15.151:0/4264753415 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c00f940 con 0x7fe15c1449e0 2023-10-18T11:10:49.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.073+0000 7fe151ffb640 1 -- 172.21.15.151:0/4264753415 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00fcf0 con 0x7fe15c1449e0 2023-10-18T11:10:49.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.073+0000 7fe163725640 1 -- 172.21.15.151:0/4264753415 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c158280 con 0x7fe15c1449e0 2023-10-18T11:10:49.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.073+0000 7fe163725640 1 -- 172.21.15.151:0/4264753415 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c1434d0 con 0x7fe15c1449e0 2023-10-18T11:10:49.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.076+0000 7fe16638d740 1 Processor -- start 2023-10-18T11:10:49.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.077+0000 7fe16638d740 1 -- start start 2023-10-18T11:10:49.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.078+0000 7fe16638d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 0x55560f332d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.078+0000 7fe16638d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.078+0000 7fe16638d740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f3313e0 0x55560f3721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.078+0000 7fe16638d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560f24d7a0 con 0x55560f332980 2023-10-18T11:10:49.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.078+0000 7fe16638d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560f29f740 con 0x55560f37c800 2023-10-18T11:10:49.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.078+0000 7fe16638d740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560f29ce30 con 0x55560f3313e0 2023-10-18T11:10:49.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.078+0000 7fe1614c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.078+0000 7fe161cc2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 0x55560f332d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.079+0000 7fe1614c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3332a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:52464/0 (socket says 172.21.15.151:52464) 2023-10-18T11:10:49.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.079+0000 7fe1614c1640 1 -- 172.21.15.151:0/3100375149 learned_addr learned my addr 172.21.15.151:0/3100375149 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.081+0000 7fe1614c1640 1 -- 172.21.15.151:0/3100375149 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f3313e0 msgr2=0x55560f3721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.081+0000 7fe1614c1640 1 --2- 172.21.15.151:0/3100375149 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f3313e0 0x55560f3721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.081+0000 7fe1614c1640 1 -- 172.21.15.151:0/3100375149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 msgr2=0x55560f332d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.081+0000 7fe1614c1640 1 --2- 172.21.15.151:0/3100375149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 0x55560f332d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.081+0000 7fe1614c1640 1 -- 172.21.15.151:0/3100375149 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55560f25c910 con 0x55560f37c800 2023-10-18T11:10:49.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.083+0000 7fe1614c1640 1 --2- 172.21.15.151:0/3100375149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3332a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe158034040 tx=0x7fe15802f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18f203710db82ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.087+0000 7fe13effd640 1 -- 172.21.15.151:0/3100375149 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1580050d0 con 0x55560f37c800 2023-10-18T11:10:49.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.087+0000 7fe13effd640 1 -- 172.21.15.151:0/3100375149 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe158005230 con 0x55560f37c800 2023-10-18T11:10:49.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.087+0000 7fe13effd640 1 -- 172.21.15.151:0/3100375149 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158007040 con 0x55560f37c800 2023-10-18T11:10:49.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.087+0000 7fe16638d740 1 -- 172.21.15.151:0/3100375149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 msgr2=0x55560f3332a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.087+0000 7fe16638d740 1 --2- 172.21.15.151:0/3100375149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3332a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe158034040 tx=0x7fe15802f000 comp rx=0 tx=0).stop 2023-10-18T11:10:49.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.088+0000 7fe16638d740 1 -- 172.21.15.151:0/3100375149 shutdown_connections 2023-10-18T11:10:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.088+0000 7fe16638d740 1 --2- 172.21.15.151:0/3100375149 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f3313e0 0x55560f3721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.088+0000 7fe16638d740 1 --2- 172.21.15.151:0/3100375149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3332a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.088+0000 7fe16638d740 1 --2- 172.21.15.151:0/3100375149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 0x55560f332d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.088+0000 7fe16638d740 1 -- 172.21.15.151:0/3100375149 >> 172.21.15.151:0/3100375149 conn(0x55560f32f0f0 msgr2=0x55560f331a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.088+0000 7fe16638d740 1 -- 172.21.15.151:0/3100375149 shutdown_connections 2023-10-18T11:10:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.088+0000 7fe16638d740 1 -- 172.21.15.151:0/3100375149 wait complete. 2023-10-18T11:10:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.089+0000 7fe16638d740 1 -- start start 2023-10-18T11:10:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.089+0000 7fe16638d740 1 Processor -- start 2023-10-18T11:10:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.090+0000 7fe16638d740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f332980 0x55560f357f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.090+0000 7fe16638d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f36ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.090+0000 7fe16638d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f386e80 0x55560f387300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.091+0000 7fe16638d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560f298720 con 0x55560f386e80 2023-10-18T11:10:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.091+0000 7fe16638d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560f236970 con 0x55560f37c800 2023-10-18T11:10:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.091+0000 7fe16638d740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560f236610 con 0x55560f332980 2023-10-18T11:10:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.091+0000 7fe16638d740 10 client.0 _ll_register_callbacks cb 0x55560f2589d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:49.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.091+0000 7fe1614c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f36ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.091+0000 7fe160cc0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f386e80 0x55560f387300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.092+0000 7fe1614c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f36ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:52478/0 (socket says 172.21.15.151:52478) 2023-10-18T11:10:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.092+0000 7fe1614c1640 1 -- 172.21.15.151:0/731812117 learned_addr learned my addr 172.21.15.151:0/731812117 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.094+0000 7fe151ffb640 1 -- 172.21.15.151:0/4264753415 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe14c01e470 con 0x7fe15c1449e0 2023-10-18T11:10:49.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.095+0000 7fe1614c1640 1 -- 172.21.15.151:0/731812117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f332980 msgr2=0x55560f357f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.095+0000 7fe1614c1640 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f332980 0x55560f357f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.095+0000 7fe1614c1640 1 -- 172.21.15.151:0/731812117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f386e80 msgr2=0x55560f387300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.095+0000 7fe1614c1640 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f386e80 0x55560f387300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.095+0000 7fe1614c1640 1 -- 172.21.15.151:0/731812117 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe148003520 con 0x55560f37c800 2023-10-18T11:10:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.095+0000 7fe151ffb640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe14006ae30 0x7fe14006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.095+0000 7fe161cc2640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe14006ae30 0x7fe14006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.096+0000 7fe161cc2640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe14006ae30 0x7fe14006d2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0c1520 tx=0x7fe15400b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.097+0000 7fe1614c1640 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f36ee30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe158001870 tx=0x7fe158001190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18209e672a7d1ad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.097+0000 7fe137fff640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2023-10-18T11:10:49.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.097+0000 7fe151ffb640 1 -- 172.21.15.151:0/4264753415 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe14c05f8a0 con 0x7fe15c1449e0 2023-10-18T11:10:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.100+0000 7fe137fff640 1 -- 172.21.15.151:0/731812117 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158003e50 con 0x55560f37c800 2023-10-18T11:10:49.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.100+0000 7fe137fff640 1 -- 172.21.15.151:0/731812117 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1580067d0 con 0x55560f37c800 2023-10-18T11:10:49.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.100+0000 7fe16638d740 1 -- 172.21.15.151:0/731812117 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55560f2bf160 con 0x55560f37c800 2023-10-18T11:10:49.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.102+0000 7fe137fff640 1 -- 172.21.15.151:0/731812117 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe158006990 con 0x55560f37c800 2023-10-18T11:10:49.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.102+0000 7fe16638d740 10 client.4804 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:49.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.102+0000 7fe16638d740 1 -- 172.21.15.151:0/731812117 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55560f296da0 con 0x55560f37c800 2023-10-18T11:10:49.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.105+0000 7fe137fff640 1 -- 172.21.15.151:0/731812117 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55560f2bf160 con 0x55560f37c800 2023-10-18T11:10:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.107+0000 7fe137fff640 1 -- 172.21.15.151:0/731812117 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fe15804e070 con 0x55560f37c800 2023-10-18T11:10:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.107+0000 7fe16638d740 10 client.4804 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.107+0000 7fe16638d740 10 client.4804 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-18T11:10:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.107+0000 7fe16638d740 20 client.4804 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.107+0000 7fe16638d740 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] conn(0x55560f37ce20 0x55560f37d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.107+0000 7fe16638d740 4 client.4804 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T11:10:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.107+0000 7fe16638d740 1 -- 172.21.15.151:0/731812117 --> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55560f26acc0 con 0x55560f37ce20 2023-10-18T11:10:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.109+0000 7fe160cc0640 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] conn(0x55560f37ce20 0x55560f37d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.162+0000 7fe160cc0640 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] conn(0x55560f37ce20 0x55560f37d200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94e233b549db373a server_cookie=11bd810719ce34df in_seq=0 out_seq=0 2023-10-18T11:10:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.162+0000 7fe137fff640 10 client.4804 ms_handle_connect on v2:172.21.15.151:6832/251484638 2023-10-18T11:10:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.343+0000 7fe137fff640 1 -- 172.21.15.151:0/731812117 <== mds.1 v2:172.21.15.151:6832/251484638 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55560f26acc0 con 0x55560f37ce20 2023-10-18T11:10:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.343+0000 7fe137fff640 10 client.4804 handle_command_reply: tid=0 2023-10-18T11:10:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.343+0000 7fe16638d740 1 client.4804 shutdown 2023-10-18T11:10:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.344+0000 7fe16638d740 1 -- 172.21.15.151:0/731812117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 msgr2=0x55560f36ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.344+0000 7fe16638d740 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f36ee30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe158001870 tx=0x7fe158001190 comp rx=0 tx=0).stop 2023-10-18T11:10:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.344+0000 7fe16638d740 1 -- 172.21.15.151:0/731812117 shutdown_connections 2023-10-18T11:10:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.344+0000 7fe16638d740 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] conn(0x55560f37ce20 0x55560f37d200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.344+0000 7fe16638d740 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f386e80 0x55560f387300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.344+0000 7fe16638d740 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f36ee30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.344+0000 7fe16638d740 1 --2- 172.21.15.151:0/731812117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f332980 0x55560f357f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.344+0000 7fe16638d740 1 -- 172.21.15.151:0/731812117 >> 172.21.15.151:0/731812117 conn(0x55560f3313e0 msgr2=0x55560f332d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.344+0000 7fe137fff640 0 client.4804 ms_handle_reset on v2:172.21.15.151:6832/251484638 2023-10-18T11:10:49.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.345+0000 7fe16638d740 1 -- 172.21.15.151:0/731812117 shutdown_connections 2023-10-18T11:10:49.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.345+0000 7fe16638d740 1 -- 172.21.15.151:0/731812117 wait complete. 2023-10-18T11:10:49.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.345+0000 7fe16638d740 20 client.4804 trim_cache size 0 max 16384 2023-10-18T11:10:49.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.389+0000 7fe16638d740 1 Processor -- start 2023-10-18T11:10:49.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.389+0000 7fe16638d740 1 -- start start 2023-10-18T11:10:49.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.391+0000 7fe16638d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f332980 0x55560f330940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.391+0000 7fe16638d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f37c800 0x55560f330e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.391+0000 7fe16638d740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f32d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.391+0000 7fe16638d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560effcf20 con 0x55560f37c800 2023-10-18T11:10:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.391+0000 7fe16638d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560f38dc50 con 0x55560f332980 2023-10-18T11:10:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.391+0000 7fe16638d740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560f35c3d0 con 0x55560f386e80 2023-10-18T11:10:49.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.392+0000 7fe161cc2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f32d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.392+0000 7fe1614c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f332980 0x55560f330940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.392+0000 7fe161cc2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f32d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:32782/0 (socket says 172.21.15.151:32782) 2023-10-18T11:10:49.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.392+0000 7fe161cc2640 1 -- 172.21.15.151:0/2545194164 learned_addr learned my addr 172.21.15.151:0/2545194164 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.395+0000 7fe161cc2640 1 -- 172.21.15.151:0/2545194164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f332980 msgr2=0x55560f330940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.395+0000 7fe161cc2640 1 --2- 172.21.15.151:0/2545194164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f332980 0x55560f330940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.395+0000 7fe161cc2640 1 -- 172.21.15.151:0/2545194164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f37c800 msgr2=0x55560f330e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.395+0000 7fe161cc2640 1 --2- 172.21.15.151:0/2545194164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f37c800 0x55560f330e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.395+0000 7fe161cc2640 1 -- 172.21.15.151:0/2545194164 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55560f235b80 con 0x55560f386e80 2023-10-18T11:10:49.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.395+0000 7fe1614c1640 1 --2- 172.21.15.151:0/2545194164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f332980 0x55560f330940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:49.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.397+0000 7fe161cc2640 1 --2- 172.21.15.151:0/2545194164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f32d760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe15c066ac0 tx=0x7fe154017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09783b8b436d2df server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.400+0000 7fe13f7fe640 1 -- 172.21.15.151:0/2545194164 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15401f040 con 0x55560f386e80 2023-10-18T11:10:49.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.400+0000 7fe13f7fe640 1 -- 172.21.15.151:0/2545194164 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1540256b0 con 0x55560f386e80 2023-10-18T11:10:49.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.400+0000 7fe13f7fe640 1 -- 172.21.15.151:0/2545194164 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154010040 con 0x55560f386e80 2023-10-18T11:10:49.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.402+0000 7fe16638d740 1 -- 172.21.15.151:0/2545194164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 msgr2=0x55560f32d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.402+0000 7fe16638d740 1 --2- 172.21.15.151:0/2545194164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f32d760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe15c066ac0 tx=0x7fe154017000 comp rx=0 tx=0).stop 2023-10-18T11:10:49.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.402+0000 7fe16638d740 1 -- 172.21.15.151:0/2545194164 shutdown_connections 2023-10-18T11:10:49.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.402+0000 7fe16638d740 1 --2- 172.21.15.151:0/2545194164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f32d760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.402+0000 7fe16638d740 1 --2- 172.21.15.151:0/2545194164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f37c800 0x55560f330e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.402+0000 7fe16638d740 1 --2- 172.21.15.151:0/2545194164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f332980 0x55560f330940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.402+0000 7fe16638d740 1 -- 172.21.15.151:0/2545194164 >> 172.21.15.151:0/2545194164 conn(0x55560f3313e0 msgr2=0x55560f370df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.402+0000 7fe16638d740 1 -- 172.21.15.151:0/2545194164 shutdown_connections 2023-10-18T11:10:49.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.402+0000 7fe16638d740 1 -- 172.21.15.151:0/2545194164 wait complete. 2023-10-18T11:10:49.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.404+0000 7fe16638d740 1 -- start start 2023-10-18T11:10:49.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.405+0000 7fe16638d740 1 Processor -- start 2023-10-18T11:10:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.407+0000 7fe16638d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 0x55560f32dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.407+0000 7fe16638d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3dc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.407+0000 7fe16638d740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f3d59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.407+0000 7fe16638d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560f3336c0 con 0x55560f332980 2023-10-18T11:10:49.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.407+0000 7fe16638d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560f332030 con 0x55560f37c800 2023-10-18T11:10:49.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.407+0000 7fe16638d740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560f32cc60 con 0x55560f386e80 2023-10-18T11:10:49.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.408+0000 7fe16638d740 10 client.0 _ll_register_callbacks cb 0x7fe154009230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:49.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.408+0000 7fe1614c1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 0x55560f32dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.408+0000 7fe161cc2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f3d59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.408+0000 7fe160cc0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3dc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.408+0000 7fe161cc2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f3d59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:32784/0 (socket says 172.21.15.151:32784) 2023-10-18T11:10:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.408+0000 7fe161cc2640 1 -- 172.21.15.151:0/56864719 learned_addr learned my addr 172.21.15.151:0/56864719 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.412+0000 7fe161cc2640 1 -- 172.21.15.151:0/56864719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 msgr2=0x55560f3dc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.412+0000 7fe161cc2640 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3dc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.412+0000 7fe161cc2640 1 -- 172.21.15.151:0/56864719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 msgr2=0x55560f32dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.412+0000 7fe161cc2640 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 0x55560f32dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.412+0000 7fe161cc2640 1 -- 172.21.15.151:0/56864719 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55560f296da0 con 0x55560f386e80 2023-10-18T11:10:49.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.412+0000 7fe1614c1640 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 0x55560f32dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:49.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.414+0000 7fe161cc2640 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f3d59b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe154009380 tx=0x7fe154004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e384a20aa35c832 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.414+0000 7fe137fff640 10 client.0 ms_handle_connect on v2:172.21.15.169:3301/0 2023-10-18T11:10:49.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.418+0000 7fe137fff640 1 -- 172.21.15.151:0/56864719 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154010040 con 0x55560f386e80 2023-10-18T11:10:49.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.418+0000 7fe137fff640 1 -- 172.21.15.151:0/56864719 <== mon.2 v2:172.21.15.169:3301/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe15402e630 con 0x55560f386e80 2023-10-18T11:10:49.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.418+0000 7fe16638d740 1 -- 172.21.15.151:0/56864719 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe158005230 con 0x55560f386e80 2023-10-18T11:10:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.420+0000 7fe137fff640 1 -- 172.21.15.151:0/56864719 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe154007040 con 0x55560f386e80 2023-10-18T11:10:49.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.420+0000 7fe16638d740 10 client.4646 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:49.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.420+0000 7fe16638d740 1 -- 172.21.15.151:0/56864719 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7fe154003990 con 0x55560f386e80 2023-10-18T11:10:49.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.424+0000 7fe137fff640 1 -- 172.21.15.151:0/56864719 <== mon.2 v2:172.21.15.169:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe158005230 con 0x55560f386e80 2023-10-18T11:10:49.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.424+0000 7fe137fff640 1 -- 172.21.15.151:0/56864719 <== mon.2 v2:172.21.15.169:3301/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fe15402e7f0 con 0x55560f386e80 2023-10-18T11:10:49.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.424+0000 7fe16638d740 10 client.4646 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:49.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.424+0000 7fe16638d740 10 client.4646 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-18T11:10:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.424+0000 7fe16638d740 20 client.4646 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.424+0000 7fe16638d740 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] conn(0x55560f3df110 0x55560f3df4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.424+0000 7fe16638d740 4 client.4646 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T11:10:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.424+0000 7fe16638d740 1 -- 172.21.15.151:0/56864719 --> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55560f291700 con 0x55560f3df110 2023-10-18T11:10:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.425+0000 7fe1614c1640 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] conn(0x55560f3df110 0x55560f3df4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.430+0000 7fe1614c1640 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] conn(0x55560f3df110 0x55560f3df4f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2aba4e7a3003cc64 server_cookie=335af2d3e28d6542 in_seq=0 out_seq=0 2023-10-18T11:10:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.430+0000 7fe137fff640 10 client.4646 ms_handle_connect on v2:172.21.15.151:6832/251484638 2023-10-18T11:10:49.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe137fff640 1 -- 172.21.15.151:0/56864719 <== mds.1 v2:172.21.15.151:6832/251484638 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55560f291700 con 0x55560f3df110 2023-10-18T11:10:49.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe137fff640 10 client.4646 handle_command_reply: tid=0 2023-10-18T11:10:49.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe16638d740 1 client.4646 shutdown 2023-10-18T11:10:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe16638d740 1 -- 172.21.15.151:0/56864719 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 msgr2=0x55560f3d59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe16638d740 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f3d59b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe154009380 tx=0x7fe154004a40 comp rx=0 tx=0).stop 2023-10-18T11:10:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe16638d740 1 -- 172.21.15.151:0/56864719 shutdown_connections 2023-10-18T11:10:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe16638d740 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.151:6832/251484638,v1:172.21.15.151:6833/251484638] conn(0x55560f3df110 0x55560f3df4f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe16638d740 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55560f386e80 0x55560f3d59b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe16638d740 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55560f37c800 0x55560f3dc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe16638d740 1 --2- 172.21.15.151:0/56864719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55560f332980 0x55560f32dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe137fff640 0 client.4646 ms_handle_reset on v2:172.21.15.151:6832/251484638 2023-10-18T11:10:49.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.453+0000 7fe16638d740 1 -- 172.21.15.151:0/56864719 >> 172.21.15.151:0/56864719 conn(0x55560f3313e0 msgr2=0x55560f332d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.454+0000 7fe16638d740 1 -- 172.21.15.151:0/56864719 shutdown_connections 2023-10-18T11:10:49.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.454+0000 7fe16638d740 1 -- 172.21.15.151:0/56864719 wait complete. 2023-10-18T11:10:49.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.454+0000 7fe16638d740 20 client.4646 trim_cache size 0 max 16384 2023-10-18T11:10:49.460 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:10:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "31f501b1-61b9-452b-813c-bb68ad49056d", 2023-10-18T11:10:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 1, 2023-10-18T11:10:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4288, 2023-10-18T11:10:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-10-18T11:10:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-10-18T11:10:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-10-18T11:10:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 29.220236153999998, 2023-10-18T11:10:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 18, 2023-10-18T11:10:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 31, 2023-10-18T11:10:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 31, 2023-10-18T11:10:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 79.20383477 2023-10-18T11:10:49.463 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:10:49.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 -- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe14006ae30 msgr2=0x7fe14006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe14006ae30 0x7fe14006d2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0c1520 tx=0x7fe15400b040 comp rx=0 tx=0).stop 2023-10-18T11:10:49.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 -- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe15c1449e0 msgr2=0x7fe15c070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe15c1449e0 0x7fe15c070ee0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0072c0 tx=0x7fe14c007780 comp rx=0 tx=0).stop 2023-10-18T11:10:49.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 -- 172.21.15.151:0/4264753415 shutdown_connections 2023-10-18T11:10:49.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15c1439f0 0x7fe15c143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe15c1449e0 0x7fe15c070ee0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe14006ae30 0x7fe14006d2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 --2- 172.21.15.151:0/4264753415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1480039c0 0x7fe15c1ee330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.455+0000 7fe163725640 1 -- 172.21.15.151:0/4264753415 >> 172.21.15.151:0/4264753415 conn(0x7fe15c069f70 msgr2=0x7fe15c1565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.456+0000 7fe163725640 1 -- 172.21.15.151:0/4264753415 shutdown_connections 2023-10-18T11:10:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.456+0000 7fe163725640 1 -- 172.21.15.151:0/4264753415 wait complete. 2023-10-18T11:10:49.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-10-18T11:10:49.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.685+0000 7f440bb8a640 1 Processor -- start 2023-10-18T11:10:49.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.685+0000 7f440bb8a640 1 -- start start 2023-10-18T11:10:49.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.687+0000 7f440bb8a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4404070790 0x7f44041566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.687+0000 7f440bb8a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4404070ee0 0x7f44040718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.687+0000 7f440bb8a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44040c18e0 con 0x7f440414fe20 2023-10-18T11:10:49.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.687+0000 7f440bb8a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44040c5350 con 0x7f4404070ee0 2023-10-18T11:10:49.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.687+0000 7f440bb8a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44040c20f0 con 0x7f4404070790 2023-10-18T11:10:49.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.688+0000 7f440a127640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4404070ee0 0x7f44040718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.688+0000 7f4409125640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4404070790 0x7f44041566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.688+0000 7f4409125640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4404070790 0x7f44041566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:32800/0 (socket says 172.21.15.151:32800) 2023-10-18T11:10:49.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.688+0000 7f4409125640 1 -- 172.21.15.151:0/3464954485 learned_addr learned my addr 172.21.15.151:0/3464954485 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.691+0000 7f4409125640 1 -- 172.21.15.151:0/3464954485 >> v2:172.21.15.169:3300/0 conn(0x7f4404070ee0 msgr2=0x7f44040718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.691+0000 7f4409125640 1 --2- 172.21.15.151:0/3464954485 >> v2:172.21.15.169:3300/0 conn(0x7f4404070ee0 0x7f44040718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.691+0000 7f4409125640 1 -- 172.21.15.151:0/3464954485 >> v1:172.21.15.151:6789/0 conn(0x7f440414fe20 legacy=0x7f44040c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.691+0000 7f4409125640 1 -- 172.21.15.151:0/3464954485 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44040c1b30 con 0x7f4404070790 2023-10-18T11:10:49.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.693+0000 7f4409125640 1 --2- 172.21.15.151:0/3464954485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4404070790 0x7f44041566f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009870 tx=0x7f43f402db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f05555232365002 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.697+0000 7f4408924640 1 -- 172.21.15.151:0/3464954485 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f402e940 con 0x7f4404070790 2023-10-18T11:10:49.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.697+0000 7f4408924640 1 -- 172.21.15.151:0/3464954485 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f402eaa0 con 0x7f4404070790 2023-10-18T11:10:49.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.697+0000 7f4408924640 1 -- 172.21.15.151:0/3464954485 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f402ee30 con 0x7f4404070790 2023-10-18T11:10:49.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.697+0000 7f440bb8a640 1 -- 172.21.15.151:0/3464954485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4404070790 msgr2=0x7f44041566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.697+0000 7f440bb8a640 1 --2- 172.21.15.151:0/3464954485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4404070790 0x7f44041566f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009870 tx=0x7f43f402db90 comp rx=0 tx=0).stop 2023-10-18T11:10:49.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.698+0000 7f440bb8a640 1 -- 172.21.15.151:0/3464954485 shutdown_connections 2023-10-18T11:10:49.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.698+0000 7f440bb8a640 1 --2- 172.21.15.151:0/3464954485 >> v2:172.21.15.169:3300/0 conn(0x7f4404070ee0 0x7f44040718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.698+0000 7f440bb8a640 1 --2- 172.21.15.151:0/3464954485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4404070790 0x7f44041566f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.698+0000 7f440bb8a640 1 -- 172.21.15.151:0/3464954485 >> 172.21.15.151:0/3464954485 conn(0x7f4404069f70 msgr2=0x7f440406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.698+0000 7f440bb8a640 1 -- 172.21.15.151:0/3464954485 shutdown_connections 2023-10-18T11:10:49.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.698+0000 7f440bb8a640 1 -- 172.21.15.151:0/3464954485 wait complete. 2023-10-18T11:10:49.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.699+0000 7f440bb8a640 1 Processor -- start 2023-10-18T11:10:49.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.700+0000 7f440bb8a640 1 -- start start 2023-10-18T11:10:49.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.700+0000 7f440bb8a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4404070790 0x7f4404151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.701+0000 7f440bb8a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4404070ee0 0x7f44040c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.701+0000 7f440bb8a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f440414fe20 0x7f4404154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.701+0000 7f440bb8a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44040c8ca0 con 0x7f4404070ee0 2023-10-18T11:10:49.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.701+0000 7f440bb8a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4404155670 con 0x7f4404070790 2023-10-18T11:10:49.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.701+0000 7f440bb8a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4404155910 con 0x7f440414fe20 2023-10-18T11:10:49.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.701+0000 7f4409125640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4404070ee0 0x7f44040c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.701+0000 7f440a127640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f440414fe20 0x7f4404154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.702+0000 7f4409926640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4404070790 0x7f4404151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.702+0000 7f4409125640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4404070ee0 0x7f44040c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59300/0 (socket says 172.21.15.151:59300) 2023-10-18T11:10:49.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.702+0000 7f4409125640 1 -- 172.21.15.151:0/1872425201 learned_addr learned my addr 172.21.15.151:0/1872425201 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.705+0000 7f440a127640 1 -- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4404070790 msgr2=0x7f4404151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.705+0000 7f440a127640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4404070790 0x7f4404151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.705+0000 7f440a127640 1 -- 172.21.15.151:0/1872425201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4404070ee0 msgr2=0x7f44040c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.705+0000 7f440a127640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4404070ee0 0x7f44040c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.705+0000 7f440a127640 1 -- 172.21.15.151:0/1872425201 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f40094d0 con 0x7f440414fe20 2023-10-18T11:10:49.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.707+0000 7f440a127640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f440414fe20 0x7f4404154910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00efc0 tx=0x7f43fc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.711+0000 7f43fa7fc640 1 -- 172.21.15.151:0/1872425201 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc009c00 con 0x7f440414fe20 2023-10-18T11:10:49.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.711+0000 7f43fa7fc640 1 -- 172.21.15.151:0/1872425201 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc00f040 con 0x7f440414fe20 2023-10-18T11:10:49.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.711+0000 7f440bb8a640 1 -- 172.21.15.151:0/1872425201 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44040c89c0 con 0x7f440414fe20 2023-10-18T11:10:49.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.711+0000 7f43fa7fc640 1 -- 172.21.15.151:0/1872425201 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0146c0 con 0x7f440414fe20 2023-10-18T11:10:49.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.711+0000 7f440bb8a640 1 -- 172.21.15.151:0/1872425201 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44040bd150 con 0x7f440414fe20 2023-10-18T11:10:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.714+0000 7f440e7f0740 1 Processor -- start 2023-10-18T11:10:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.715+0000 7f440e7f0740 1 -- start start 2023-10-18T11:10:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.715+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 0x55e338e5dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.715+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.715+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5c3e0 0x55e338e9d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.715+0000 7f440e7f0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e338d787a0 con 0x55e338e5d980 2023-10-18T11:10:49.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.715+0000 7f440e7f0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e338dca740 con 0x55e338ea7800 2023-10-18T11:10:49.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.715+0000 7f440e7f0740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e338dc7e30 con 0x55e338e5c3e0 2023-10-18T11:10:49.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.716+0000 7f4409926640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.716+0000 7f4409125640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 0x55e338e5dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.716+0000 7f4409926640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:52542/0 (socket says 172.21.15.151:52542) 2023-10-18T11:10:49.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.716+0000 7f4409926640 1 -- 172.21.15.151:0/4104591675 learned_addr learned my addr 172.21.15.151:0/4104591675 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.719+0000 7f4409926640 1 -- 172.21.15.151:0/4104591675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5c3e0 msgr2=0x55e338e9d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.719+0000 7f4409926640 1 --2- 172.21.15.151:0/4104591675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5c3e0 0x55e338e9d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.719+0000 7f4409926640 1 -- 172.21.15.151:0/4104591675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 msgr2=0x55e338e5dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.719+0000 7f4409926640 1 --2- 172.21.15.151:0/4104591675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 0x55e338e5dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.719+0000 7f4409926640 1 -- 172.21.15.151:0/4104591675 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e338d87910 con 0x55e338ea7800 2023-10-18T11:10:49.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.720+0000 7f4409926640 1 --2- 172.21.15.151:0/4104591675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5e2a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4400001720 tx=0x7f4400007e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb7c98ab7426b194 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.724+0000 7f43e77fe640 1 -- 172.21.15.151:0/4104591675 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44000013d0 con 0x55e338ea7800 2023-10-18T11:10:49.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.724+0000 7f43e77fe640 1 -- 172.21.15.151:0/4104591675 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44000052e0 con 0x55e338ea7800 2023-10-18T11:10:49.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.724+0000 7f43e77fe640 1 -- 172.21.15.151:0/4104591675 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440000f9b0 con 0x55e338ea7800 2023-10-18T11:10:49.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.725+0000 7f440e7f0740 1 -- 172.21.15.151:0/4104591675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 msgr2=0x55e338e5e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.725+0000 7f440e7f0740 1 --2- 172.21.15.151:0/4104591675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5e2a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4400001720 tx=0x7f4400007e30 comp rx=0 tx=0).stop 2023-10-18T11:10:49.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.725+0000 7f440e7f0740 1 -- 172.21.15.151:0/4104591675 shutdown_connections 2023-10-18T11:10:49.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.725+0000 7f440e7f0740 1 --2- 172.21.15.151:0/4104591675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5c3e0 0x55e338e9d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.725+0000 7f440e7f0740 1 --2- 172.21.15.151:0/4104591675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5e2a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.725+0000 7f440e7f0740 1 --2- 172.21.15.151:0/4104591675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 0x55e338e5dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.725+0000 7f440e7f0740 1 -- 172.21.15.151:0/4104591675 >> 172.21.15.151:0/4104591675 conn(0x55e338e5a0f0 msgr2=0x55e338e5ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.725+0000 7f440e7f0740 1 -- 172.21.15.151:0/4104591675 shutdown_connections 2023-10-18T11:10:49.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.725+0000 7f440e7f0740 1 -- 172.21.15.151:0/4104591675 wait complete. 2023-10-18T11:10:49.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.726+0000 7f440e7f0740 1 -- start start 2023-10-18T11:10:49.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.726+0000 7f440e7f0740 1 Processor -- start 2023-10-18T11:10:49.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.727+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 0x55e338eb0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.727+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338ea7800 0x55e338e821e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.727+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338e82720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.727+0000 7f440e7f0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e338dc3720 con 0x55e338ea7800 2023-10-18T11:10:49.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.727+0000 7f440e7f0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e338d61970 con 0x55e338e9b080 2023-10-18T11:10:49.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.727+0000 7f440e7f0740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e338d61610 con 0x55e338e5d980 2023-10-18T11:10:49.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.727+0000 7f440e7f0740 10 client.0 _ll_register_callbacks cb 0x55e338d839d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:49.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.728+0000 7f4409926640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338ea7800 0x55e338e821e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.728+0000 7f4409125640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338e82720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.728+0000 7f4409926640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338ea7800 0x55e338e821e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59318/0 (socket says 172.21.15.151:59318) 2023-10-18T11:10:49.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.728+0000 7f4409926640 1 -- 172.21.15.151:0/1574849141 learned_addr learned my addr 172.21.15.151:0/1574849141 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.731+0000 7f43fa7fc640 1 -- 172.21.15.151:0/1872425201 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f43fc014820 con 0x7f440414fe20 2023-10-18T11:10:49.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.731+0000 7f4409125640 1 -- 172.21.15.151:0/1574849141 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 msgr2=0x55e338eb0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.731+0000 7f4409125640 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 0x55e338eb0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.731+0000 7f4409125640 1 -- 172.21.15.151:0/1574849141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338ea7800 msgr2=0x55e338e821e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.731+0000 7f4409125640 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338ea7800 0x55e338e821e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.731+0000 7f4409125640 1 -- 172.21.15.151:0/1574849141 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44040c18e0 con 0x55e338e9b080 2023-10-18T11:10:49.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.732+0000 7f43fa7fc640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f43e806ae30 0x7f43e806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.732+0000 7f4409926640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f43e806ae30 0x7f43e806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.732+0000 7f43fa7fc640 1 -- 172.21.15.151:0/1872425201 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f43fc059190 con 0x7f440414fe20 2023-10-18T11:10:49.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.733+0000 7f4409926640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f43e806ae30 0x7f43e806d2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4400008fd0 tx=0x7f4400005000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.734+0000 7f4409125640 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338e82720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009870 tx=0x7f43f402e0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6be9e2b960a22d0f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.734+0000 7f43e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2023-10-18T11:10:49.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.738+0000 7f43e4ff9640 1 -- 172.21.15.151:0/1574849141 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4036b10 con 0x55e338e9b080 2023-10-18T11:10:49.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.738+0000 7f43e4ff9640 1 -- 172.21.15.151:0/1574849141 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f43f4036c70 con 0x55e338e9b080 2023-10-18T11:10:49.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.738+0000 7f440e7f0740 1 -- 172.21.15.151:0/1574849141 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e338dea160 con 0x55e338e9b080 2023-10-18T11:10:49.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.740+0000 7f43e4ff9640 1 -- 172.21.15.151:0/1574849141 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43f4036e30 con 0x55e338e9b080 2023-10-18T11:10:49.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.740+0000 7f440e7f0740 10 client.4822 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:49.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.740+0000 7f440e7f0740 1 -- 172.21.15.151:0/1574849141 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e338dc1da0 con 0x55e338e9b080 2023-10-18T11:10:49.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.742+0000 7f43e4ff9640 1 -- 172.21.15.151:0/1574849141 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e338dea160 con 0x55e338e9b080 2023-10-18T11:10:49.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.745+0000 7f43e4ff9640 1 -- 172.21.15.151:0/1574849141 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f43f404f260 con 0x55e338e9b080 2023-10-18T11:10:49.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.745+0000 7f440e7f0740 10 client.4822 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:49.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.745+0000 7f440e7f0740 10 client.4822 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-18T11:10:49.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.745+0000 7f440e7f0740 20 client.4822 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:49.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.745+0000 7f440e7f0740 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x55e338eb1fd0 0x55e338e99070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.745+0000 7f440e7f0740 4 client.4822 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-18T11:10:49.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.745+0000 7f440e7f0740 1 -- 172.21.15.151:0/1574849141 --> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e338d95cc0 con 0x55e338eb1fd0 2023-10-18T11:10:49.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.746+0000 7f4409125640 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x55e338eb1fd0 0x55e338e99070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.754+0000 7f4409125640 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x55e338eb1fd0 0x55e338e99070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c385c57e78be2b1d server_cookie=6f1b05fe71e2b147 in_seq=0 out_seq=0 2023-10-18T11:10:49.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.754+0000 7f43e4ff9640 10 client.4822 ms_handle_connect on v2:172.21.15.151:6836/909327926 2023-10-18T11:10:49.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.781+0000 7f43e4ff9640 1 -- 172.21.15.151:0/1574849141 <== mds.0 v2:172.21.15.151:6836/909327926 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e338d95cc0 con 0x55e338eb1fd0 2023-10-18T11:10:49.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.781+0000 7f43e4ff9640 10 client.4822 handle_command_reply: tid=0 2023-10-18T11:10:49.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f440e7f0740 1 client.4822 shutdown 2023-10-18T11:10:49.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f440e7f0740 1 -- 172.21.15.151:0/1574849141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 msgr2=0x55e338e82720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f440e7f0740 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338e82720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009870 tx=0x7f43f402e0b0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f440e7f0740 1 -- 172.21.15.151:0/1574849141 shutdown_connections 2023-10-18T11:10:49.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f440e7f0740 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x55e338eb1fd0 0x55e338e99070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f440e7f0740 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338e82720 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f440e7f0740 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338ea7800 0x55e338e821e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f440e7f0740 1 --2- 172.21.15.151:0/1574849141 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 0x55e338eb0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f43e4ff9640 0 client.4822 ms_handle_reset on v2:172.21.15.151:6836/909327926 2023-10-18T11:10:49.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.782+0000 7f440e7f0740 1 -- 172.21.15.151:0/1574849141 >> 172.21.15.151:0/1574849141 conn(0x55e338e5c3e0 msgr2=0x55e338e5dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.783+0000 7f440e7f0740 1 -- 172.21.15.151:0/1574849141 shutdown_connections 2023-10-18T11:10:49.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.783+0000 7f440e7f0740 1 -- 172.21.15.151:0/1574849141 wait complete. 2023-10-18T11:10:49.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.783+0000 7f440e7f0740 20 client.4822 trim_cache size 0 max 16384 2023-10-18T11:10:49.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.807+0000 7f440e7f0740 1 Processor -- start 2023-10-18T11:10:49.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.807+0000 7f440e7f0740 1 -- start start 2023-10-18T11:10:49.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.809+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 0x55e338eb0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.809+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e9b080 0x55e338e5b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.809+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.809+0000 7f440e7f0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e338b27f20 con 0x55e338e9b080 2023-10-18T11:10:49.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.809+0000 7f440e7f0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e338e5c1d0 con 0x55e338ea7800 2023-10-18T11:10:49.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.809+0000 7f440e7f0740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e338d82f10 con 0x55e338e5d980 2023-10-18T11:10:49.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.809+0000 7f4409926640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 0x55e338eb0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.809+0000 7f440a127640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.810+0000 7f4409926640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 0x55e338eb0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:32832/0 (socket says 172.21.15.151:32832) 2023-10-18T11:10:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.810+0000 7f4409926640 1 -- 172.21.15.151:0/270504109 learned_addr learned my addr 172.21.15.151:0/270504109 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.810+0000 7f4409125640 1 --2- 172.21.15.151:0/270504109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e9b080 0x55e338e5b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.812+0000 7f4409926640 1 -- 172.21.15.151:0/270504109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 msgr2=0x55e338e5bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.812+0000 7f4409926640 1 --2- 172.21.15.151:0/270504109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.812+0000 7f4409926640 1 -- 172.21.15.151:0/270504109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e9b080 msgr2=0x55e338e5b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.812+0000 7f4409926640 1 --2- 172.21.15.151:0/270504109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e9b080 0x55e338e5b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.812+0000 7f4409926640 1 -- 172.21.15.151:0/270504109 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e338d60b80 con 0x55e338e5d980 2023-10-18T11:10:49.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.812+0000 7f440a127640 1 --2- 172.21.15.151:0/270504109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:10:49.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.814+0000 7f4409926640 1 --2- 172.21.15.151:0/270504109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 0x55e338eb0fd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4400001400 tx=0x7f440000a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d49698c283b71a46 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.817+0000 7f43e7fff640 1 -- 172.21.15.151:0/270504109 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400023070 con 0x55e338e5d980 2023-10-18T11:10:49.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.817+0000 7f43e7fff640 1 -- 172.21.15.151:0/270504109 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400007600 con 0x55e338e5d980 2023-10-18T11:10:49.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.818+0000 7f43e7fff640 1 -- 172.21.15.151:0/270504109 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44000067d0 con 0x55e338e5d980 2023-10-18T11:10:49.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.819+0000 7f440e7f0740 1 -- 172.21.15.151:0/270504109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 msgr2=0x55e338eb0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.819+0000 7f440e7f0740 1 --2- 172.21.15.151:0/270504109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 0x55e338eb0fd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4400001400 tx=0x7f440000a000 comp rx=0 tx=0).stop 2023-10-18T11:10:49.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.819+0000 7f440e7f0740 1 -- 172.21.15.151:0/270504109 shutdown_connections 2023-10-18T11:10:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.819+0000 7f440e7f0740 1 --2- 172.21.15.151:0/270504109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338ea7800 0x55e338e5bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.819+0000 7f440e7f0740 1 --2- 172.21.15.151:0/270504109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e9b080 0x55e338e5b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.819+0000 7f440e7f0740 1 --2- 172.21.15.151:0/270504109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338e5d980 0x55e338eb0fd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.819+0000 7f440e7f0740 1 -- 172.21.15.151:0/270504109 >> 172.21.15.151:0/270504109 conn(0x55e338e5c3e0 msgr2=0x55e338eb0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.819+0000 7f440e7f0740 1 -- 172.21.15.151:0/270504109 shutdown_connections 2023-10-18T11:10:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.819+0000 7f440e7f0740 1 -- 172.21.15.151:0/270504109 wait complete. 2023-10-18T11:10:49.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.820+0000 7f440e7f0740 1 -- start start 2023-10-18T11:10:49.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.820+0000 7f440e7f0740 1 Processor -- start 2023-10-18T11:10:49.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.821+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 0x55e338e5ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.822+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338f09520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.822+0000 7f440e7f0740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338ea7800 0x55e338f09a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.822+0000 7f440e7f0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e338e5d370 con 0x55e338e5d980 2023-10-18T11:10:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.822+0000 7f440e7f0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e338e5be90 con 0x55e338e9b080 2023-10-18T11:10:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.822+0000 7f440e7f0740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e338f13310 con 0x55e338ea7800 2023-10-18T11:10:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.822+0000 7f440e7f0740 10 client.0 _ll_register_callbacks cb 0x7f43f40096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T11:10:49.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.822+0000 7f4409125640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338f09520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.823+0000 7f4409125640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338f09520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:52572/0 (socket says 172.21.15.151:52572) 2023-10-18T11:10:49.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.823+0000 7f4409125640 1 -- 172.21.15.151:0/3989060147 learned_addr learned my addr 172.21.15.151:0/3989060147 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:49.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.824+0000 7f4409926640 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 0x55e338e5ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.824+0000 7f440a127640 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338ea7800 0x55e338f09a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.826+0000 7f4409125640 1 -- 172.21.15.151:0/3989060147 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338ea7800 msgr2=0x55e338f09a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.826+0000 7f4409125640 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338ea7800 0x55e338f09a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.826+0000 7f4409125640 1 -- 172.21.15.151:0/3989060147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 msgr2=0x55e338e5ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:10:49.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.826+0000 7f4409125640 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 0x55e338e5ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.826+0000 7f4409125640 1 -- 172.21.15.151:0/3989060147 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44040bd150 con 0x55e338e9b080 2023-10-18T11:10:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.829+0000 7f4409125640 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338f09520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f43f40090b0 tx=0x7f43f4043040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e9aec2e7fc013a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.829+0000 7f43e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2023-10-18T11:10:49.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.833+0000 7f43e4ff9640 1 -- 172.21.15.151:0/3989060147 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f404fab0 con 0x55e338e9b080 2023-10-18T11:10:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.833+0000 7f43e4ff9640 1 -- 172.21.15.151:0/3989060147 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f43f4000e40 con 0x55e338e9b080 2023-10-18T11:10:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.833+0000 7f440e7f0740 1 -- 172.21.15.151:0/3989060147 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44000052e0 con 0x55e338e9b080 2023-10-18T11:10:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.835+0000 7f43e4ff9640 1 -- 172.21.15.151:0/3989060147 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43f402e290 con 0x55e338e9b080 2023-10-18T11:10:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.835+0000 7f440e7f0740 10 client.4828 fetch_fsmap learned FSMap version 18 2023-10-18T11:10:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.835+0000 7f440e7f0740 1 -- 172.21.15.151:0/3989060147 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e338d87910 con 0x55e338e9b080 2023-10-18T11:10:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.837+0000 7f43e4ff9640 1 -- 172.21.15.151:0/3989060147 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f4061030 con 0x55e338e9b080 2023-10-18T11:10:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.840+0000 7f43e4ff9640 1 -- 172.21.15.151:0/3989060147 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f43f4036440 con 0x55e338e9b080 2023-10-18T11:10:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.840+0000 7f440e7f0740 10 client.4828 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T11:10:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.840+0000 7f440e7f0740 10 client.4828 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-18T11:10:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.840+0000 7f440e7f0740 20 client.4828 populate_metadata read hostname 'smithi151' 2023-10-18T11:10:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.840+0000 7f440e7f0740 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x55e338f0f700 0x55e338f0fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.840+0000 7f440e7f0740 4 client.4828 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-18T11:10:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.840+0000 7f440e7f0740 1 -- 172.21.15.151:0/3989060147 --> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e338dbc700 con 0x55e338f0f700 2023-10-18T11:10:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.841+0000 7f4409926640 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x55e338f0f700 0x55e338f0fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.846+0000 7f43e4ff9640 10 client.4828 ms_handle_connect on v2:172.21.15.151:6836/909327926 2023-10-18T11:10:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.846+0000 7f4409926640 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x55e338f0f700 0x55e338f0fae0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98c0c12eca981f0 server_cookie=949b760102550344 in_seq=0 out_seq=0 2023-10-18T11:10:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f43e4ff9640 1 -- 172.21.15.151:0/3989060147 <== mds.0 v2:172.21.15.151:6836/909327926 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e338dbc700 con 0x55e338f0f700 2023-10-18T11:10:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f43e4ff9640 10 client.4828 handle_command_reply: tid=0 2023-10-18T11:10:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f440e7f0740 1 client.4828 shutdown 2023-10-18T11:10:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f440e7f0740 1 -- 172.21.15.151:0/3989060147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 msgr2=0x55e338f09520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f440e7f0740 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338f09520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f43f40090b0 tx=0x7f43f4043040 comp rx=0 tx=0).stop 2023-10-18T11:10:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f440e7f0740 1 -- 172.21.15.151:0/3989060147 shutdown_connections 2023-10-18T11:10:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f440e7f0740 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.151:6836/909327926,v1:172.21.15.151:6837/909327926] conn(0x55e338f0f700 0x55e338f0fae0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f440e7f0740 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55e338ea7800 0x55e338f09a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f43e4ff9640 0 client.4828 ms_handle_reset on v2:172.21.15.151:6836/909327926 2023-10-18T11:10:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f440e7f0740 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e338e9b080 0x55e338f09520 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f440e7f0740 1 --2- 172.21.15.151:0/3989060147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e338e5d980 0x55e338e5ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.852+0000 7f440e7f0740 1 -- 172.21.15.151:0/3989060147 >> 172.21.15.151:0/3989060147 conn(0x55e338e5c3e0 msgr2=0x55e338e5dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.853+0000 7f440e7f0740 1 -- 172.21.15.151:0/3989060147 shutdown_connections 2023-10-18T11:10:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.853+0000 7f440e7f0740 1 -- 172.21.15.151:0/3989060147 wait complete. 2023-10-18T11:10:49.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.853+0000 7f440e7f0740 20 client.4828 trim_cache size 0 max 16384 2023-10-18T11:10:49.858 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:10:49.858 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "31f501b1-61b9-452b-813c-bb68ad49056d", 2023-10-18T11:10:49.859 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 0, 2023-10-18T11:10:49.859 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4294, 2023-10-18T11:10:49.859 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-10-18T11:10:49.859 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-10-18T11:10:49.859 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-10-18T11:10:49.860 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 69.777296360999998, 2023-10-18T11:10:49.860 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 18, 2023-10-18T11:10:49.860 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 31, 2023-10-18T11:10:49.860 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 31, 2023-10-18T11:10:49.860 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 79.383083251000002 2023-10-18T11:10:49.861 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:10:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.854+0000 7f440bb8a640 1 -- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f43e806ae30 msgr2=0x7f43e806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.854+0000 7f440bb8a640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f43e806ae30 0x7f43e806d2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4400008fd0 tx=0x7f4400005000 comp rx=0 tx=0).stop 2023-10-18T11:10:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.854+0000 7f440bb8a640 1 -- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f440414fe20 msgr2=0x7f4404154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.854+0000 7f440bb8a640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f440414fe20 0x7f4404154910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00efc0 tx=0x7f43fc00c490 comp rx=0 tx=0).stop 2023-10-18T11:10:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.855+0000 7f440bb8a640 1 -- 172.21.15.151:0/1872425201 shutdown_connections 2023-10-18T11:10:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.855+0000 7f440bb8a640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f440414fe20 0x7f4404154910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.855+0000 7f440bb8a640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4404070ee0 0x7f44040c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.855+0000 7f440bb8a640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f43e806ae30 0x7f43e806d2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.855+0000 7f440bb8a640 1 --2- 172.21.15.151:0/1872425201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4404070790 0x7f4404151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.855+0000 7f440bb8a640 1 -- 172.21.15.151:0/1872425201 >> 172.21.15.151:0/1872425201 conn(0x7f4404069f70 msgr2=0x7f440406d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.855+0000 7f440bb8a640 1 -- 172.21.15.151:0/1872425201 shutdown_connections 2023-10-18T11:10:49.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:49.855+0000 7f440bb8a640 1 -- 172.21.15.151:0/1872425201 wait complete. 2023-10-18T11:10:49.880 INFO:teuthology.run_tasks:Running task kclient... 2023-10-18T11:10:49.917 INFO:tasks.kclient:Mounting kernel clients... 2023-10-18T11:10:49.918 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-18T11:10:49.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:49.918 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-18T11:10:49.977 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-18T11:10:49.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:49.979 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T11:10:50.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:50.071 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-10-18T11:10:50.200 INFO:tasks.kclient:client.0 config is {} 2023-10-18T11:10:50.200 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-18T11:10:50.200 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T11:10:50.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T11:10:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.396+0000 7f028eabb640 1 Processor -- start 2023-10-18T11:10:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.396+0000 7f028eabb640 1 -- start start 2023-10-18T11:10:50.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.397+0000 7f028eabb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f028815f630 0x7f0288161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:50.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.398+0000 7f028eabb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0288070d00 con 0x7f02880c5560 2023-10-18T11:10:50.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.398+0000 7f028eabb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02881503c0 con 0x7f028814ffe0 2023-10-18T11:10:50.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.398+0000 7f028eabb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028806ac30 con 0x7f028815f630 2023-10-18T11:10:50.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.398+0000 7f028c857640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f028814ffe0 0x7f02880c3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47196/0 (socket says 172.21.15.151:47196) 2023-10-18T11:10:50.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.398+0000 7f028c857640 1 -- 172.21.15.151:0/3941113893 learned_addr learned my addr 172.21.15.151:0/3941113893 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:10:50.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.450+0000 7f028d058640 1 --2- 172.21.15.151:0/3941113893 >> v2:172.21.15.151:3300/0 conn(0x7f028815f630 0x7f0288161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:50.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.460+0000 7f028d058640 1 -- 172.21.15.151:0/3941113893 >> v1:172.21.15.169:6789/0 conn(0x7f028814ffe0 legacy=0x7f02880c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:50.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.460+0000 7f028d058640 1 -- 172.21.15.151:0/3941113893 >> v1:172.21.15.151:6789/0 conn(0x7f02880c5560 legacy=0x7f02880c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:50.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.460+0000 7f028d058640 1 -- 172.21.15.151:0/3941113893 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0288156b50 con 0x7f028815f630 2023-10-18T11:10:50.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.466+0000 7f028d058640 1 --2- 172.21.15.151:0/3941113893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f028815f630 0x7f0288161a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0280009d90 tx=0x7f028002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6273f8a7cdc54426 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:50.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.477+0000 7f02877fe640 1 -- 172.21.15.151:0/3941113893 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028002cd80 con 0x7f028815f630 2023-10-18T11:10:50.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.477+0000 7f02877fe640 1 -- 172.21.15.151:0/3941113893 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0280034440 con 0x7f028815f630 2023-10-18T11:10:50.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.477+0000 7f02877fe640 1 -- 172.21.15.151:0/3941113893 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02800347d0 con 0x7f028815f630 2023-10-18T11:10:50.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.479+0000 7f028eabb640 1 -- 172.21.15.151:0/3941113893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f028815f630 msgr2=0x7f0288161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:50.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.479+0000 7f028eabb640 1 --2- 172.21.15.151:0/3941113893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f028815f630 0x7f0288161a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0280009d90 tx=0x7f028002bfd0 comp rx=0 tx=0).stop 2023-10-18T11:10:50.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.479+0000 7f028eabb640 1 -- 172.21.15.151:0/3941113893 shutdown_connections 2023-10-18T11:10:50.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.479+0000 7f028eabb640 1 --2- 172.21.15.151:0/3941113893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f028815f630 0x7f0288161a20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:50.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.479+0000 7f028eabb640 1 -- 172.21.15.151:0/3941113893 >> 172.21.15.151:0/3941113893 conn(0x7f028806c1b0 msgr2=0x7f0288069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:50.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.479+0000 7f028eabb640 1 -- 172.21.15.151:0/3941113893 shutdown_connections 2023-10-18T11:10:50.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.479+0000 7f028eabb640 1 -- 172.21.15.151:0/3941113893 wait complete. 2023-10-18T11:10:50.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.483+0000 7f028eabb640 1 Processor -- start 2023-10-18T11:10:50.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.483+0000 7f028eabb640 1 -- start start 2023-10-18T11:10:50.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.484+0000 7f028eabb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02880c5560 0x7f028813d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:50.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.484+0000 7f028eabb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f028814ffe0 0x7f0288145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:50.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.484+0000 7f028eabb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f028815f630 0x7f0288145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:50.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.484+0000 7f028eabb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02880caf70 con 0x7f028814ffe0 2023-10-18T11:10:50.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.484+0000 7f028eabb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0288144290 con 0x7f028815f630 2023-10-18T11:10:50.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.484+0000 7f028eabb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880cb230 con 0x7f02880c5560 2023-10-18T11:10:50.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.485+0000 7f0287fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f028814ffe0 0x7f0288145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:50.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.486+0000 7f028c857640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02880c5560 0x7f028813d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:50.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.486+0000 7f028c857640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02880c5560 0x7f028813d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:32848/0 (socket says 172.21.15.151:32848) 2023-10-18T11:10:50.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.486+0000 7f028c857640 1 -- 172.21.15.151:0/1895678585 learned_addr learned my addr 172.21.15.151:0/1895678585 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:10:50.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.489+0000 7f028d058640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f028815f630 0x7f0288145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:50.492 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.490+0000 7f028c857640 1 -- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f028815f630 msgr2=0x7f0288145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:50.492 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.490+0000 7f028c857640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f028815f630 0x7f0288145d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:50.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.490+0000 7f028c857640 1 -- 172.21.15.151:0/1895678585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f028814ffe0 msgr2=0x7f0288145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:50.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.490+0000 7f028c857640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f028814ffe0 0x7f0288145830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:50.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.490+0000 7f028c857640 1 -- 172.21.15.151:0/1895678585 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280009a70 con 0x7f02880c5560 2023-10-18T11:10:50.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.492+0000 7f028c857640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02880c5560 0x7f028813d0e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c4a0 tx=0x7f027c00c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:50.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.496+0000 7f02857fa640 1 -- 172.21.15.151:0/1895678585 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c005ce0 con 0x7f02880c5560 2023-10-18T11:10:50.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.496+0000 7f02857fa640 1 -- 172.21.15.151:0/1895678585 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c005e40 con 0x7f02880c5560 2023-10-18T11:10:50.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.496+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02880c8d90 con 0x7f02880c5560 2023-10-18T11:10:50.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.496+0000 7f02857fa640 1 -- 172.21.15.151:0/1895678585 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c007270 con 0x7f02880c5560 2023-10-18T11:10:50.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.496+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02880c9350 con 0x7f02880c5560 2023-10-18T11:10:50.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.498+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0288155800 con 0x7f02880c5560 2023-10-18T11:10:50.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.517+0000 7f02857fa640 1 -- 172.21.15.151:0/1895678585 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f027c007490 con 0x7f02880c5560 2023-10-18T11:10:50.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.518+0000 7f02857fa640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f026c06aec0 0x7f026c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:10:50.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.518+0000 7f0287fff640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f026c06aec0 0x7f026c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:10:50.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.518+0000 7f02857fa640 1 -- 172.21.15.151:0/1895678585 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f027c057dc0 con 0x7f02880c5560 2023-10-18T11:10:50.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.519+0000 7f0287fff640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f026c06aec0 0x7f026c06d380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f028806e340 tx=0x7f0274009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:10:50.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:50.773+0000 7f02857fa640 1 -- 172.21.15.151:0/1895678585 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f027c054100 con 0x7f02880c5560 2023-10-18T11:10:51.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.028+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f02880cb370 con 0x7f02880c5560 2023-10-18T11:10:51.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.033+0000 7f02857fa640 1 -- 172.21.15.151:0/1895678585 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+88 (secure 0 0 0) 0x7f027c057720 con 0x7f02880c5560 2023-10-18T11:10:51.035 INFO:teuthology.orchestra.run.smithi151.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-18T11:10:51.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f026c06aec0 msgr2=0x7f026c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:51.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f026c06aec0 0x7f026c06d380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f028806e340 tx=0x7f0274009040 comp rx=0 tx=0).stop 2023-10-18T11:10:51.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02880c5560 msgr2=0x7f028813d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:10:51.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02880c5560 0x7f028813d0e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c4a0 tx=0x7f027c00c960 comp rx=0 tx=0).stop 2023-10-18T11:10:51.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 shutdown_connections 2023-10-18T11:10:51.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f026c06aec0 0x7f026c06d380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:51.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f028815f630 0x7f0288145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:51.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f028814ffe0 0x7f0288145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:51.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 --2- 172.21.15.151:0/1895678585 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02880c5560 0x7f028813d0e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:10:51.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 >> 172.21.15.151:0/1895678585 conn(0x7f028806c1b0 msgr2=0x7f02880c4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:10:51.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 shutdown_connections 2023-10-18T11:10:51.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:10:51.036+0000 7f028eabb640 1 -- 172.21.15.151:0/1895678585 wait complete. 2023-10-18T11:10:51.057 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T11:10:51.057 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T11:10:51.058 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-10-18T11:10:51.058 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-18T11:10:51.058 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T11:10:51.058 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T11:10:51.059 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T11:10:51.059 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T11:10:51.059 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T11:10:51.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:51.060 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-10-18T11:10:51.108 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T11:10:51.108 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T11:10:51.109 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T11:10:51.109 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-18T11:10:51.109 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-18T11:10:51.109 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-18T11:10:51.109 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T11:10:51.110 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-18T11:10:51.110 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-10-18T11:10:51.110 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T11:10:51.110 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-18T11:10:51.111 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-10-18T11:10:51.111 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T11:10:51.111 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-10-18T11:10:51.111 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T11:10:51.111 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-10-18T11:10:51.111 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-18T11:10:51.112 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 41770sec preferred_lft 41770sec 2023-10-18T11:10:51.112 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-10-18T11:10:51.112 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-18T11:10:51.114 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T11:10:51.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:51.114 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:10:51.115 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:10:51.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-10-18T11:10:51.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-10-18T11:10:51.116 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-10-18T11:10:51.116 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T11:10:51.116 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:10:51.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:51.337 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T11:10:51.414 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-10-18T11:10:51.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:51.420 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-10-18T11:10:51.474 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-10-18T11:10:51.474 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T11:10:51.474 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T11:10:51.475 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-18T11:10:51.475 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T11:10:51.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:51.476 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:10:51.476 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:10:51.476 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T11:10:51.477 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T11:10:51.477 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T11:10:51.477 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:10:51.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:51.654 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-18T11:10:51.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:51.707 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-10-18T11:10:51.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:51.756 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:10:51.757 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:10:51.757 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T11:10:51.757 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-18T11:10:51.758 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:10:51.892 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-18T11:10:51.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:51.893 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:10:51.893 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:10:51.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-18T11:10:51.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T11:10:51.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-18T11:10:51.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-18T11:10:51.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-18T11:10:51.895 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:10:52.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:52.143 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-18T11:10:52.143 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-18T11:10:52.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-10-18T11:10:52.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T11:10:52.144 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-18T11:10:52.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T11:10:52.309 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-18T11:10:52.357 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-18T11:10:52.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T11:10:52.358 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-18T11:10:52.406 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-18T11:10:52.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:52.407 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-18T11:10:52.530 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-18T11:10:52.531 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-18T11:10:53.280 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-18T11:10:53.281 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-18T11:10:53.281 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.151:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-10-18T11:10:53.281 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with new device syntax: 0@31f501b1-61b9-452b-813c-bb68ad49056d.cephfs=/ 2023-10-18T11:10:53.281 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.151:3300/172.21.15.169:3300/172.21.15.169:3301" will pass to kernel 2023-10-18T11:10:53.285 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-10-18T11:10:53.286 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-10-18T11:10:53.286 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-10-18T11:10:53.286 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-10-18T11:10:53.286 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-10-18T11:10:53.290 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T11:10:53.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:53.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-18T11:10:53.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:53.392 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T11:10:53.468 INFO:teuthology.orchestra.run.smithi151.stdout:client4834 2023-10-18T11:10:53.468 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:10:53.469 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T11:10:53.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:53.524 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T11:10:53.589 INFO:teuthology.orchestra.run.smithi151.stdout:client4834 2023-10-18T11:10:53.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:53.590 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T11:10:53.658 INFO:teuthology.orchestra.run.smithi151.stdout:client4834 2023-10-18T11:10:53.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:10:53.659 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/31f501b1-61b9-452b-813c-bb68ad49056d.client4834/status') 2023-10-18T11:10:53.756 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4834 (3)172.21.15.151:0/2472881732 2023-10-18T11:10:53.756 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2023-10-18T11:10:53.757 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2023-10-18T11:10:53.757 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2023-10-18T11:10:53.757 INFO:teuthology.orchestra.run.smithi151.stderr:71 bytes copied, 0.000105465 s, 673 kB/s 2023-10-18T11:10:53.760 INFO:teuthology.run_tasks:Running task workunit... 2023-10-18T11:10:53.793 INFO:tasks.workunit:Pulling workunits from ref 189714d033726ae2ce7d2d105c75781f0aec48f4 2023-10-18T11:10:53.794 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-18T11:10:53.794 INFO:tasks.workunit:timeout=3h 2023-10-18T11:10:53.795 INFO:tasks.workunit:cleanup=True 2023-10-18T11:10:53.795 DEBUG:teuthology.orchestra.run.smithi151:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-18T11:10:53.853 INFO:teuthology.orchestra.run.smithi151.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-18T11:10:53.854 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-18T11:10:53.854 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 27h/39d Inode: 1 Links: 2 2023-10-18T11:10:53.854 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T11:10:53.854 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:unlabeled_t:s0 2023-10-18T11:10:53.855 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-10-18T11:10:53.855 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-18 11:09:40.435092928 +0000 2023-10-18T11:10:53.855 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-18 11:09:59.331119775 +0000 2023-10-18T11:10:53.855 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-18 11:09:40.435092928 +0000 2023-10-18T11:10:53.856 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-18T11:10:53.856 DEBUG:teuthology.orchestra.run.smithi151:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-18T11:10:54.846 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 189714d033726ae2ce7d2d105c75781f0aec48f4 2023-10-18T11:10:54.907 INFO:tasks.workunit.client.0.smithi151.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-18T11:11:02.653 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:11:02.663 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:11:32.815 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:11:32.824 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:12:02.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:12:02.953 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:12:04.690 INFO:tasks.workunit.client.0.smithi151.stderr:Updating files: 62% (7555/12063) Updating files: 63% (7600/12063) Updating files: 64% (7721/12063) Updating files: 65% (7841/12063) Updating files: 66% (7962/12063) Updating files: 67% (8083/12063) Updating files: 68% (8203/12063) Updating files: 69% (8324/12063) Updating files: 70% (8445/12063) Updating files: 71% (8565/12063) Updating files: 72% (8686/12063) Updating files: 73% (8806/12063) Updating files: 74% (8927/12063) Updating files: 75% (9048/12063) Updating files: 76% (9168/12063) Updating files: 77% (9289/12063) Updating files: 78% (9410/12063) Updating files: 79% (9530/12063) Updating files: 80% (9651/12063) Updating files: 81% (9772/12063) Updating files: 82% (9892/12063) Updating files: 83% (10013/12063) Updating files: 84% (10133/12063) Updating files: 85% (10254/12063) Updating files: 86% (10375/12063) Updating files: 87% (10495/12063) Updating files: 88% (10616/12063) Updating files: 89% (10737/12063) Updating files: 90% (10857/12063) Updating files: 91% (10978/12063) Updating files: 92% (11098/12063) Updating files: 93% (11219/12063) Updating files: 94% (11340/12063) Updating files: 95% (11460/12063) Updating files: 96% (11581/12063) Updating files: 97% (11702/12063) Updating files: 98% (11822/12063) Updating files: 99% (11943/12063) Updating files: 100% (12063/12063) Updating files: 100% (12063/12063), done. 2023-10-18T11:12:05.252 INFO:tasks.workunit.client.0.smithi151.stderr:Note: switching to '189714d033726ae2ce7d2d105c75781f0aec48f4'. 2023-10-18T11:12:05.252 INFO:tasks.workunit.client.0.smithi151.stderr: 2023-10-18T11:12:05.253 INFO:tasks.workunit.client.0.smithi151.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-18T11:12:05.253 INFO:tasks.workunit.client.0.smithi151.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-18T11:12:05.253 INFO:tasks.workunit.client.0.smithi151.stderr:state without impacting any branches by switching back to a branch. 2023-10-18T11:12:05.253 INFO:tasks.workunit.client.0.smithi151.stderr: 2023-10-18T11:12:05.253 INFO:tasks.workunit.client.0.smithi151.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-18T11:12:05.253 INFO:tasks.workunit.client.0.smithi151.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-18T11:12:05.254 INFO:tasks.workunit.client.0.smithi151.stderr: 2023-10-18T11:12:05.254 INFO:tasks.workunit.client.0.smithi151.stderr: git switch -c 2023-10-18T11:12:05.254 INFO:tasks.workunit.client.0.smithi151.stderr: 2023-10-18T11:12:05.254 INFO:tasks.workunit.client.0.smithi151.stderr:Or undo this operation with: 2023-10-18T11:12:05.255 INFO:tasks.workunit.client.0.smithi151.stderr: 2023-10-18T11:12:05.255 INFO:tasks.workunit.client.0.smithi151.stderr: git switch - 2023-10-18T11:12:05.255 INFO:tasks.workunit.client.0.smithi151.stderr: 2023-10-18T11:12:05.255 INFO:tasks.workunit.client.0.smithi151.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-18T11:12:05.255 INFO:tasks.workunit.client.0.smithi151.stderr: 2023-10-18T11:12:05.255 INFO:tasks.workunit.client.0.smithi151.stderr:HEAD is now at 189714d0337 qa: test nfs export apply -i failure returns pseudo path in output JSON 2023-10-18T11:12:05.257 DEBUG:teuthology.orchestra.run.smithi151:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-18T11:12:05.315 INFO:tasks.workunit.client.0.smithi151.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-18T11:12:05.323 INFO:tasks.workunit.client.0.smithi151.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-18T11:12:05.323 INFO:tasks.workunit.client.0.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-18T11:12:06.074 INFO:tasks.workunit.client.0.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-18T11:12:06.403 INFO:tasks.workunit.client.0.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-18T11:12:06.403 INFO:tasks.workunit.client.0.smithi151.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-18T11:12:06.403 INFO:tasks.workunit.client.0.smithi151.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-18T11:12:06.403 INFO:tasks.workunit.client.0.smithi151.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-18T11:12:06.404 INFO:tasks.workunit.client.0.smithi151.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-18T11:12:06.404 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:12:06.404 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-18T11:12:06.457 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-10-18T11:12:06.458 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-10-18T11:12:06.459 DEBUG:teuthology.orchestra.run.smithi151:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=189714d033726ae2ce7d2d105c75781f0aec48f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-10-18T11:12:06.761 INFO:tasks.workunit.client.0.smithi151.stderr:+ dbench 1 2023-10-18T11:12:06.782 INFO:tasks.workunit.client.0.smithi151.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-10-18T11:12:06.782 INFO:tasks.workunit.client.0.smithi151.stdout: 2023-10-18T11:12:06.782 INFO:tasks.workunit.client.0.smithi151.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-10-18T11:12:06.786 INFO:tasks.workunit.client.0.smithi151.stdout:0 of 1 processes prepared for launch 0 sec 2023-10-18T11:12:06.886 INFO:tasks.workunit.client.0.smithi151.stdout:1 of 1 processes prepared for launch 0 sec 2023-10-18T11:12:06.886 INFO:tasks.workunit.client.0.smithi151.stdout:releasing clients 2023-10-18T11:12:07.886 INFO:tasks.workunit.client.0.smithi151.stdout: 1 51 2.10 MB/sec warmup 1 sec latency 240.736 ms 2023-10-18T11:12:08.887 INFO:tasks.workunit.client.0.smithi151.stdout: 1 129 2.88 MB/sec warmup 2 sec latency 271.870 ms 2023-10-18T11:12:09.887 INFO:tasks.workunit.client.0.smithi151.stdout: 1 165 2.27 MB/sec warmup 3 sec latency 275.072 ms 2023-10-18T11:12:10.887 INFO:tasks.workunit.client.0.smithi151.stdout: 1 207 2.03 MB/sec warmup 4 sec latency 269.379 ms 2023-10-18T11:12:11.887 INFO:tasks.workunit.client.0.smithi151.stdout: 1 231 1.78 MB/sec warmup 5 sec latency 281.125 ms 2023-10-18T11:12:12.887 INFO:tasks.workunit.client.0.smithi151.stdout: 1 255 1.61 MB/sec warmup 6 sec latency 479.012 ms 2023-10-18T11:12:13.887 INFO:tasks.workunit.client.0.smithi151.stdout: 1 279 1.49 MB/sec warmup 7 sec latency 621.079 ms 2023-10-18T11:12:14.887 INFO:tasks.workunit.client.0.smithi151.stdout: 1 313 1.44 MB/sec warmup 8 sec latency 303.979 ms 2023-10-18T11:12:15.887 INFO:tasks.workunit.client.0.smithi151.stdout: 1 349 1.39 MB/sec warmup 9 sec latency 224.463 ms 2023-10-18T11:12:16.888 INFO:tasks.workunit.client.0.smithi151.stdout: 1 365 1.30 MB/sec warmup 10 sec latency 699.166 ms 2023-10-18T11:12:17.888 INFO:tasks.workunit.client.0.smithi151.stdout: 1 397 1.28 MB/sec warmup 11 sec latency 706.147 ms 2023-10-18T11:12:18.888 INFO:tasks.workunit.client.0.smithi151.stdout: 1 429 1.26 MB/sec warmup 12 sec latency 314.369 ms 2023-10-18T11:12:19.888 INFO:tasks.workunit.client.0.smithi151.stdout: 1 453 1.22 MB/sec warmup 13 sec latency 323.205 ms 2023-10-18T11:12:20.888 INFO:tasks.workunit.client.0.smithi151.stdout: 1 477 1.19 MB/sec warmup 14 sec latency 323.430 ms 2023-10-18T11:12:21.888 INFO:tasks.workunit.client.0.smithi151.stdout: 1 511 1.18 MB/sec warmup 15 sec latency 323.918 ms 2023-10-18T11:12:22.888 INFO:tasks.workunit.client.0.smithi151.stdout: 1 654 1.32 MB/sec warmup 16 sec latency 306.175 ms 2023-10-18T11:12:23.888 INFO:tasks.workunit.client.0.smithi151.stdout: 1 710 1.25 MB/sec warmup 17 sec latency 280.933 ms 2023-10-18T11:12:24.889 INFO:tasks.workunit.client.0.smithi151.stdout: 1 769 1.19 MB/sec warmup 18 sec latency 331.658 ms 2023-10-18T11:12:25.889 INFO:tasks.workunit.client.0.smithi151.stdout: 1 796 1.13 MB/sec warmup 19 sec latency 346.488 ms 2023-10-18T11:12:26.889 INFO:tasks.workunit.client.0.smithi151.stdout: 1 815 1.07 MB/sec warmup 20 sec latency 717.054 ms 2023-10-18T11:12:27.026 INFO:tasks.ceph.mds.e.smithi151.stderr:2023-10-18T11:12:27.012+0000 cdae640 -1 mds.0.bal find_exports balancer runs too long 2023-10-18T11:12:27.027 INFO:tasks.ceph.mds.e.smithi151.stderr:2023-10-18T11:12:27.013+0000 cdae640 -1 mds.0.bal find_exports balancer runs too long 2023-10-18T11:12:27.030 INFO:tasks.ceph.mds.e.smithi151.stderr:2023-10-18T11:12:27.013+0000 cdae640 -1 mds.0.bal find_exports balancer runs too long 2023-10-18T11:12:27.889 INFO:tasks.workunit.client.0.smithi151.stdout: 1 873 1.03 MB/sec warmup 21 sec latency 730.876 ms 2023-10-18T11:12:28.889 INFO:tasks.workunit.client.0.smithi151.stdout: 1 904 0.99 MB/sec warmup 22 sec latency 371.021 ms 2023-10-18T11:12:29.889 INFO:tasks.workunit.client.0.smithi151.stdout: 1 969 0.95 MB/sec warmup 23 sec latency 246.551 ms 2023-10-18T11:12:30.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1041 0.95 MB/sec warmup 24 sec latency 268.143 ms 2023-10-18T11:12:31.890 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1064 0.92 MB/sec warmup 25 sec latency 307.892 ms 2023-10-18T11:12:32.890 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1128 0.88 MB/sec warmup 26 sec latency 407.208 ms 2023-10-18T11:12:33.105 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:12:33.115 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:12:33.890 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1172 0.85 MB/sec warmup 27 sec latency 334.133 ms 2023-10-18T11:12:34.890 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1172 0.82 MB/sec warmup 28 sec latency 1334.239 ms 2023-10-18T11:12:35.890 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1176 0.79 MB/sec warmup 29 sec latency 1363.957 ms 2023-10-18T11:12:36.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1181 0.77 MB/sec warmup 30 sec latency 712.058 ms 2023-10-18T11:12:37.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1215 0.74 MB/sec warmup 31 sec latency 477.725 ms 2023-10-18T11:12:38.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1279 0.72 MB/sec warmup 32 sec latency 247.599 ms 2023-10-18T11:12:39.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1418 0.79 MB/sec warmup 33 sec latency 411.599 ms 2023-10-18T11:12:40.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1446 0.77 MB/sec warmup 34 sec latency 288.591 ms 2023-10-18T11:12:41.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1512 0.74 MB/sec warmup 35 sec latency 323.952 ms 2023-10-18T11:12:42.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1552 0.72 MB/sec warmup 36 sec latency 360.570 ms 2023-10-18T11:12:43.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1603 0.71 MB/sec warmup 37 sec latency 425.387 ms 2023-10-18T11:12:44.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1653 0.69 MB/sec warmup 38 sec latency 431.298 ms 2023-10-18T11:12:45.891 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1689 0.67 MB/sec warmup 39 sec latency 402.358 ms 2023-10-18T11:12:46.892 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1770 0.66 MB/sec warmup 40 sec latency 238.131 ms 2023-10-18T11:12:47.892 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1820 0.64 MB/sec warmup 41 sec latency 662.076 ms 2023-10-18T11:12:48.892 INFO:tasks.workunit.client.0.smithi151.stdout: 1 1888 0.63 MB/sec warmup 42 sec latency 651.820 ms 2023-10-18T11:12:49.892 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2088 0.62 MB/sec warmup 43 sec latency 260.576 ms 2023-10-18T11:12:50.892 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2202 0.61 MB/sec warmup 44 sec latency 197.635 ms 2023-10-18T11:12:51.892 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2294 0.62 MB/sec warmup 45 sec latency 496.806 ms 2023-10-18T11:12:52.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2334 0.60 MB/sec warmup 46 sec latency 659.583 ms 2023-10-18T11:12:53.892 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2347 0.59 MB/sec warmup 47 sec latency 684.896 ms 2023-10-18T11:12:54.893 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2353 0.58 MB/sec warmup 48 sec latency 989.966 ms 2023-10-18T11:12:55.893 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2367 0.57 MB/sec warmup 49 sec latency 1131.122 ms 2023-10-18T11:12:56.893 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2388 0.56 MB/sec warmup 50 sec latency 718.242 ms 2023-10-18T11:12:57.893 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2400 0.55 MB/sec warmup 51 sec latency 904.851 ms 2023-10-18T11:12:58.893 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2428 0.54 MB/sec warmup 52 sec latency 287.067 ms 2023-10-18T11:12:59.893 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2439 0.53 MB/sec warmup 53 sec latency 539.142 ms 2023-10-18T11:13:00.893 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2447 0.52 MB/sec warmup 54 sec latency 372.189 ms 2023-10-18T11:13:01.893 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2466 0.52 MB/sec warmup 55 sec latency 458.864 ms 2023-10-18T11:13:02.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2489 0.51 MB/sec warmup 56 sec latency 448.525 ms 2023-10-18T11:13:03.578 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:13:03.592 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:13:03.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2559 0.51 MB/sec warmup 57 sec latency 573.882 ms 2023-10-18T11:13:04.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2582 0.50 MB/sec warmup 58 sec latency 292.331 ms 2023-10-18T11:13:05.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2597 0.49 MB/sec warmup 59 sec latency 634.677 ms 2023-10-18T11:13:06.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2608 0.48 MB/sec warmup 60 sec latency 344.895 ms 2023-10-18T11:13:07.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2719 0.52 MB/sec warmup 61 sec latency 538.547 ms 2023-10-18T11:13:08.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2764 0.52 MB/sec warmup 62 sec latency 397.612 ms 2023-10-18T11:13:09.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2779 0.51 MB/sec warmup 63 sec latency 243.650 ms 2023-10-18T11:13:10.894 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2880 0.50 MB/sec warmup 64 sec latency 532.115 ms 2023-10-18T11:13:11.895 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2902 0.50 MB/sec warmup 65 sec latency 726.568 ms 2023-10-18T11:13:12.895 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2931 0.51 MB/sec warmup 66 sec latency 372.836 ms 2023-10-18T11:13:13.895 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2973 0.50 MB/sec warmup 67 sec latency 514.385 ms 2023-10-18T11:13:14.895 INFO:tasks.workunit.client.0.smithi151.stdout: 1 2989 0.49 MB/sec warmup 68 sec latency 347.149 ms 2023-10-18T11:13:15.895 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3012 0.49 MB/sec warmup 69 sec latency 402.718 ms 2023-10-18T11:13:16.895 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3015 0.48 MB/sec warmup 70 sec latency 599.001 ms 2023-10-18T11:13:17.895 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3169 0.48 MB/sec warmup 71 sec latency 589.810 ms 2023-10-18T11:13:18.896 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3177 0.47 MB/sec warmup 72 sec latency 381.325 ms 2023-10-18T11:13:19.896 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3209 0.47 MB/sec warmup 73 sec latency 337.077 ms 2023-10-18T11:13:20.896 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3275 0.48 MB/sec warmup 74 sec latency 529.284 ms 2023-10-18T11:13:21.897 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3352 0.47 MB/sec warmup 75 sec latency 492.583 ms 2023-10-18T11:13:22.896 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3365 0.47 MB/sec warmup 76 sec latency 326.606 ms 2023-10-18T11:13:23.896 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3378 0.46 MB/sec warmup 77 sec latency 341.861 ms 2023-10-18T11:13:24.896 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3493 0.49 MB/sec warmup 78 sec latency 283.816 ms 2023-10-18T11:13:25.896 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3516 0.49 MB/sec warmup 79 sec latency 519.567 ms 2023-10-18T11:13:26.896 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3533 0.48 MB/sec warmup 80 sec latency 709.150 ms 2023-10-18T11:13:27.897 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3556 0.47 MB/sec warmup 81 sec latency 799.387 ms 2023-10-18T11:13:28.897 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3617 0.47 MB/sec warmup 82 sec latency 340.896 ms 2023-10-18T11:13:29.897 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3633 0.47 MB/sec warmup 83 sec latency 391.516 ms 2023-10-18T11:13:30.897 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3645 0.46 MB/sec warmup 84 sec latency 447.561 ms 2023-10-18T11:13:31.897 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3673 0.46 MB/sec warmup 85 sec latency 410.778 ms 2023-10-18T11:13:32.897 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3689 0.45 MB/sec warmup 86 sec latency 499.446 ms 2023-10-18T11:13:33.695 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:13:33.704 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:13:33.897 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3697 0.45 MB/sec warmup 87 sec latency 641.634 ms 2023-10-18T11:13:34.898 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3715 0.44 MB/sec warmup 88 sec latency 384.035 ms 2023-10-18T11:13:35.898 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3773 0.45 MB/sec warmup 89 sec latency 312.202 ms 2023-10-18T11:13:36.898 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3784 0.44 MB/sec warmup 90 sec latency 242.325 ms 2023-10-18T11:13:37.898 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3792 0.44 MB/sec warmup 91 sec latency 758.438 ms 2023-10-18T11:13:38.898 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3801 0.43 MB/sec warmup 92 sec latency 452.471 ms 2023-10-18T11:13:39.898 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3812 0.43 MB/sec warmup 93 sec latency 399.178 ms 2023-10-18T11:13:40.898 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3835 0.42 MB/sec warmup 94 sec latency 225.862 ms 2023-10-18T11:13:41.898 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3851 0.42 MB/sec warmup 95 sec latency 254.033 ms 2023-10-18T11:13:42.898 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3868 0.41 MB/sec warmup 96 sec latency 256.315 ms 2023-10-18T11:13:43.899 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3880 0.41 MB/sec warmup 97 sec latency 329.727 ms 2023-10-18T11:13:44.899 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3920 0.41 MB/sec warmup 98 sec latency 208.852 ms 2023-10-18T11:13:45.899 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3931 0.40 MB/sec warmup 99 sec latency 402.938 ms 2023-10-18T11:13:46.899 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3944 0.40 MB/sec warmup 100 sec latency 315.550 ms 2023-10-18T11:13:47.899 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3951 0.40 MB/sec warmup 101 sec latency 622.817 ms 2023-10-18T11:13:48.899 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3967 0.39 MB/sec warmup 102 sec latency 235.931 ms 2023-10-18T11:13:49.899 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3983 0.39 MB/sec warmup 103 sec latency 321.318 ms 2023-10-18T11:13:50.899 INFO:tasks.workunit.client.0.smithi151.stdout: 1 3999 0.39 MB/sec warmup 104 sec latency 357.065 ms 2023-10-18T11:13:51.900 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4021 0.38 MB/sec warmup 105 sec latency 207.956 ms 2023-10-18T11:13:52.900 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4033 0.38 MB/sec warmup 106 sec latency 377.472 ms 2023-10-18T11:13:53.900 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4091 0.37 MB/sec warmup 107 sec latency 233.890 ms 2023-10-18T11:13:54.900 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4112 0.37 MB/sec warmup 108 sec latency 285.137 ms 2023-10-18T11:13:55.900 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4129 0.37 MB/sec warmup 109 sec latency 232.798 ms 2023-10-18T11:13:56.900 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4139 0.36 MB/sec warmup 110 sec latency 333.569 ms 2023-10-18T11:13:57.900 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4156 0.36 MB/sec warmup 111 sec latency 189.237 ms 2023-10-18T11:13:58.900 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4208 0.36 MB/sec warmup 112 sec latency 173.495 ms 2023-10-18T11:13:59.900 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4257 0.36 MB/sec warmup 113 sec latency 346.816 ms 2023-10-18T11:14:00.901 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4281 0.35 MB/sec warmup 114 sec latency 451.640 ms 2023-10-18T11:14:01.901 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4340 0.35 MB/sec warmup 115 sec latency 287.208 ms 2023-10-18T11:14:02.901 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4349 0.35 MB/sec warmup 116 sec latency 661.481 ms 2023-10-18T11:14:03.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:14:03.843 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:14:03.901 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4386 0.35 MB/sec warmup 117 sec latency 459.657 ms 2023-10-18T11:14:04.901 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4434 0.34 MB/sec warmup 118 sec latency 307.014 ms 2023-10-18T11:14:05.901 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4473 0.34 MB/sec warmup 119 sec latency 410.667 ms 2023-10-18T11:14:07.901 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4533 0.04 MB/sec execute 1 sec latency 403.589 ms 2023-10-18T11:14:08.901 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4559 0.07 MB/sec execute 2 sec latency 350.133 ms 2023-10-18T11:14:09.902 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4628 0.37 MB/sec execute 3 sec latency 249.683 ms 2023-10-18T11:14:10.902 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4674 0.30 MB/sec execute 4 sec latency 293.978 ms 2023-10-18T11:14:11.902 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4723 0.25 MB/sec execute 5 sec latency 320.913 ms 2023-10-18T11:14:12.902 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4747 0.21 MB/sec execute 6 sec latency 247.586 ms 2023-10-18T11:14:13.903 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4810 0.19 MB/sec execute 7 sec latency 252.318 ms 2023-10-18T11:14:14.902 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4960 0.53 MB/sec execute 8 sec latency 284.872 ms 2023-10-18T11:14:15.902 INFO:tasks.workunit.client.0.smithi151.stdout: 1 4984 0.47 MB/sec execute 9 sec latency 548.433 ms 2023-10-18T11:14:16.902 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5012 0.42 MB/sec execute 10 sec latency 346.045 ms 2023-10-18T11:14:17.902 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5055 0.39 MB/sec execute 11 sec latency 509.341 ms 2023-10-18T11:14:18.903 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5082 0.36 MB/sec execute 12 sec latency 313.295 ms 2023-10-18T11:14:19.903 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5118 0.33 MB/sec execute 13 sec latency 448.262 ms 2023-10-18T11:14:20.903 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5168 0.31 MB/sec execute 14 sec latency 450.413 ms 2023-10-18T11:14:21.903 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5208 0.29 MB/sec execute 15 sec latency 506.328 ms 2023-10-18T11:14:22.903 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5245 0.28 MB/sec execute 16 sec latency 524.774 ms 2023-10-18T11:14:23.903 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5254 0.26 MB/sec execute 17 sec latency 508.755 ms 2023-10-18T11:14:24.903 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5335 0.25 MB/sec execute 18 sec latency 495.386 ms 2023-10-18T11:14:25.903 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5420 0.24 MB/sec execute 19 sec latency 389.302 ms 2023-10-18T11:14:26.904 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5515 0.23 MB/sec execute 20 sec latency 328.657 ms 2023-10-18T11:14:27.904 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5538 0.22 MB/sec execute 21 sec latency 420.305 ms 2023-10-18T11:14:28.904 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5700 0.22 MB/sec execute 22 sec latency 423.186 ms 2023-10-18T11:14:29.904 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5763 0.22 MB/sec execute 23 sec latency 375.095 ms 2023-10-18T11:14:30.904 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5894 0.25 MB/sec execute 24 sec latency 169.732 ms 2023-10-18T11:14:31.904 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5919 0.24 MB/sec execute 25 sec latency 386.191 ms 2023-10-18T11:14:32.905 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5948 0.24 MB/sec execute 26 sec latency 306.312 ms 2023-10-18T11:14:33.904 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5960 0.23 MB/sec execute 27 sec latency 445.650 ms 2023-10-18T11:14:33.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:14:33.967 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:14:34.905 INFO:tasks.workunit.client.0.smithi151.stdout: 1 5988 0.23 MB/sec execute 28 sec latency 329.177 ms 2023-10-18T11:14:35.905 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6000 0.22 MB/sec execute 29 sec latency 557.241 ms 2023-10-18T11:14:36.905 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6012 0.21 MB/sec execute 30 sec latency 430.145 ms 2023-10-18T11:14:37.905 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6026 0.22 MB/sec execute 31 sec latency 514.176 ms 2023-10-18T11:14:38.908 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6049 0.22 MB/sec execute 32 sec latency 475.570 ms 2023-10-18T11:14:39.905 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6116 0.22 MB/sec execute 33 sec latency 651.711 ms 2023-10-18T11:14:40.905 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6134 0.21 MB/sec execute 34 sec latency 449.846 ms 2023-10-18T11:14:41.905 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6154 0.21 MB/sec execute 35 sec latency 289.363 ms 2023-10-18T11:14:42.905 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6166 0.20 MB/sec execute 36 sec latency 519.394 ms 2023-10-18T11:14:43.906 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6317 0.28 MB/sec execute 37 sec latency 248.727 ms 2023-10-18T11:14:44.906 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6335 0.27 MB/sec execute 38 sec latency 421.832 ms 2023-10-18T11:14:45.906 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6435 0.27 MB/sec execute 39 sec latency 351.104 ms 2023-10-18T11:14:46.906 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6457 0.28 MB/sec execute 40 sec latency 351.804 ms 2023-10-18T11:14:47.906 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6473 0.29 MB/sec execute 41 sec latency 624.323 ms 2023-10-18T11:14:48.906 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6489 0.28 MB/sec execute 42 sec latency 475.558 ms 2023-10-18T11:14:49.906 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6530 0.27 MB/sec execute 43 sec latency 351.642 ms 2023-10-18T11:14:50.906 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6548 0.27 MB/sec execute 44 sec latency 389.171 ms 2023-10-18T11:14:51.907 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6567 0.26 MB/sec execute 45 sec latency 483.807 ms 2023-10-18T11:14:52.907 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6570 0.26 MB/sec execute 46 sec latency 951.581 ms 2023-10-18T11:14:53.907 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6724 0.26 MB/sec execute 47 sec latency 374.035 ms 2023-10-18T11:14:54.907 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6732 0.26 MB/sec execute 48 sec latency 434.608 ms 2023-10-18T11:14:55.907 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6764 0.26 MB/sec execute 49 sec latency 356.314 ms 2023-10-18T11:14:56.907 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6825 0.27 MB/sec execute 50 sec latency 600.664 ms 2023-10-18T11:14:57.907 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6898 0.27 MB/sec execute 51 sec latency 371.002 ms 2023-10-18T11:14:58.907 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6919 0.26 MB/sec execute 52 sec latency 286.931 ms 2023-10-18T11:14:59.908 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6933 0.26 MB/sec execute 53 sec latency 422.020 ms 2023-10-18T11:15:00.908 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7054 0.31 MB/sec execute 54 sec latency 319.083 ms 2023-10-18T11:15:01.908 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7076 0.30 MB/sec execute 55 sec latency 351.245 ms 2023-10-18T11:15:02.908 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7099 0.30 MB/sec execute 56 sec latency 294.933 ms 2023-10-18T11:15:03.908 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7130 0.29 MB/sec execute 57 sec latency 290.815 ms 2023-10-18T11:15:04.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:15:04.109 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:15:04.908 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7180 0.29 MB/sec execute 58 sec latency 225.487 ms 2023-10-18T11:15:05.908 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7209 0.29 MB/sec execute 59 sec latency 228.945 ms 2023-10-18T11:15:06.908 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7228 0.28 MB/sec execute 60 sec latency 391.585 ms 2023-10-18T11:15:07.909 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7241 0.28 MB/sec execute 61 sec latency 501.611 ms 2023-10-18T11:15:08.909 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7304 0.29 MB/sec execute 62 sec latency 224.620 ms 2023-10-18T11:15:09.909 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7317 0.29 MB/sec execute 63 sec latency 367.153 ms 2023-10-18T11:15:10.909 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7332 0.28 MB/sec execute 64 sec latency 469.588 ms 2023-10-18T11:15:11.909 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7345 0.28 MB/sec execute 65 sec latency 410.543 ms 2023-10-18T11:15:12.909 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7352 0.27 MB/sec execute 66 sec latency 607.393 ms 2023-10-18T11:15:13.909 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7373 0.27 MB/sec execute 67 sec latency 276.110 ms 2023-10-18T11:15:14.909 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7396 0.26 MB/sec execute 68 sec latency 280.036 ms 2023-10-18T11:15:15.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7418 0.26 MB/sec execute 69 sec latency 277.785 ms 2023-10-18T11:15:16.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7463 0.26 MB/sec execute 70 sec latency 205.741 ms 2023-10-18T11:15:17.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7472 0.26 MB/sec execute 71 sec latency 459.361 ms 2023-10-18T11:15:18.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7488 0.25 MB/sec execute 72 sec latency 290.817 ms 2023-10-18T11:15:19.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7503 0.25 MB/sec execute 73 sec latency 341.263 ms 2023-10-18T11:15:20.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7523 0.25 MB/sec execute 74 sec latency 296.134 ms 2023-10-18T11:15:21.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7543 0.24 MB/sec execute 75 sec latency 267.767 ms 2023-10-18T11:15:22.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7559 0.24 MB/sec execute 76 sec latency 318.511 ms 2023-10-18T11:15:23.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7578 0.24 MB/sec execute 77 sec latency 335.577 ms 2023-10-18T11:15:24.910 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7650 0.23 MB/sec execute 78 sec latency 220.413 ms 2023-10-18T11:15:25.911 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7659 0.23 MB/sec execute 79 sec latency 391.304 ms 2023-10-18T11:15:26.913 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7681 0.23 MB/sec execute 80 sec latency 197.333 ms 2023-10-18T11:15:27.911 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7697 0.23 MB/sec execute 81 sec latency 335.874 ms 2023-10-18T11:15:28.911 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7710 0.22 MB/sec execute 82 sec latency 383.410 ms 2023-10-18T11:15:29.911 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7750 0.22 MB/sec execute 83 sec latency 308.811 ms 2023-10-18T11:15:30.911 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7768 0.22 MB/sec execute 84 sec latency 425.900 ms 2023-10-18T11:15:31.911 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7812 0.22 MB/sec execute 85 sec latency 555.656 ms 2023-10-18T11:15:32.911 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7824 0.22 MB/sec execute 86 sec latency 602.293 ms 2023-10-18T11:15:33.911 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7882 0.22 MB/sec execute 87 sec latency 399.451 ms 2023-10-18T11:15:34.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:15:34.309 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:15:34.912 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7892 0.21 MB/sec execute 88 sec latency 628.203 ms 2023-10-18T11:15:35.912 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7928 0.21 MB/sec execute 89 sec latency 310.363 ms 2023-10-18T11:15:36.912 INFO:tasks.workunit.client.0.smithi151.stdout: 1 7975 0.21 MB/sec execute 90 sec latency 466.614 ms 2023-10-18T11:15:37.912 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8004 0.21 MB/sec execute 91 sec latency 660.584 ms 2023-10-18T11:15:38.912 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8014 0.21 MB/sec execute 92 sec latency 616.736 ms 2023-10-18T11:15:39.912 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8044 0.21 MB/sec execute 93 sec latency 519.522 ms 2023-10-18T11:15:40.912 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8080 0.20 MB/sec execute 94 sec latency 369.656 ms 2023-10-18T11:15:41.912 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8091 0.20 MB/sec execute 95 sec latency 602.445 ms 2023-10-18T11:15:42.913 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8161 0.21 MB/sec execute 96 sec latency 253.316 ms 2023-10-18T11:15:43.913 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8209 0.21 MB/sec execute 97 sec latency 294.676 ms 2023-10-18T11:15:44.913 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8265 0.21 MB/sec execute 98 sec latency 255.892 ms 2023-10-18T11:15:45.913 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8289 0.21 MB/sec execute 99 sec latency 252.069 ms 2023-10-18T11:15:46.913 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8352 0.20 MB/sec execute 100 sec latency 263.531 ms 2023-10-18T11:15:47.913 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8360 0.20 MB/sec execute 101 sec latency 515.840 ms 2023-10-18T11:15:48.913 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8512 0.23 MB/sec execute 102 sec latency 226.476 ms 2023-10-18T11:15:49.913 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8537 0.23 MB/sec execute 103 sec latency 516.770 ms 2023-10-18T11:15:50.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8555 0.22 MB/sec execute 104 sec latency 413.528 ms 2023-10-18T11:15:51.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8608 0.22 MB/sec execute 105 sec latency 409.804 ms 2023-10-18T11:15:52.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8625 0.22 MB/sec execute 106 sec latency 383.747 ms 2023-10-18T11:15:53.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8661 0.22 MB/sec execute 107 sec latency 330.737 ms 2023-10-18T11:15:54.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8711 0.22 MB/sec execute 108 sec latency 423.486 ms 2023-10-18T11:15:55.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8751 0.22 MB/sec execute 109 sec latency 423.900 ms 2023-10-18T11:15:56.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8788 0.21 MB/sec execute 110 sec latency 562.749 ms 2023-10-18T11:15:57.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8797 0.21 MB/sec execute 111 sec latency 575.413 ms 2023-10-18T11:15:58.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8877 0.21 MB/sec execute 112 sec latency 429.633 ms 2023-10-18T11:15:59.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 8928 0.21 MB/sec execute 113 sec latency 390.622 ms 2023-10-18T11:16:00.914 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9018 0.21 MB/sec execute 114 sec latency 420.755 ms 2023-10-18T11:16:01.915 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9082 0.21 MB/sec execute 115 sec latency 318.510 ms 2023-10-18T11:16:02.915 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9194 0.21 MB/sec execute 116 sec latency 445.312 ms 2023-10-18T11:16:03.915 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9280 0.21 MB/sec execute 117 sec latency 449.987 ms 2023-10-18T11:16:04.445 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:16:04.455 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:16:04.915 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9399 0.21 MB/sec execute 118 sec latency 348.920 ms 2023-10-18T11:16:05.915 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9449 0.21 MB/sec execute 119 sec latency 287.309 ms 2023-10-18T11:16:06.915 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9492 0.21 MB/sec execute 120 sec latency 135.313 ms 2023-10-18T11:16:07.915 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9497 0.21 MB/sec execute 121 sec latency 842.814 ms 2023-10-18T11:16:08.915 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9511 0.21 MB/sec execute 122 sec latency 239.410 ms 2023-10-18T11:16:09.916 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9540 0.21 MB/sec execute 123 sec latency 424.606 ms 2023-10-18T11:16:10.916 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9553 0.21 MB/sec execute 124 sec latency 286.433 ms 2023-10-18T11:16:11.916 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9571 0.21 MB/sec execute 125 sec latency 376.404 ms 2023-10-18T11:16:12.916 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9594 0.21 MB/sec execute 126 sec latency 428.638 ms 2023-10-18T11:16:13.916 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9664 0.21 MB/sec execute 127 sec latency 328.065 ms 2023-10-18T11:16:14.916 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9698 0.21 MB/sec execute 128 sec latency 155.871 ms 2023-10-18T11:16:15.916 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9710 0.20 MB/sec execute 129 sec latency 442.743 ms 2023-10-18T11:16:16.916 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9861 0.23 MB/sec execute 130 sec latency 313.995 ms 2023-10-18T11:16:17.917 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9870 0.22 MB/sec execute 131 sec latency 572.549 ms 2023-10-18T11:16:18.917 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9975 0.22 MB/sec execute 132 sec latency 352.592 ms 2023-10-18T11:16:19.917 INFO:tasks.workunit.client.0.smithi151.stdout: 1 9997 0.23 MB/sec execute 133 sec latency 337.812 ms 2023-10-18T11:16:20.917 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10016 0.23 MB/sec execute 134 sec latency 345.111 ms 2023-10-18T11:16:21.917 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10031 0.23 MB/sec execute 135 sec latency 492.171 ms 2023-10-18T11:16:22.917 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10074 0.23 MB/sec execute 136 sec latency 373.331 ms 2023-10-18T11:16:23.917 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10088 0.23 MB/sec execute 137 sec latency 397.425 ms 2023-10-18T11:16:24.917 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10111 0.22 MB/sec execute 138 sec latency 406.194 ms 2023-10-18T11:16:25.918 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10123 0.22 MB/sec execute 139 sec latency 455.539 ms 2023-10-18T11:16:26.918 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10270 0.22 MB/sec execute 140 sec latency 450.062 ms 2023-10-18T11:16:27.918 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10288 0.22 MB/sec execute 141 sec latency 584.871 ms 2023-10-18T11:16:28.918 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10308 0.22 MB/sec execute 142 sec latency 367.544 ms 2023-10-18T11:16:29.918 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10370 0.23 MB/sec execute 143 sec latency 743.249 ms 2023-10-18T11:16:30.918 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10451 0.23 MB/sec execute 144 sec latency 320.603 ms 2023-10-18T11:16:31.919 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10464 0.23 MB/sec execute 145 sec latency 338.068 ms 2023-10-18T11:16:32.918 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10476 0.22 MB/sec execute 146 sec latency 395.349 ms 2023-10-18T11:16:33.919 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10592 0.24 MB/sec execute 147 sec latency 392.292 ms 2023-10-18T11:16:34.571 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:16:34.581 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:16:34.919 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10629 0.24 MB/sec execute 148 sec latency 408.592 ms 2023-10-18T11:16:35.919 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10659 0.24 MB/sec execute 149 sec latency 289.871 ms 2023-10-18T11:16:36.920 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10725 0.24 MB/sec execute 150 sec latency 237.438 ms 2023-10-18T11:16:37.919 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10753 0.24 MB/sec execute 151 sec latency 424.133 ms 2023-10-18T11:16:38.919 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10785 0.24 MB/sec execute 152 sec latency 253.218 ms 2023-10-18T11:16:39.920 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10805 0.24 MB/sec execute 153 sec latency 290.015 ms 2023-10-18T11:16:40.919 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10858 0.24 MB/sec execute 154 sec latency 311.404 ms 2023-10-18T11:16:41.920 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10870 0.24 MB/sec execute 155 sec latency 327.706 ms 2023-10-18T11:16:42.920 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10887 0.24 MB/sec execute 156 sec latency 379.196 ms 2023-10-18T11:16:43.920 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10901 0.24 MB/sec execute 157 sec latency 288.123 ms 2023-10-18T11:16:44.920 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10918 0.23 MB/sec execute 158 sec latency 267.377 ms 2023-10-18T11:16:45.920 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10942 0.23 MB/sec execute 159 sec latency 284.659 ms 2023-10-18T11:16:46.920 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10961 0.23 MB/sec execute 160 sec latency 276.035 ms 2023-10-18T11:16:47.920 INFO:tasks.workunit.client.0.smithi151.stdout: 1 10975 0.23 MB/sec execute 161 sec latency 365.142 ms 2023-10-18T11:16:48.921 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11017 0.23 MB/sec execute 162 sec latency 251.603 ms 2023-10-18T11:16:49.921 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11032 0.23 MB/sec execute 163 sec latency 433.902 ms 2023-10-18T11:16:50.921 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11038 0.23 MB/sec execute 164 sec latency 653.196 ms 2023-10-18T11:16:51.921 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11057 0.23 MB/sec execute 165 sec latency 353.590 ms 2023-10-18T11:16:52.921 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11081 0.23 MB/sec execute 166 sec latency 332.744 ms 2023-10-18T11:16:53.921 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11103 0.22 MB/sec execute 167 sec latency 283.988 ms 2023-10-18T11:16:54.921 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11118 0.22 MB/sec execute 168 sec latency 294.736 ms 2023-10-18T11:16:55.921 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11180 0.22 MB/sec execute 169 sec latency 410.975 ms 2023-10-18T11:16:56.921 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11190 0.22 MB/sec execute 170 sec latency 299.901 ms 2023-10-18T11:16:57.922 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11204 0.22 MB/sec execute 171 sec latency 220.546 ms 2023-10-18T11:16:58.922 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11226 0.22 MB/sec execute 172 sec latency 221.055 ms 2023-10-18T11:16:59.922 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11250 0.22 MB/sec execute 173 sec latency 140.197 ms 2023-10-18T11:17:00.922 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11257 0.22 MB/sec execute 174 sec latency 504.938 ms 2023-10-18T11:17:01.922 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11310 0.21 MB/sec execute 175 sec latency 469.093 ms 2023-10-18T11:17:02.922 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11315 0.21 MB/sec execute 176 sec latency 400.267 ms 2023-10-18T11:17:03.923 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11365 0.21 MB/sec execute 177 sec latency 489.479 ms 2023-10-18T11:17:04.692 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:17:04.702 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:17:04.922 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11400 0.21 MB/sec execute 178 sec latency 482.092 ms 2023-10-18T11:17:05.922 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11429 0.21 MB/sec execute 179 sec latency 448.155 ms 2023-10-18T11:17:06.923 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11438 0.21 MB/sec execute 180 sec latency 835.936 ms 2023-10-18T11:17:07.923 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11440 0.21 MB/sec execute 181 sec latency 1217.720 ms 2023-10-18T11:17:08.923 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11475 0.21 MB/sec execute 182 sec latency 303.697 ms 2023-10-18T11:17:09.923 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11532 0.21 MB/sec execute 183 sec latency 276.597 ms 2023-10-18T11:17:10.923 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11562 0.21 MB/sec execute 184 sec latency 493.358 ms 2023-10-18T11:17:11.923 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11592 0.21 MB/sec execute 185 sec latency 292.967 ms 2023-10-18T11:17:12.923 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11627 0.21 MB/sec execute 186 sec latency 455.162 ms 2023-10-18T11:17:13.923 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11651 0.21 MB/sec execute 187 sec latency 555.766 ms 2023-10-18T11:17:14.924 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11708 0.21 MB/sec execute 188 sec latency 193.538 ms 2023-10-18T11:17:15.924 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11756 0.21 MB/sec execute 189 sec latency 253.951 ms 2023-10-18T11:17:16.924 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11812 0.21 MB/sec execute 190 sec latency 316.615 ms 2023-10-18T11:17:17.924 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11836 0.21 MB/sec execute 191 sec latency 394.020 ms 2023-10-18T11:17:18.924 INFO:tasks.workunit.client.0.smithi151.stdout: 1 11900 0.21 MB/sec execute 192 sec latency 200.159 ms 2023-10-18T11:17:19.924 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12049 0.22 MB/sec execute 193 sec latency 394.044 ms 2023-10-18T11:17:20.924 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12059 0.22 MB/sec execute 194 sec latency 400.719 ms 2023-10-18T11:17:21.924 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12097 0.22 MB/sec execute 195 sec latency 454.585 ms 2023-10-18T11:17:22.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12137 0.22 MB/sec execute 196 sec latency 487.242 ms 2023-10-18T11:17:23.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12168 0.22 MB/sec execute 197 sec latency 342.061 ms 2023-10-18T11:17:24.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12181 0.21 MB/sec execute 198 sec latency 424.841 ms 2023-10-18T11:17:25.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12243 0.21 MB/sec execute 199 sec latency 333.028 ms 2023-10-18T11:17:26.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12271 0.21 MB/sec execute 200 sec latency 452.786 ms 2023-10-18T11:17:27.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12308 0.21 MB/sec execute 201 sec latency 517.023 ms 2023-10-18T11:17:28.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12341 0.21 MB/sec execute 202 sec latency 566.922 ms 2023-10-18T11:17:29.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12353 0.21 MB/sec execute 203 sec latency 636.563 ms 2023-10-18T11:17:30.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12425 0.21 MB/sec execute 204 sec latency 402.345 ms 2023-10-18T11:17:31.925 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12511 0.21 MB/sec execute 205 sec latency 406.531 ms 2023-10-18T11:17:32.926 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12608 0.21 MB/sec execute 206 sec latency 457.836 ms 2023-10-18T11:17:33.926 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12712 0.21 MB/sec execute 207 sec latency 402.025 ms 2023-10-18T11:17:34.813 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:17:34.823 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:17:34.926 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12793 0.21 MB/sec execute 208 sec latency 267.065 ms 2023-10-18T11:17:35.926 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12912 0.21 MB/sec execute 209 sec latency 322.902 ms 2023-10-18T11:17:36.926 INFO:tasks.workunit.client.0.smithi151.stdout: 1 12981 0.21 MB/sec execute 210 sec latency 238.866 ms 2023-10-18T11:17:37.926 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13007 0.21 MB/sec execute 211 sec latency 345.816 ms 2023-10-18T11:17:38.926 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13042 0.21 MB/sec execute 212 sec latency 206.030 ms 2023-10-18T11:17:39.926 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13054 0.21 MB/sec execute 213 sec latency 417.259 ms 2023-10-18T11:17:40.926 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13082 0.21 MB/sec execute 214 sec latency 332.363 ms 2023-10-18T11:17:41.927 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13094 0.21 MB/sec execute 215 sec latency 454.493 ms 2023-10-18T11:17:42.927 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13107 0.21 MB/sec execute 216 sec latency 355.752 ms 2023-10-18T11:17:43.519 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:08:59.613 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:43.606 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:08:59.775 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:43.607 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:08:59.775 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:43.633 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:08:59.727 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:43.665 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:08:59.833 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:43.667 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:08:59.836 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:43.927 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13137 0.21 MB/sec execute 217 sec latency 463.519 ms 2023-10-18T11:17:44.053 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:09:00.221 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:44.056 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:09:00.224 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:44.270 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:09:00.364 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:44.927 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13155 0.21 MB/sec execute 218 sec latency 398.041 ms 2023-10-18T11:17:45.927 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13214 0.21 MB/sec execute 219 sec latency 297.188 ms 2023-10-18T11:17:46.927 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13234 0.21 MB/sec execute 220 sec latency 352.381 ms 2023-10-18T11:17:47.927 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13254 0.21 MB/sec execute 221 sec latency 514.607 ms 2023-10-18T11:17:48.927 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13261 0.20 MB/sec execute 222 sec latency 350.979 ms 2023-10-18T11:17:49.927 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13415 0.22 MB/sec execute 223 sec latency 341.425 ms 2023-10-18T11:17:50.928 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13430 0.22 MB/sec execute 224 sec latency 300.714 ms 2023-10-18T11:17:51.928 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13530 0.22 MB/sec execute 225 sec latency 392.310 ms 2023-10-18T11:17:52.928 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13552 0.22 MB/sec execute 226 sec latency 422.178 ms 2023-10-18T11:17:53.928 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13568 0.22 MB/sec execute 227 sec latency 676.468 ms 2023-10-18T11:17:54.928 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13584 0.22 MB/sec execute 228 sec latency 568.381 ms 2023-10-18T11:17:55.928 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13625 0.22 MB/sec execute 229 sec latency 329.946 ms 2023-10-18T11:17:56.929 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13643 0.22 MB/sec execute 230 sec latency 406.365 ms 2023-10-18T11:17:57.928 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13662 0.22 MB/sec execute 231 sec latency 471.244 ms 2023-10-18T11:17:58.929 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13674 0.22 MB/sec execute 232 sec latency 472.892 ms 2023-10-18T11:17:59.236 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:09:15.330 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:59.246 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:09:15.414 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:59.247 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:09:15.415 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:59.247 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:09:15.342 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:59.249 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:09:15.417 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:59.249 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:09:15.418 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:59.289 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:09:15.457 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:59.289 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:09:15.457 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:59.474 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:09:15.569 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:17:59.929 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13821 0.22 MB/sec execute 233 sec latency 349.017 ms 2023-10-18T11:18:00.929 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13839 0.22 MB/sec execute 234 sec latency 358.550 ms 2023-10-18T11:18:01.929 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13860 0.22 MB/sec execute 235 sec latency 466.783 ms 2023-10-18T11:18:02.929 INFO:tasks.workunit.client.0.smithi151.stdout: 1 13924 0.22 MB/sec execute 236 sec latency 424.301 ms 2023-10-18T11:18:03.929 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14001 0.22 MB/sec execute 237 sec latency 628.224 ms 2023-10-18T11:18:04.929 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14014 0.22 MB/sec execute 238 sec latency 250.470 ms 2023-10-18T11:18:04.934 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:18:04.943 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:18:05.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14027 0.22 MB/sec execute 239 sec latency 279.993 ms 2023-10-18T11:18:06.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14142 0.23 MB/sec execute 240 sec latency 408.133 ms 2023-10-18T11:18:07.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14180 0.23 MB/sec execute 241 sec latency 355.873 ms 2023-10-18T11:18:08.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14215 0.23 MB/sec execute 242 sec latency 322.565 ms 2023-10-18T11:18:09.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14275 0.23 MB/sec execute 243 sec latency 283.012 ms 2023-10-18T11:18:10.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14307 0.23 MB/sec execute 244 sec latency 318.309 ms 2023-10-18T11:18:11.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14336 0.23 MB/sec execute 245 sec latency 274.253 ms 2023-10-18T11:18:12.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14356 0.22 MB/sec execute 246 sec latency 412.311 ms 2023-10-18T11:18:13.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14412 0.23 MB/sec execute 247 sec latency 377.673 ms 2023-10-18T11:18:14.930 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14431 0.23 MB/sec execute 248 sec latency 369.421 ms 2023-10-18T11:18:15.931 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14440 0.23 MB/sec execute 249 sec latency 481.196 ms 2023-10-18T11:18:16.931 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14459 0.22 MB/sec execute 250 sec latency 367.461 ms 2023-10-18T11:18:17.931 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14483 0.22 MB/sec execute 251 sec latency 322.651 ms 2023-10-18T11:18:18.931 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14499 0.22 MB/sec execute 252 sec latency 328.959 ms 2023-10-18T11:18:19.931 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14523 0.22 MB/sec execute 253 sec latency 301.970 ms 2023-10-18T11:18:20.931 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14554 0.22 MB/sec execute 254 sec latency 432.578 ms 2023-10-18T11:18:21.931 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14571 0.22 MB/sec execute 255 sec latency 257.874 ms 2023-10-18T11:18:22.931 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14583 0.22 MB/sec execute 256 sec latency 529.075 ms 2023-10-18T11:18:23.932 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14598 0.22 MB/sec execute 257 sec latency 696.172 ms 2023-10-18T11:18:24.932 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14614 0.22 MB/sec execute 258 sec latency 269.979 ms 2023-10-18T11:18:25.932 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14638 0.22 MB/sec execute 259 sec latency 297.313 ms 2023-10-18T11:18:26.932 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14661 0.22 MB/sec execute 260 sec latency 277.698 ms 2023-10-18T11:18:27.932 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14680 0.22 MB/sec execute 261 sec latency 309.093 ms 2023-10-18T11:18:28.932 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14739 0.22 MB/sec execute 262 sec latency 223.592 ms 2023-10-18T11:18:29.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14765 0.22 MB/sec execute 263 sec latency 124.668 ms 2023-10-18T11:18:30.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14789 0.21 MB/sec execute 264 sec latency 183.498 ms 2023-10-18T11:18:31.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14801 0.21 MB/sec execute 265 sec latency 241.366 ms 2023-10-18T11:18:32.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14854 0.21 MB/sec execute 266 sec latency 325.109 ms 2023-10-18T11:18:33.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14906 0.21 MB/sec execute 267 sec latency 230.487 ms 2023-10-18T11:18:34.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14919 0.21 MB/sec execute 268 sec latency 377.559 ms 2023-10-18T11:18:35.057 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:18:35.067 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:18:35.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14954 0.21 MB/sec execute 269 sec latency 452.099 ms 2023-10-18T11:18:36.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14954 0.21 MB/sec execute 270 sec latency 1452.201 ms 2023-10-18T11:18:37.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14954 0.21 MB/sec execute 271 sec latency 2452.301 ms 2023-10-18T11:18:38.933 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14954 0.21 MB/sec execute 272 sec latency 3452.390 ms 2023-10-18T11:18:39.934 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14954 0.21 MB/sec execute 273 sec latency 4452.484 ms 2023-10-18T11:18:40.934 INFO:tasks.workunit.client.0.smithi151.stdout: 1 14985 0.21 MB/sec execute 274 sec latency 4719.884 ms 2023-10-18T11:18:41.934 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15061 0.21 MB/sec execute 275 sec latency 337.953 ms 2023-10-18T11:18:42.934 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15108 0.21 MB/sec execute 276 sec latency 298.553 ms 2023-10-18T11:18:43.934 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15119 0.21 MB/sec execute 277 sec latency 740.624 ms 2023-10-18T11:18:44.934 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15175 0.21 MB/sec execute 278 sec latency 346.631 ms 2023-10-18T11:18:45.934 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15243 0.21 MB/sec execute 279 sec latency 290.423 ms 2023-10-18T11:18:46.934 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15268 0.21 MB/sec execute 280 sec latency 259.869 ms 2023-10-18T11:18:47.934 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15350 0.21 MB/sec execute 281 sec latency 274.095 ms 2023-10-18T11:18:48.935 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15379 0.21 MB/sec execute 282 sec latency 263.182 ms 2023-10-18T11:18:49.935 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15427 0.21 MB/sec execute 283 sec latency 264.801 ms 2023-10-18T11:18:50.935 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15481 0.21 MB/sec execute 284 sec latency 328.869 ms 2023-10-18T11:18:51.935 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15605 0.22 MB/sec execute 285 sec latency 226.502 ms 2023-10-18T11:18:52.935 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15630 0.22 MB/sec execute 286 sec latency 526.567 ms 2023-10-18T11:18:53.935 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15648 0.21 MB/sec execute 287 sec latency 630.674 ms 2023-10-18T11:18:54.935 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15701 0.21 MB/sec execute 288 sec latency 371.861 ms 2023-10-18T11:18:55.935 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15718 0.21 MB/sec execute 289 sec latency 414.842 ms 2023-10-18T11:18:56.936 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15754 0.21 MB/sec execute 290 sec latency 389.902 ms 2023-10-18T11:18:57.935 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15804 0.21 MB/sec execute 291 sec latency 434.304 ms 2023-10-18T11:18:58.936 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15854 0.21 MB/sec execute 292 sec latency 417.938 ms 2023-10-18T11:18:59.936 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15887 0.21 MB/sec execute 293 sec latency 520.385 ms 2023-10-18T11:19:00.936 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15890 0.21 MB/sec execute 294 sec latency 628.954 ms 2023-10-18T11:19:01.936 INFO:tasks.workunit.client.0.smithi151.stdout: 1 15971 0.21 MB/sec execute 295 sec latency 512.897 ms 2023-10-18T11:19:02.936 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16021 0.21 MB/sec execute 296 sec latency 443.775 ms 2023-10-18T11:19:03.936 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16056 0.21 MB/sec execute 297 sec latency 616.713 ms 2023-10-18T11:19:04.937 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16151 0.21 MB/sec execute 298 sec latency 301.146 ms 2023-10-18T11:19:05.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:19:05.188 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:19:05.937 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16258 0.21 MB/sec execute 299 sec latency 358.608 ms 2023-10-18T11:19:06.937 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16336 0.21 MB/sec execute 300 sec latency 392.037 ms 2023-10-18T11:19:07.937 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16488 0.21 MB/sec execute 301 sec latency 352.553 ms 2023-10-18T11:19:08.937 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16530 0.21 MB/sec execute 302 sec latency 239.167 ms 2023-10-18T11:19:09.937 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16564 0.21 MB/sec execute 303 sec latency 265.365 ms 2023-10-18T11:19:10.937 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16592 0.21 MB/sec execute 304 sec latency 415.009 ms 2023-10-18T11:19:11.937 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16612 0.21 MB/sec execute 305 sec latency 297.123 ms 2023-10-18T11:19:12.937 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16630 0.21 MB/sec execute 306 sec latency 524.453 ms 2023-10-18T11:19:13.938 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16643 0.21 MB/sec execute 307 sec latency 292.349 ms 2023-10-18T11:19:14.938 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16662 0.21 MB/sec execute 308 sec latency 303.279 ms 2023-10-18T11:19:15.938 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16685 0.21 MB/sec execute 309 sec latency 483.727 ms 2023-10-18T11:19:16.938 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16754 0.21 MB/sec execute 310 sec latency 489.753 ms 2023-10-18T11:19:17.938 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16772 0.21 MB/sec execute 311 sec latency 413.919 ms 2023-10-18T11:19:18.938 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16791 0.21 MB/sec execute 312 sec latency 347.559 ms 2023-10-18T11:19:19.938 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16802 0.21 MB/sec execute 313 sec latency 468.989 ms 2023-10-18T11:19:20.939 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16954 0.22 MB/sec execute 314 sec latency 267.662 ms 2023-10-18T11:19:21.939 INFO:tasks.workunit.client.0.smithi151.stdout: 1 16968 0.21 MB/sec execute 315 sec latency 455.842 ms 2023-10-18T11:19:22.939 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17072 0.21 MB/sec execute 316 sec latency 350.292 ms 2023-10-18T11:19:23.939 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17090 0.22 MB/sec execute 317 sec latency 471.421 ms 2023-10-18T11:19:24.939 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17109 0.22 MB/sec execute 318 sec latency 336.498 ms 2023-10-18T11:19:25.939 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17124 0.22 MB/sec execute 319 sec latency 556.238 ms 2023-10-18T11:19:26.939 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17167 0.22 MB/sec execute 320 sec latency 439.622 ms 2023-10-18T11:19:27.939 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17181 0.22 MB/sec execute 321 sec latency 325.556 ms 2023-10-18T11:19:28.940 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17204 0.21 MB/sec execute 322 sec latency 254.695 ms 2023-10-18T11:19:29.940 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17216 0.21 MB/sec execute 323 sec latency 577.565 ms 2023-10-18T11:19:30.940 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17363 0.22 MB/sec execute 324 sec latency 364.081 ms 2023-10-18T11:19:31.940 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17382 0.21 MB/sec execute 325 sec latency 359.060 ms 2023-10-18T11:19:32.940 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17404 0.21 MB/sec execute 326 sec latency 474.927 ms 2023-10-18T11:19:33.940 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17533 0.22 MB/sec execute 327 sec latency 540.339 ms 2023-10-18T11:19:34.940 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17551 0.22 MB/sec execute 328 sec latency 331.805 ms 2023-10-18T11:19:35.334 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:19:35.347 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:19:35.940 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17566 0.22 MB/sec execute 329 sec latency 224.231 ms 2023-10-18T11:19:36.941 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17685 0.22 MB/sec execute 330 sec latency 384.600 ms 2023-10-18T11:19:37.941 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17722 0.22 MB/sec execute 331 sec latency 307.733 ms 2023-10-18T11:19:38.941 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17764 0.22 MB/sec execute 332 sec latency 289.683 ms 2023-10-18T11:19:39.941 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17813 0.22 MB/sec execute 333 sec latency 374.379 ms 2023-10-18T11:19:40.941 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17847 0.22 MB/sec execute 334 sec latency 233.711 ms 2023-10-18T11:19:41.941 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17872 0.22 MB/sec execute 335 sec latency 298.577 ms 2023-10-18T11:19:42.941 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17898 0.22 MB/sec execute 336 sec latency 305.168 ms 2023-10-18T11:19:43.941 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17950 0.22 MB/sec execute 337 sec latency 462.140 ms 2023-10-18T11:19:44.941 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17959 0.22 MB/sec execute 338 sec latency 524.336 ms 2023-10-18T11:19:45.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17968 0.22 MB/sec execute 339 sec latency 502.549 ms 2023-10-18T11:19:46.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17975 0.22 MB/sec execute 340 sec latency 501.744 ms 2023-10-18T11:19:47.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17984 0.22 MB/sec execute 341 sec latency 564.414 ms 2023-10-18T11:19:48.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 17995 0.22 MB/sec execute 342 sec latency 621.086 ms 2023-10-18T11:19:49.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18007 0.22 MB/sec execute 343 sec latency 385.411 ms 2023-10-18T11:19:50.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18019 0.22 MB/sec execute 344 sec latency 427.772 ms 2023-10-18T11:19:51.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18027 0.22 MB/sec execute 345 sec latency 604.768 ms 2023-10-18T11:19:52.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18039 0.22 MB/sec execute 346 sec latency 337.736 ms 2023-10-18T11:19:53.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18051 0.22 MB/sec execute 347 sec latency 420.623 ms 2023-10-18T11:19:54.942 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18067 0.22 MB/sec execute 348 sec latency 330.046 ms 2023-10-18T11:19:55.943 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18098 0.22 MB/sec execute 349 sec latency 379.404 ms 2023-10-18T11:19:56.943 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18106 0.22 MB/sec execute 350 sec latency 480.887 ms 2023-10-18T11:19:57.943 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18115 0.22 MB/sec execute 351 sec latency 284.674 ms 2023-10-18T11:19:58.943 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18127 0.21 MB/sec execute 352 sec latency 599.538 ms 2023-10-18T11:19:59.943 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18131 0.21 MB/sec execute 353 sec latency 554.746 ms 2023-10-18T11:20:00.943 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18142 0.21 MB/sec execute 354 sec latency 488.045 ms 2023-10-18T11:20:01.943 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18150 0.21 MB/sec execute 355 sec latency 506.148 ms 2023-10-18T11:20:02.944 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18158 0.21 MB/sec execute 356 sec latency 371.227 ms 2023-10-18T11:20:03.944 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18166 0.21 MB/sec execute 357 sec latency 481.279 ms 2023-10-18T11:20:04.944 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18182 0.21 MB/sec execute 358 sec latency 387.837 ms 2023-10-18T11:20:05.465 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:20:05.476 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:20:05.944 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18197 0.21 MB/sec execute 359 sec latency 390.936 ms 2023-10-18T11:20:06.944 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18206 0.21 MB/sec execute 360 sec latency 417.278 ms 2023-10-18T11:20:07.944 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18217 0.21 MB/sec execute 361 sec latency 527.500 ms 2023-10-18T11:20:08.944 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18267 0.21 MB/sec execute 362 sec latency 552.653 ms 2023-10-18T11:20:09.944 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18283 0.21 MB/sec execute 363 sec latency 245.766 ms 2023-10-18T11:20:10.944 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18313 0.21 MB/sec execute 364 sec latency 126.725 ms 2023-10-18T11:20:11.945 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18333 0.21 MB/sec execute 365 sec latency 240.453 ms 2023-10-18T11:20:12.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18346 0.21 MB/sec execute 366 sec latency 190.370 ms 2023-10-18T11:20:13.945 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18349 0.21 MB/sec execute 367 sec latency 821.428 ms 2023-10-18T11:20:14.945 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18402 0.21 MB/sec execute 368 sec latency 507.477 ms 2023-10-18T11:20:15.945 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18465 0.21 MB/sec execute 369 sec latency 295.209 ms 2023-10-18T11:20:16.945 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18467 0.21 MB/sec execute 370 sec latency 563.520 ms 2023-10-18T11:20:17.945 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18533 0.21 MB/sec execute 371 sec latency 371.646 ms 2023-10-18T11:20:18.945 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18570 0.20 MB/sec execute 372 sec latency 562.993 ms 2023-10-18T11:20:19.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18646 0.20 MB/sec execute 373 sec latency 298.919 ms 2023-10-18T11:20:20.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18658 0.20 MB/sec execute 374 sec latency 550.197 ms 2023-10-18T11:20:21.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18722 0.20 MB/sec execute 375 sec latency 331.116 ms 2023-10-18T11:20:22.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18763 0.20 MB/sec execute 376 sec latency 583.038 ms 2023-10-18T11:20:23.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18802 0.21 MB/sec execute 377 sec latency 218.410 ms 2023-10-18T11:20:24.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18837 0.21 MB/sec execute 378 sec latency 266.494 ms 2023-10-18T11:20:25.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18879 0.20 MB/sec execute 379 sec latency 399.663 ms 2023-10-18T11:20:26.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18907 0.20 MB/sec execute 380 sec latency 391.592 ms 2023-10-18T11:20:27.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18927 0.20 MB/sec execute 381 sec latency 240.356 ms 2023-10-18T11:20:28.946 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18964 0.20 MB/sec execute 382 sec latency 346.148 ms 2023-10-18T11:20:29.947 INFO:tasks.workunit.client.0.smithi151.stdout: 1 18994 0.20 MB/sec execute 383 sec latency 279.487 ms 2023-10-18T11:20:30.947 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19024 0.20 MB/sec execute 384 sec latency 235.499 ms 2023-10-18T11:20:31.947 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19154 0.21 MB/sec execute 385 sec latency 345.418 ms 2023-10-18T11:20:32.947 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19179 0.21 MB/sec execute 386 sec latency 628.141 ms 2023-10-18T11:20:33.947 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19197 0.21 MB/sec execute 387 sec latency 437.173 ms 2023-10-18T11:20:34.947 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19250 0.21 MB/sec execute 388 sec latency 438.105 ms 2023-10-18T11:20:35.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:20:35.652 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:20:35.947 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19274 0.21 MB/sec execute 389 sec latency 387.277 ms 2023-10-18T11:20:36.947 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19335 0.21 MB/sec execute 390 sec latency 386.728 ms 2023-10-18T11:20:37.947 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19353 0.21 MB/sec execute 391 sec latency 496.441 ms 2023-10-18T11:20:38.948 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19403 0.21 MB/sec execute 392 sec latency 424.057 ms 2023-10-18T11:20:39.948 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19436 0.21 MB/sec execute 393 sec latency 414.709 ms 2023-10-18T11:20:40.948 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19448 0.21 MB/sec execute 394 sec latency 513.847 ms 2023-10-18T11:20:41.948 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19520 0.21 MB/sec execute 395 sec latency 432.407 ms 2023-10-18T11:20:42.948 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19606 0.20 MB/sec execute 396 sec latency 436.076 ms 2023-10-18T11:20:43.948 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19701 0.20 MB/sec execute 397 sec latency 427.592 ms 2023-10-18T11:20:44.948 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19808 0.20 MB/sec execute 398 sec latency 445.747 ms 2023-10-18T11:20:45.948 INFO:tasks.workunit.client.0.smithi151.stdout: 1 19886 0.20 MB/sec execute 399 sec latency 310.180 ms 2023-10-18T11:20:46.948 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20044 0.20 MB/sec execute 400 sec latency 370.514 ms 2023-10-18T11:20:47.949 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20112 0.21 MB/sec execute 401 sec latency 333.684 ms 2023-10-18T11:20:48.949 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20143 0.21 MB/sec execute 402 sec latency 321.130 ms 2023-10-18T11:20:49.949 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20173 0.21 MB/sec execute 403 sec latency 380.467 ms 2023-10-18T11:20:50.949 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20186 0.20 MB/sec execute 404 sec latency 495.904 ms 2023-10-18T11:20:51.949 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20213 0.20 MB/sec execute 405 sec latency 277.410 ms 2023-10-18T11:20:52.949 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20225 0.20 MB/sec execute 406 sec latency 690.865 ms 2023-10-18T11:20:53.949 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20234 0.20 MB/sec execute 407 sec latency 430.167 ms 2023-10-18T11:20:54.950 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20268 0.20 MB/sec execute 408 sec latency 267.714 ms 2023-10-18T11:20:55.950 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20291 0.20 MB/sec execute 409 sec latency 433.147 ms 2023-10-18T11:20:56.950 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20354 0.20 MB/sec execute 410 sec latency 279.995 ms 2023-10-18T11:20:57.950 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20373 0.20 MB/sec execute 411 sec latency 344.077 ms 2023-10-18T11:20:58.950 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20385 0.20 MB/sec execute 412 sec latency 685.522 ms 2023-10-18T11:20:59.950 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20542 0.21 MB/sec execute 413 sec latency 303.219 ms 2023-10-18T11:21:00.950 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20560 0.21 MB/sec execute 414 sec latency 257.693 ms 2023-10-18T11:21:01.950 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20678 0.21 MB/sec execute 415 sec latency 337.092 ms 2023-10-18T11:21:02.950 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20711 0.21 MB/sec execute 416 sec latency 357.584 ms 2023-10-18T11:21:03.951 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20753 0.21 MB/sec execute 417 sec latency 518.939 ms 2023-10-18T11:21:04.951 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20776 0.21 MB/sec execute 418 sec latency 263.167 ms 2023-10-18T11:21:05.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:21:05.932 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:21:05.951 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20804 0.21 MB/sec execute 419 sec latency 461.768 ms 2023-10-18T11:21:06.951 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20969 0.21 MB/sec execute 420 sec latency 254.531 ms 2023-10-18T11:21:07.951 INFO:tasks.workunit.client.0.smithi151.stdout: 1 20992 0.21 MB/sec execute 421 sec latency 449.707 ms 2023-10-18T11:21:08.951 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21122 0.21 MB/sec execute 422 sec latency 486.543 ms 2023-10-18T11:21:09.951 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21140 0.21 MB/sec execute 423 sec latency 302.279 ms 2023-10-18T11:21:10.542 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:12:26.636 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:21:10.558 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:12:26.652 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:21:10.587 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:12:26.755 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:21:10.590 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:12:26.758 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:21:10.606 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:12:26.774 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:21:10.612 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:12:26.780 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:21:10.689 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:12:26.857 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:21:10.701 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:12:26.869 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:21:10.716 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:12:26.810 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:21:10.951 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21153 0.21 MB/sec execute 424 sec latency 263.710 ms 2023-10-18T11:21:11.952 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21290 0.22 MB/sec execute 425 sec latency 267.581 ms 2023-10-18T11:21:12.952 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21323 0.22 MB/sec execute 426 sec latency 364.162 ms 2023-10-18T11:21:13.953 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21338 0.22 MB/sec execute 427 sec latency 488.476 ms 2023-10-18T11:21:14.952 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21409 0.22 MB/sec execute 428 sec latency 237.928 ms 2023-10-18T11:21:15.952 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21444 0.22 MB/sec execute 429 sec latency 230.813 ms 2023-10-18T11:21:16.952 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21472 0.22 MB/sec execute 430 sec latency 286.674 ms 2023-10-18T11:21:17.952 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21536 0.22 MB/sec execute 431 sec latency 415.322 ms 2023-10-18T11:21:18.953 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21542 0.22 MB/sec execute 432 sec latency 630.573 ms 2023-10-18T11:21:19.952 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21554 0.22 MB/sec execute 433 sec latency 383.290 ms 2023-10-18T11:21:20.953 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21561 0.22 MB/sec execute 434 sec latency 550.086 ms 2023-10-18T11:21:21.953 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21570 0.22 MB/sec execute 435 sec latency 553.150 ms 2023-10-18T11:21:22.953 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21580 0.22 MB/sec execute 436 sec latency 572.375 ms 2023-10-18T11:21:23.953 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21585 0.22 MB/sec execute 437 sec latency 755.131 ms 2023-10-18T11:21:24.953 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21597 0.22 MB/sec execute 438 sec latency 474.861 ms 2023-10-18T11:21:25.953 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21605 0.22 MB/sec execute 439 sec latency 523.803 ms 2023-10-18T11:21:26.953 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21620 0.21 MB/sec execute 440 sec latency 410.641 ms 2023-10-18T11:21:27.954 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21633 0.21 MB/sec execute 441 sec latency 302.462 ms 2023-10-18T11:21:28.954 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21640 0.21 MB/sec execute 442 sec latency 633.986 ms 2023-10-18T11:21:29.954 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21653 0.21 MB/sec execute 443 sec latency 367.552 ms 2023-10-18T11:21:30.954 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21688 0.21 MB/sec execute 444 sec latency 364.129 ms 2023-10-18T11:21:31.954 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21696 0.21 MB/sec execute 445 sec latency 365.041 ms 2023-10-18T11:21:32.954 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21701 0.21 MB/sec execute 446 sec latency 577.252 ms 2023-10-18T11:21:33.954 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21713 0.21 MB/sec execute 447 sec latency 603.834 ms 2023-10-18T11:21:34.954 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21721 0.21 MB/sec execute 448 sec latency 504.700 ms 2023-10-18T11:21:35.955 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21728 0.21 MB/sec execute 449 sec latency 448.748 ms 2023-10-18T11:21:36.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:21:36.079 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:21:36.955 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21740 0.21 MB/sec execute 450 sec latency 556.503 ms 2023-10-18T11:21:37.955 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21752 0.21 MB/sec execute 451 sec latency 291.609 ms 2023-10-18T11:21:38.955 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21767 0.21 MB/sec execute 452 sec latency 391.856 ms 2023-10-18T11:21:39.955 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21779 0.21 MB/sec execute 453 sec latency 364.281 ms 2023-10-18T11:21:40.955 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21791 0.21 MB/sec execute 454 sec latency 469.797 ms 2023-10-18T11:21:41.955 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21797 0.21 MB/sec execute 455 sec latency 552.087 ms 2023-10-18T11:21:42.955 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21836 0.21 MB/sec execute 456 sec latency 610.011 ms 2023-10-18T11:21:43.956 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21861 0.21 MB/sec execute 457 sec latency 520.284 ms 2023-10-18T11:21:44.956 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21877 0.21 MB/sec execute 458 sec latency 810.853 ms 2023-10-18T11:21:45.956 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21914 0.21 MB/sec execute 459 sec latency 132.330 ms 2023-10-18T11:21:46.956 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21922 0.21 MB/sec execute 460 sec latency 535.474 ms 2023-10-18T11:21:47.956 INFO:tasks.workunit.client.0.smithi151.stdout: 1 21944 0.21 MB/sec execute 461 sec latency 234.091 ms 2023-10-18T11:21:48.956 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22022 0.21 MB/sec execute 462 sec latency 388.496 ms 2023-10-18T11:21:49.956 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22048 0.21 MB/sec execute 463 sec latency 331.358 ms 2023-10-18T11:21:50.956 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22114 0.21 MB/sec execute 464 sec latency 286.905 ms 2023-10-18T11:21:51.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22151 0.21 MB/sec execute 465 sec latency 399.457 ms 2023-10-18T11:21:52.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22227 0.21 MB/sec execute 466 sec latency 404.337 ms 2023-10-18T11:21:53.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22238 0.20 MB/sec execute 467 sec latency 681.409 ms 2023-10-18T11:21:54.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22303 0.20 MB/sec execute 468 sec latency 273.093 ms 2023-10-18T11:21:55.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22360 0.21 MB/sec execute 469 sec latency 481.452 ms 2023-10-18T11:21:56.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22393 0.21 MB/sec execute 470 sec latency 223.516 ms 2023-10-18T11:21:57.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22428 0.21 MB/sec execute 471 sec latency 282.625 ms 2023-10-18T11:21:58.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22467 0.21 MB/sec execute 472 sec latency 242.782 ms 2023-10-18T11:21:59.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22503 0.20 MB/sec execute 473 sec latency 193.557 ms 2023-10-18T11:22:00.957 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22512 0.20 MB/sec execute 474 sec latency 397.734 ms 2023-10-18T11:22:01.958 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22546 0.20 MB/sec execute 475 sec latency 289.176 ms 2023-10-18T11:22:02.958 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22582 0.20 MB/sec execute 476 sec latency 319.459 ms 2023-10-18T11:22:03.958 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22727 0.21 MB/sec execute 477 sec latency 108.578 ms 2023-10-18T11:22:04.958 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22734 0.21 MB/sec execute 478 sec latency 683.333 ms 2023-10-18T11:22:05.958 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22759 0.21 MB/sec execute 479 sec latency 820.370 ms 2023-10-18T11:22:06.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:22:06.227 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:22:06.958 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22812 0.21 MB/sec execute 480 sec latency 409.634 ms 2023-10-18T11:22:07.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22833 0.21 MB/sec execute 481 sec latency 373.966 ms 2023-10-18T11:22:08.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22854 0.21 MB/sec execute 482 sec latency 354.186 ms 2023-10-18T11:22:09.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22915 0.21 MB/sec execute 483 sec latency 443.534 ms 2023-10-18T11:22:10.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22933 0.21 MB/sec execute 484 sec latency 612.416 ms 2023-10-18T11:22:11.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 22983 0.21 MB/sec execute 485 sec latency 461.708 ms 2023-10-18T11:22:12.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23010 0.21 MB/sec execute 486 sec latency 682.942 ms 2023-10-18T11:22:13.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23016 0.21 MB/sec execute 487 sec latency 864.933 ms 2023-10-18T11:22:14.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23088 0.21 MB/sec execute 488 sec latency 880.758 ms 2023-10-18T11:22:15.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23150 0.20 MB/sec execute 489 sec latency 468.528 ms 2023-10-18T11:22:16.959 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23239 0.20 MB/sec execute 490 sec latency 338.951 ms 2023-10-18T11:22:17.960 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23303 0.20 MB/sec execute 491 sec latency 314.357 ms 2023-10-18T11:22:18.960 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23415 0.20 MB/sec execute 492 sec latency 395.897 ms 2023-10-18T11:22:19.960 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23524 0.20 MB/sec execute 493 sec latency 347.544 ms 2023-10-18T11:22:20.960 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23628 0.21 MB/sec execute 494 sec latency 324.946 ms 2023-10-18T11:22:21.960 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23684 0.21 MB/sec execute 495 sec latency 276.546 ms 2023-10-18T11:22:22.960 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23714 0.21 MB/sec execute 496 sec latency 329.552 ms 2023-10-18T11:22:23.960 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23727 0.20 MB/sec execute 497 sec latency 425.974 ms 2023-10-18T11:22:24.960 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23760 0.20 MB/sec execute 498 sec latency 331.985 ms 2023-10-18T11:22:25.961 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23775 0.20 MB/sec execute 499 sec latency 276.012 ms 2023-10-18T11:22:26.961 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23815 0.21 MB/sec execute 500 sec latency 265.215 ms 2023-10-18T11:22:27.961 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23883 0.21 MB/sec execute 501 sec latency 478.147 ms 2023-10-18T11:22:28.961 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23916 0.20 MB/sec execute 502 sec latency 280.771 ms 2023-10-18T11:22:29.961 INFO:tasks.workunit.client.0.smithi151.stdout: 1 23933 0.20 MB/sec execute 503 sec latency 431.645 ms 2023-10-18T11:22:30.961 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24094 0.21 MB/sec execute 504 sec latency 249.019 ms 2023-10-18T11:22:31.961 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24203 0.21 MB/sec execute 505 sec latency 327.304 ms 2023-10-18T11:22:32.961 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24226 0.21 MB/sec execute 506 sec latency 316.635 ms 2023-10-18T11:22:33.961 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24254 0.21 MB/sec execute 507 sec latency 553.208 ms 2023-10-18T11:22:34.962 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24307 0.21 MB/sec execute 508 sec latency 607.196 ms 2023-10-18T11:22:35.962 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24335 0.21 MB/sec execute 509 sec latency 386.307 ms 2023-10-18T11:22:36.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:22:36.355 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:22:36.962 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24482 0.21 MB/sec execute 510 sec latency 339.955 ms 2023-10-18T11:22:37.962 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24512 0.21 MB/sec execute 511 sec latency 305.263 ms 2023-10-18T11:22:38.962 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24586 0.21 MB/sec execute 512 sec latency 317.660 ms 2023-10-18T11:22:39.962 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24676 0.21 MB/sec execute 513 sec latency 280.963 ms 2023-10-18T11:22:40.962 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24695 0.21 MB/sec execute 514 sec latency 256.227 ms 2023-10-18T11:22:41.962 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24817 0.22 MB/sec execute 515 sec latency 282.031 ms 2023-10-18T11:22:42.963 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24855 0.22 MB/sec execute 516 sec latency 324.711 ms 2023-10-18T11:22:43.963 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24879 0.22 MB/sec execute 517 sec latency 466.631 ms 2023-10-18T11:22:44.963 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24945 0.22 MB/sec execute 518 sec latency 505.780 ms 2023-10-18T11:22:45.963 INFO:tasks.workunit.client.0.smithi151.stdout: 1 24979 0.22 MB/sec execute 519 sec latency 218.999 ms 2023-10-18T11:22:46.963 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25010 0.22 MB/sec execute 520 sec latency 370.201 ms 2023-10-18T11:22:47.963 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25030 0.22 MB/sec execute 521 sec latency 309.694 ms 2023-10-18T11:22:48.963 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25083 0.22 MB/sec execute 522 sec latency 473.055 ms 2023-10-18T11:22:49.963 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25095 0.22 MB/sec execute 523 sec latency 694.310 ms 2023-10-18T11:22:50.964 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25100 0.22 MB/sec execute 524 sec latency 402.378 ms 2023-10-18T11:22:51.964 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25112 0.22 MB/sec execute 525 sec latency 654.107 ms 2023-10-18T11:22:52.964 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25116 0.22 MB/sec execute 526 sec latency 537.137 ms 2023-10-18T11:22:53.964 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25127 0.22 MB/sec execute 527 sec latency 555.514 ms 2023-10-18T11:22:54.964 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25139 0.22 MB/sec execute 528 sec latency 386.663 ms 2023-10-18T11:22:55.964 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25151 0.21 MB/sec execute 529 sec latency 469.339 ms 2023-10-18T11:22:56.964 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25159 0.21 MB/sec execute 530 sec latency 354.450 ms 2023-10-18T11:22:57.964 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25171 0.21 MB/sec execute 531 sec latency 403.555 ms 2023-10-18T11:22:58.964 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25183 0.21 MB/sec execute 532 sec latency 465.134 ms 2023-10-18T11:22:59.965 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25198 0.21 MB/sec execute 533 sec latency 386.393 ms 2023-10-18T11:23:00.965 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25228 0.21 MB/sec execute 534 sec latency 351.569 ms 2023-10-18T11:23:01.965 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25238 0.21 MB/sec execute 535 sec latency 397.967 ms 2023-10-18T11:23:02.965 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25247 0.21 MB/sec execute 536 sec latency 312.341 ms 2023-10-18T11:23:03.965 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25254 0.21 MB/sec execute 537 sec latency 765.637 ms 2023-10-18T11:23:04.965 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25263 0.21 MB/sec execute 538 sec latency 802.647 ms 2023-10-18T11:23:05.965 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25270 0.21 MB/sec execute 539 sec latency 491.994 ms 2023-10-18T11:23:06.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:23:06.483 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:23:06.965 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25282 0.21 MB/sec execute 540 sec latency 287.398 ms 2023-10-18T11:23:07.966 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25297 0.21 MB/sec execute 541 sec latency 434.611 ms 2023-10-18T11:23:08.966 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25306 0.21 MB/sec execute 542 sec latency 453.188 ms 2023-10-18T11:23:09.966 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25317 0.21 MB/sec execute 543 sec latency 381.970 ms 2023-10-18T11:23:10.966 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25329 0.21 MB/sec execute 544 sec latency 316.805 ms 2023-10-18T11:23:11.966 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25343 0.21 MB/sec execute 545 sec latency 355.516 ms 2023-10-18T11:23:12.966 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25354 0.21 MB/sec execute 546 sec latency 614.724 ms 2023-10-18T11:23:13.966 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25405 0.21 MB/sec execute 547 sec latency 176.848 ms 2023-10-18T11:23:14.966 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25429 0.21 MB/sec execute 548 sec latency 230.122 ms 2023-10-18T11:23:15.966 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25466 0.21 MB/sec execute 549 sec latency 196.709 ms 2023-10-18T11:23:16.967 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25483 0.21 MB/sec execute 550 sec latency 236.811 ms 2023-10-18T11:23:17.967 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25541 0.21 MB/sec execute 551 sec latency 284.264 ms 2023-10-18T11:23:18.967 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25597 0.21 MB/sec execute 552 sec latency 335.329 ms 2023-10-18T11:23:19.967 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25664 0.21 MB/sec execute 553 sec latency 291.673 ms 2023-10-18T11:23:20.967 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25697 0.21 MB/sec execute 554 sec latency 475.895 ms 2023-10-18T11:23:21.967 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25748 0.21 MB/sec execute 555 sec latency 362.603 ms 2023-10-18T11:23:22.967 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25787 0.21 MB/sec execute 556 sec latency 356.237 ms 2023-10-18T11:23:23.967 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25843 0.21 MB/sec execute 557 sec latency 325.212 ms 2023-10-18T11:23:24.968 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25874 0.21 MB/sec execute 558 sec latency 426.802 ms 2023-10-18T11:23:25.968 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25924 0.21 MB/sec execute 559 sec latency 545.873 ms 2023-10-18T11:23:26.968 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25946 0.21 MB/sec execute 560 sec latency 323.801 ms 2023-10-18T11:23:27.968 INFO:tasks.workunit.client.0.smithi151.stdout: 1 25998 0.21 MB/sec execute 561 sec latency 286.480 ms 2023-10-18T11:23:28.968 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26030 0.21 MB/sec execute 562 sec latency 196.980 ms 2023-10-18T11:23:29.968 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26058 0.21 MB/sec execute 563 sec latency 248.655 ms 2023-10-18T11:23:30.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26092 0.21 MB/sec execute 564 sec latency 383.206 ms 2023-10-18T11:23:31.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26125 0.21 MB/sec execute 565 sec latency 244.300 ms 2023-10-18T11:23:32.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26276 0.21 MB/sec execute 566 sec latency 200.568 ms 2023-10-18T11:23:33.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26299 0.21 MB/sec execute 567 sec latency 609.419 ms 2023-10-18T11:23:34.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26322 0.21 MB/sec execute 568 sec latency 495.715 ms 2023-10-18T11:23:35.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26368 0.21 MB/sec execute 569 sec latency 389.748 ms 2023-10-18T11:23:36.603 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:23:36.613 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:23:36.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26398 0.21 MB/sec execute 570 sec latency 290.971 ms 2023-10-18T11:23:37.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26434 0.21 MB/sec execute 571 sec latency 376.512 ms 2023-10-18T11:23:38.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26469 0.21 MB/sec execute 572 sec latency 552.351 ms 2023-10-18T11:23:39.969 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26524 0.21 MB/sec execute 573 sec latency 560.291 ms 2023-10-18T11:23:40.970 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26561 0.21 MB/sec execute 574 sec latency 522.801 ms 2023-10-18T11:23:41.970 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26570 0.21 MB/sec execute 575 sec latency 585.064 ms 2023-10-18T11:23:42.970 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26580 0.21 MB/sec execute 576 sec latency 720.455 ms 2023-10-18T11:23:43.971 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26701 0.21 MB/sec execute 577 sec latency 318.476 ms 2023-10-18T11:23:44.970 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26749 0.21 MB/sec execute 578 sec latency 446.674 ms 2023-10-18T11:23:45.970 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26854 0.21 MB/sec execute 579 sec latency 265.121 ms 2023-10-18T11:23:46.970 INFO:tasks.workunit.client.0.smithi151.stdout: 1 26966 0.21 MB/sec execute 580 sec latency 411.169 ms 2023-10-18T11:23:47.971 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27059 0.21 MB/sec execute 581 sec latency 369.177 ms 2023-10-18T11:23:48.970 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27172 0.21 MB/sec execute 582 sec latency 264.943 ms 2023-10-18T11:23:49.971 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27234 0.21 MB/sec execute 583 sec latency 203.022 ms 2023-10-18T11:23:50.971 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27265 0.21 MB/sec execute 584 sec latency 325.468 ms 2023-10-18T11:23:51.971 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27283 0.21 MB/sec execute 585 sec latency 284.234 ms 2023-10-18T11:23:52.971 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27310 0.21 MB/sec execute 586 sec latency 445.511 ms 2023-10-18T11:23:53.971 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27325 0.21 MB/sec execute 587 sec latency 324.963 ms 2023-10-18T11:23:54.971 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27365 0.21 MB/sec execute 588 sec latency 264.038 ms 2023-10-18T11:23:55.971 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27432 0.21 MB/sec execute 589 sec latency 471.519 ms 2023-10-18T11:23:56.972 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27456 0.21 MB/sec execute 590 sec latency 276.066 ms 2023-10-18T11:23:57.972 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27478 0.21 MB/sec execute 591 sec latency 355.717 ms 2023-10-18T11:23:58.972 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27636 0.21 MB/sec execute 592 sec latency 340.891 ms 2023-10-18T11:23:59.972 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27751 0.21 MB/sec execute 593 sec latency 175.294 ms 2023-10-18T11:24:00.972 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27773 0.21 MB/sec execute 594 sec latency 336.607 ms 2023-10-18T11:24:01.973 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27805 0.21 MB/sec execute 595 sec latency 322.693 ms 2023-10-18T11:24:02.972 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27855 0.21 MB/sec execute 596 sec latency 302.609 ms 2023-10-18T11:24:03.972 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27883 0.21 MB/sec execute 597 sec latency 371.772 ms 2023-10-18T11:24:04.973 INFO:tasks.workunit.client.0.smithi151.stdout: 1 27896 0.21 MB/sec execute 598 sec latency 565.999 ms 2023-10-18T11:24:05.973 INFO:tasks.workunit.client.0.smithi151.stdout: 1 28047 0.21 MB/sec execute 599 sec latency 350.657 ms 2023-10-18T11:24:06.742 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:24:06.754 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:24:06.973 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 600 sec 2023-10-18T11:24:07.973 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 601 sec 2023-10-18T11:24:08.973 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 602 sec 2023-10-18T11:24:09.973 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 603 sec 2023-10-18T11:24:10.973 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 604 sec 2023-10-18T11:24:11.973 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 605 sec 2023-10-18T11:24:12.974 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 606 sec 2023-10-18T11:24:13.974 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 607 sec 2023-10-18T11:24:14.974 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 608 sec 2023-10-18T11:24:15.933 INFO:tasks.workunit.client.0.smithi151.stdout: 0 cleanup 609 sec 2023-10-18T11:24:15.933 INFO:tasks.workunit.client.0.smithi151.stdout: 2023-10-18T11:24:15.934 INFO:tasks.workunit.client.0.smithi151.stdout: Operation Count AvgLat MaxLat 2023-10-18T11:24:15.934 INFO:tasks.workunit.client.0.smithi151.stdout: ---------------------------------------- 2023-10-18T11:24:15.934 INFO:tasks.workunit.client.0.smithi151.stdout: NTCreateX 4043 70.621 4719.868 2023-10-18T11:24:15.935 INFO:tasks.workunit.client.0.smithi151.stdout: Close 3004 0.015 1.460 2023-10-18T11:24:15.935 INFO:tasks.workunit.client.0.smithi151.stdout: Rename 175 316.042 1217.690 2023-10-18T11:24:15.935 INFO:tasks.workunit.client.0.smithi151.stdout: Unlink 785 87.182 535.444 2023-10-18T11:24:15.935 INFO:tasks.workunit.client.0.smithi151.stdout: Qpathinfo 3708 42.320 630.651 2023-10-18T11:24:15.936 INFO:tasks.workunit.client.0.smithi151.stdout: Qfileinfo 662 0.006 0.060 2023-10-18T11:24:15.936 INFO:tasks.workunit.client.0.smithi151.stdout: Qfsinfo 655 10.791 313.931 2023-10-18T11:24:15.936 INFO:tasks.workunit.client.0.smithi151.stdout: Sfileinfo 335 9.012 425.885 2023-10-18T11:24:15.937 INFO:tasks.workunit.client.0.smithi151.stdout: Find 1404 5.135 821.406 2023-10-18T11:24:15.937 INFO:tasks.workunit.client.0.smithi151.stdout: WriteX 2019 1.158 190.296 2023-10-18T11:24:15.937 INFO:tasks.workunit.client.0.smithi151.stdout: ReadX 6488 0.327 88.317 2023-10-18T11:24:15.937 INFO:tasks.workunit.client.0.smithi151.stdout: LockX 14 49.944 107.142 2023-10-18T11:24:15.938 INFO:tasks.workunit.client.0.smithi151.stdout: UnlockX 14 42.503 93.915 2023-10-18T11:24:15.938 INFO:tasks.workunit.client.0.smithi151.stdout: Flush 275 39.359 211.855 2023-10-18T11:24:15.938 INFO:tasks.workunit.client.0.smithi151.stdout: 2023-10-18T11:24:15.939 INFO:tasks.workunit.client.0.smithi151.stdout:Throughput 0.212215 MB/sec 1 clients 1 procs max_latency=4719.884 ms 2023-10-18T11:24:15.939 INFO:tasks.workunit.client.0.smithi151.stderr:+ dbench 10 2023-10-18T11:24:15.940 INFO:tasks.workunit.client.0.smithi151.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-10-18T11:24:15.940 INFO:tasks.workunit.client.0.smithi151.stdout: 2023-10-18T11:24:15.940 INFO:tasks.workunit.client.0.smithi151.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-10-18T11:24:15.942 INFO:tasks.workunit.client.0.smithi151.stdout:9 of 10 processes prepared for launch 0 sec 2023-10-18T11:24:16.043 INFO:tasks.workunit.client.0.smithi151.stdout:10 of 10 processes prepared for launch 0 sec 2023-10-18T11:24:16.043 INFO:tasks.workunit.client.0.smithi151.stdout:releasing clients 2023-10-18T11:24:17.042 INFO:tasks.workunit.client.0.smithi151.stdout: 0 3 0.00 MB/sec warmup 1 sec latency 999.747 ms 2023-10-18T11:24:18.042 INFO:tasks.workunit.client.0.smithi151.stdout: 1 6 0.52 MB/sec warmup 2 sec latency 1999.837 ms 2023-10-18T11:24:19.042 INFO:tasks.workunit.client.0.smithi151.stdout: 2 15 1.75 MB/sec warmup 3 sec latency 2999.977 ms 2023-10-18T11:24:20.042 INFO:tasks.workunit.client.0.smithi151.stdout: 4 22 2.10 MB/sec warmup 4 sec latency 3837.154 ms 2023-10-18T11:24:21.043 INFO:tasks.workunit.client.0.smithi151.stdout: 5 29 2.31 MB/sec warmup 5 sec latency 4837.246 ms 2023-10-18T11:24:22.043 INFO:tasks.workunit.client.0.smithi151.stdout: 6 43 2.97 MB/sec warmup 6 sec latency 5817.405 ms 2023-10-18T11:24:22.077 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:15:38.172 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:24:22.082 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:15:38.176 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:24:22.150 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:15:38.319 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:24:22.151 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:15:38.319 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:24:22.153 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:15:38.322 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:24:22.154 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:15:38.323 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:24:22.235 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:15:38.403 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:24:22.236 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:15:38.404 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:24:22.243 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:15:38.338 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:24:23.043 INFO:tasks.workunit.client.0.smithi151.stdout: 7 53 3.18 MB/sec warmup 7 sec latency 1526.686 ms 2023-10-18T11:24:24.043 INFO:tasks.workunit.client.0.smithi151.stdout: 9 62 3.31 MB/sec warmup 8 sec latency 1412.613 ms 2023-10-18T11:24:25.043 INFO:tasks.workunit.client.0.smithi151.stdout: 10 71 3.47 MB/sec warmup 9 sec latency 1836.294 ms 2023-10-18T11:24:26.043 INFO:tasks.workunit.client.0.smithi151.stdout: 10 77 3.43 MB/sec warmup 10 sec latency 2570.953 ms 2023-10-18T11:24:27.043 INFO:tasks.workunit.client.0.smithi151.stdout: 10 90 3.67 MB/sec warmup 11 sec latency 2681.580 ms 2023-10-18T11:24:28.043 INFO:tasks.workunit.client.0.smithi151.stdout: 10 95 3.56 MB/sec warmup 12 sec latency 1838.144 ms 2023-10-18T11:24:29.043 INFO:tasks.workunit.client.0.smithi151.stdout: 10 102 3.51 MB/sec warmup 13 sec latency 2471.625 ms 2023-10-18T11:24:30.044 INFO:tasks.workunit.client.0.smithi151.stdout: 10 110 3.54 MB/sec warmup 14 sec latency 2665.295 ms 2023-10-18T11:24:31.044 INFO:tasks.workunit.client.0.smithi151.stdout: 10 111 3.32 MB/sec warmup 15 sec latency 2706.851 ms 2023-10-18T11:24:32.044 INFO:tasks.workunit.client.0.smithi151.stdout: 10 117 3.27 MB/sec warmup 16 sec latency 3357.468 ms 2023-10-18T11:24:33.044 INFO:tasks.workunit.client.0.smithi151.stdout: 10 127 3.30 MB/sec warmup 17 sec latency 3634.897 ms 2023-10-18T11:24:34.044 INFO:tasks.workunit.client.0.smithi151.stdout: 10 128 3.13 MB/sec warmup 18 sec latency 2304.784 ms 2023-10-18T11:24:35.044 INFO:tasks.workunit.client.0.smithi151.stdout: 10 132 3.06 MB/sec warmup 19 sec latency 2721.133 ms 2023-10-18T11:24:36.044 INFO:tasks.workunit.client.0.smithi151.stdout: 10 134 2.93 MB/sec warmup 20 sec latency 3721.256 ms 2023-10-18T11:24:36.889 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:24:36.899 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:24:37.044 INFO:tasks.workunit.client.0.smithi151.stdout: 10 142 2.93 MB/sec warmup 21 sec latency 4656.164 ms 2023-10-18T11:24:38.045 INFO:tasks.workunit.client.0.smithi151.stdout: 10 143 2.82 MB/sec warmup 22 sec latency 2509.879 ms 2023-10-18T11:24:39.045 INFO:tasks.workunit.client.0.smithi151.stdout: 10 148 2.75 MB/sec warmup 23 sec latency 2741.495 ms 2023-10-18T11:24:40.045 INFO:tasks.workunit.client.0.smithi151.stdout: 10 149 2.65 MB/sec warmup 24 sec latency 3741.675 ms 2023-10-18T11:24:41.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 150 2.55 MB/sec warmup 25 sec latency 4741.803 ms 2023-10-18T11:24:42.045 INFO:tasks.workunit.client.0.smithi151.stdout: 10 154 2.51 MB/sec warmup 26 sec latency 5741.898 ms 2023-10-18T11:24:43.045 INFO:tasks.workunit.client.0.smithi151.stdout: 10 159 2.47 MB/sec warmup 27 sec latency 6062.614 ms 2023-10-18T11:24:44.045 INFO:tasks.workunit.client.0.smithi151.stdout: 10 162 2.41 MB/sec warmup 28 sec latency 6416.039 ms 2023-10-18T11:24:45.046 INFO:tasks.workunit.client.0.smithi151.stdout: 10 169 2.40 MB/sec warmup 29 sec latency 4985.651 ms 2023-10-18T11:24:46.046 INFO:tasks.workunit.client.0.smithi151.stdout: 10 173 2.37 MB/sec warmup 30 sec latency 5985.797 ms 2023-10-18T11:24:47.046 INFO:tasks.workunit.client.0.smithi151.stdout: 10 175 2.31 MB/sec warmup 31 sec latency 6985.958 ms 2023-10-18T11:24:48.046 INFO:tasks.workunit.client.0.smithi151.stdout: 10 179 2.28 MB/sec warmup 32 sec latency 7986.108 ms 2023-10-18T11:24:49.046 INFO:tasks.workunit.client.0.smithi151.stdout: 10 185 2.27 MB/sec warmup 33 sec latency 8629.327 ms 2023-10-18T11:24:50.046 INFO:tasks.workunit.client.0.smithi151.stdout: 10 190 2.24 MB/sec warmup 34 sec latency 5039.262 ms 2023-10-18T11:24:51.046 INFO:tasks.workunit.client.0.smithi151.stdout: 10 198 2.25 MB/sec warmup 35 sec latency 6039.384 ms 2023-10-18T11:24:52.046 INFO:tasks.workunit.client.0.smithi151.stdout: 10 204 2.24 MB/sec warmup 36 sec latency 7039.468 ms 2023-10-18T11:24:53.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 215 2.27 MB/sec warmup 37 sec latency 7247.643 ms 2023-10-18T11:24:54.046 INFO:tasks.workunit.client.0.smithi151.stdout: 10 227 2.31 MB/sec warmup 38 sec latency 4741.486 ms 2023-10-18T11:24:55.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 244 2.39 MB/sec warmup 39 sec latency 5741.576 ms 2023-10-18T11:24:56.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 260 2.45 MB/sec warmup 40 sec latency 6741.677 ms 2023-10-18T11:24:57.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 283 2.58 MB/sec warmup 41 sec latency 6751.979 ms 2023-10-18T11:24:58.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 318 2.75 MB/sec warmup 42 sec latency 841.667 ms 2023-10-18T11:24:59.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 348 2.86 MB/sec warmup 43 sec latency 832.369 ms 2023-10-18T11:25:00.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 382 2.98 MB/sec warmup 44 sec latency 762.576 ms 2023-10-18T11:25:01.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 404 3.02 MB/sec warmup 45 sec latency 921.014 ms 2023-10-18T11:25:02.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 432 3.10 MB/sec warmup 46 sec latency 943.568 ms 2023-10-18T11:25:03.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 456 3.14 MB/sec warmup 47 sec latency 993.410 ms 2023-10-18T11:25:04.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 488 3.22 MB/sec warmup 48 sec latency 849.102 ms 2023-10-18T11:25:05.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 515 3.24 MB/sec warmup 49 sec latency 1003.172 ms 2023-10-18T11:25:06.047 INFO:tasks.workunit.client.0.smithi151.stdout: 10 542 3.26 MB/sec warmup 50 sec latency 1197.688 ms 2023-10-18T11:25:07.044 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:25:07.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:25:07.051 INFO:tasks.workunit.client.0.smithi151.stdout: 10 580 3.29 MB/sec warmup 51 sec latency 789.961 ms 2023-10-18T11:25:08.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 599 3.28 MB/sec warmup 52 sec latency 1437.316 ms 2023-10-18T11:25:09.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 625 3.30 MB/sec warmup 53 sec latency 1788.196 ms 2023-10-18T11:25:10.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 676 3.38 MB/sec warmup 54 sec latency 2013.794 ms 2023-10-18T11:25:11.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 715 3.39 MB/sec warmup 55 sec latency 949.890 ms 2023-10-18T11:25:12.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 768 3.42 MB/sec warmup 56 sec latency 1333.252 ms 2023-10-18T11:25:13.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 783 3.38 MB/sec warmup 57 sec latency 1384.292 ms 2023-10-18T11:25:14.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 798 3.32 MB/sec warmup 58 sec latency 1948.452 ms 2023-10-18T11:25:15.048 INFO:tasks.workunit.client.0.smithi151.stdout: 10 843 3.31 MB/sec warmup 59 sec latency 2948.538 ms 2023-10-18T11:25:16.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 869 3.27 MB/sec warmup 60 sec latency 3948.630 ms 2023-10-18T11:25:17.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 892 3.25 MB/sec warmup 61 sec latency 4140.760 ms 2023-10-18T11:25:18.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 946 3.33 MB/sec warmup 62 sec latency 1472.734 ms 2023-10-18T11:25:19.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1010 3.38 MB/sec warmup 63 sec latency 851.780 ms 2023-10-18T11:25:20.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1059 3.38 MB/sec warmup 64 sec latency 613.961 ms 2023-10-18T11:25:21.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1105 3.35 MB/sec warmup 65 sec latency 792.989 ms 2023-10-18T11:25:22.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1171 3.43 MB/sec warmup 66 sec latency 1584.033 ms 2023-10-18T11:25:23.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1204 3.44 MB/sec warmup 67 sec latency 2348.597 ms 2023-10-18T11:25:24.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1232 3.40 MB/sec warmup 68 sec latency 761.637 ms 2023-10-18T11:25:25.049 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1248 3.36 MB/sec warmup 69 sec latency 1389.268 ms 2023-10-18T11:25:26.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1280 3.34 MB/sec warmup 70 sec latency 2389.404 ms 2023-10-18T11:25:27.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1302 3.31 MB/sec warmup 71 sec latency 2838.736 ms 2023-10-18T11:25:28.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1337 3.29 MB/sec warmup 72 sec latency 885.966 ms 2023-10-18T11:25:29.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1371 3.26 MB/sec warmup 73 sec latency 818.271 ms 2023-10-18T11:25:30.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1394 3.23 MB/sec warmup 74 sec latency 826.033 ms 2023-10-18T11:25:31.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1440 3.25 MB/sec warmup 75 sec latency 1066.105 ms 2023-10-18T11:25:32.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1482 3.24 MB/sec warmup 76 sec latency 1614.476 ms 2023-10-18T11:25:33.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1508 3.21 MB/sec warmup 77 sec latency 2082.486 ms 2023-10-18T11:25:34.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1550 3.22 MB/sec warmup 78 sec latency 1531.670 ms 2023-10-18T11:25:35.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1570 3.20 MB/sec warmup 79 sec latency 2204.046 ms 2023-10-18T11:25:36.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1603 3.20 MB/sec warmup 80 sec latency 2474.241 ms 2023-10-18T11:25:37.050 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1640 3.18 MB/sec warmup 81 sec latency 2816.144 ms 2023-10-18T11:25:37.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:25:37.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:25:38.051 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1678 3.18 MB/sec warmup 82 sec latency 1426.401 ms 2023-10-18T11:25:39.051 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1710 3.16 MB/sec warmup 83 sec latency 716.104 ms 2023-10-18T11:25:40.051 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1730 3.16 MB/sec warmup 84 sec latency 1716.486 ms 2023-10-18T11:25:41.051 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1753 3.14 MB/sec warmup 85 sec latency 1911.060 ms 2023-10-18T11:25:42.051 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1784 3.13 MB/sec warmup 86 sec latency 903.292 ms 2023-10-18T11:25:43.051 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1805 3.10 MB/sec warmup 87 sec latency 937.099 ms 2023-10-18T11:25:44.051 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1845 3.10 MB/sec warmup 88 sec latency 967.510 ms 2023-10-18T11:25:45.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1876 3.08 MB/sec warmup 89 sec latency 1001.102 ms 2023-10-18T11:25:46.054 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1925 3.08 MB/sec warmup 90 sec latency 1319.923 ms 2023-10-18T11:25:47.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1958 3.07 MB/sec warmup 91 sec latency 1075.710 ms 2023-10-18T11:25:48.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1977 3.05 MB/sec warmup 92 sec latency 1178.462 ms 2023-10-18T11:25:49.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 1999 3.02 MB/sec warmup 93 sec latency 943.452 ms 2023-10-18T11:25:50.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2022 2.99 MB/sec warmup 94 sec latency 1012.435 ms 2023-10-18T11:25:51.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2041 2.96 MB/sec warmup 95 sec latency 887.340 ms 2023-10-18T11:25:52.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2062 2.94 MB/sec warmup 96 sec latency 902.855 ms 2023-10-18T11:25:53.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2081 2.91 MB/sec warmup 97 sec latency 703.209 ms 2023-10-18T11:25:54.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2115 2.90 MB/sec warmup 98 sec latency 991.437 ms 2023-10-18T11:25:55.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2142 2.87 MB/sec warmup 99 sec latency 1389.155 ms 2023-10-18T11:25:56.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2161 2.84 MB/sec warmup 100 sec latency 1242.206 ms 2023-10-18T11:25:57.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2190 2.83 MB/sec warmup 101 sec latency 1520.507 ms 2023-10-18T11:25:58.053 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2210 2.80 MB/sec warmup 102 sec latency 1048.889 ms 2023-10-18T11:25:59.052 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2244 2.79 MB/sec warmup 103 sec latency 1134.693 ms 2023-10-18T11:26:00.053 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2278 2.77 MB/sec warmup 104 sec latency 1140.887 ms 2023-10-18T11:26:01.053 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2309 2.77 MB/sec warmup 105 sec latency 1298.287 ms 2023-10-18T11:26:02.053 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2345 2.75 MB/sec warmup 106 sec latency 1108.446 ms 2023-10-18T11:26:03.054 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2368 2.77 MB/sec warmup 107 sec latency 1276.370 ms 2023-10-18T11:26:04.054 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2404 2.77 MB/sec warmup 108 sec latency 1460.713 ms 2023-10-18T11:26:05.054 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2423 2.75 MB/sec warmup 109 sec latency 1362.792 ms 2023-10-18T11:26:06.054 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2425 2.72 MB/sec warmup 110 sec latency 2362.865 ms 2023-10-18T11:26:07.054 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2434 2.71 MB/sec warmup 111 sec latency 3363.003 ms 2023-10-18T11:26:07.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:26:07.315 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:26:07.389 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:17:23.483 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:26:07.392 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:17:23.487 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:26:07.441 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:17:23.609 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:26:07.446 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:17:23.615 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:26:07.447 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:17:23.615 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:26:07.449 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:17:23.618 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:26:07.462 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:17:23.556 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:26:07.494 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:17:23.662 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:26:07.497 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:17:23.665 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:26:08.054 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2458 2.71 MB/sec warmup 112 sec latency 3746.448 ms 2023-10-18T11:26:09.054 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2474 2.69 MB/sec warmup 113 sec latency 4746.526 ms 2023-10-18T11:26:10.054 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2499 2.67 MB/sec warmup 114 sec latency 5654.137 ms 2023-10-18T11:26:11.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2532 2.68 MB/sec warmup 115 sec latency 1643.349 ms 2023-10-18T11:26:12.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2563 2.66 MB/sec warmup 116 sec latency 2390.126 ms 2023-10-18T11:26:13.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2602 2.66 MB/sec warmup 117 sec latency 1100.496 ms 2023-10-18T11:26:14.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2649 2.64 MB/sec warmup 118 sec latency 809.413 ms 2023-10-18T11:26:15.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2704 2.63 MB/sec warmup 119 sec latency 1061.239 ms 2023-10-18T11:26:17.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2786 0.18 MB/sec execute 1 sec latency 917.693 ms 2023-10-18T11:26:18.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2815 0.51 MB/sec execute 2 sec latency 1460.025 ms 2023-10-18T11:26:19.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2878 1.99 MB/sec execute 3 sec latency 749.126 ms 2023-10-18T11:26:20.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2920 1.66 MB/sec execute 4 sec latency 1319.873 ms 2023-10-18T11:26:21.055 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2961 1.61 MB/sec execute 5 sec latency 2130.761 ms 2023-10-18T11:26:22.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 2986 1.43 MB/sec execute 6 sec latency 1001.266 ms 2023-10-18T11:26:23.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3018 1.76 MB/sec execute 7 sec latency 2001.347 ms 2023-10-18T11:26:24.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3046 1.60 MB/sec execute 8 sec latency 3001.433 ms 2023-10-18T11:26:25.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3077 1.81 MB/sec execute 9 sec latency 4001.505 ms 2023-10-18T11:26:26.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3102 1.94 MB/sec execute 10 sec latency 4407.220 ms 2023-10-18T11:26:27.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3113 1.77 MB/sec execute 11 sec latency 3333.774 ms 2023-10-18T11:26:28.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3123 1.63 MB/sec execute 12 sec latency 4333.851 ms 2023-10-18T11:26:29.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3128 1.51 MB/sec execute 13 sec latency 4945.583 ms 2023-10-18T11:26:30.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3144 1.41 MB/sec execute 14 sec latency 4362.460 ms 2023-10-18T11:26:31.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3193 1.54 MB/sec execute 15 sec latency 2208.582 ms 2023-10-18T11:26:32.056 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3244 1.50 MB/sec execute 16 sec latency 2010.998 ms 2023-10-18T11:26:33.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3282 1.53 MB/sec execute 17 sec latency 1536.537 ms 2023-10-18T11:26:34.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3335 1.52 MB/sec execute 18 sec latency 1355.167 ms 2023-10-18T11:26:35.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3364 1.59 MB/sec execute 19 sec latency 1475.737 ms 2023-10-18T11:26:36.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3390 1.56 MB/sec execute 20 sec latency 1601.209 ms 2023-10-18T11:26:37.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3413 1.57 MB/sec execute 21 sec latency 1889.446 ms 2023-10-18T11:26:37.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:26:37.450 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:26:38.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3447 1.69 MB/sec execute 22 sec latency 1426.255 ms 2023-10-18T11:26:39.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3477 1.67 MB/sec execute 23 sec latency 1069.142 ms 2023-10-18T11:26:40.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3506 1.64 MB/sec execute 24 sec latency 1077.880 ms 2023-10-18T11:26:41.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3534 1.60 MB/sec execute 25 sec latency 1813.315 ms 2023-10-18T11:26:42.057 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3579 1.62 MB/sec execute 26 sec latency 892.714 ms 2023-10-18T11:26:43.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3594 1.56 MB/sec execute 27 sec latency 1892.800 ms 2023-10-18T11:26:44.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3622 1.64 MB/sec execute 28 sec latency 2892.870 ms 2023-10-18T11:26:45.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3641 1.60 MB/sec execute 29 sec latency 3406.094 ms 2023-10-18T11:26:46.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3652 1.56 MB/sec execute 30 sec latency 3319.665 ms 2023-10-18T11:26:47.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3676 1.53 MB/sec execute 31 sec latency 3602.074 ms 2023-10-18T11:26:48.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3695 1.52 MB/sec execute 32 sec latency 3886.793 ms 2023-10-18T11:26:49.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3749 1.58 MB/sec execute 33 sec latency 4487.198 ms 2023-10-18T11:26:50.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3786 1.58 MB/sec execute 34 sec latency 4667.933 ms 2023-10-18T11:26:51.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3814 1.57 MB/sec execute 35 sec latency 1477.438 ms 2023-10-18T11:26:52.058 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3862 1.68 MB/sec execute 36 sec latency 882.919 ms 2023-10-18T11:26:53.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3906 1.77 MB/sec execute 37 sec latency 878.786 ms 2023-10-18T11:26:54.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3931 1.81 MB/sec execute 38 sec latency 1211.335 ms 2023-10-18T11:26:55.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3951 1.77 MB/sec execute 39 sec latency 732.160 ms 2023-10-18T11:26:56.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3978 1.80 MB/sec execute 40 sec latency 1219.373 ms 2023-10-18T11:26:57.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 3991 1.78 MB/sec execute 41 sec latency 1422.363 ms 2023-10-18T11:26:58.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4016 1.76 MB/sec execute 42 sec latency 893.218 ms 2023-10-18T11:26:59.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4038 1.74 MB/sec execute 43 sec latency 630.719 ms 2023-10-18T11:27:00.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4066 1.72 MB/sec execute 44 sec latency 916.164 ms 2023-10-18T11:27:01.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4088 1.70 MB/sec execute 45 sec latency 857.538 ms 2023-10-18T11:27:02.059 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4118 1.74 MB/sec execute 46 sec latency 864.841 ms 2023-10-18T11:27:03.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4147 1.81 MB/sec execute 47 sec latency 1468.968 ms 2023-10-18T11:27:04.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4166 1.78 MB/sec execute 48 sec latency 1573.504 ms 2023-10-18T11:27:05.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4187 1.76 MB/sec execute 49 sec latency 2383.444 ms 2023-10-18T11:27:06.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4232 1.77 MB/sec execute 50 sec latency 1125.038 ms 2023-10-18T11:27:07.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4271 1.76 MB/sec execute 51 sec latency 1054.309 ms 2023-10-18T11:27:07.558 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:27:07.565 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:27:08.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4304 1.80 MB/sec execute 52 sec latency 1322.172 ms 2023-10-18T11:27:09.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4340 1.78 MB/sec execute 53 sec latency 921.132 ms 2023-10-18T11:27:10.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4365 1.77 MB/sec execute 54 sec latency 1044.330 ms 2023-10-18T11:27:11.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4390 1.76 MB/sec execute 55 sec latency 1505.454 ms 2023-10-18T11:27:12.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4407 1.73 MB/sec execute 56 sec latency 2505.566 ms 2023-10-18T11:27:13.060 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4454 1.72 MB/sec execute 57 sec latency 2670.706 ms 2023-10-18T11:27:14.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4489 1.71 MB/sec execute 58 sec latency 3413.375 ms 2023-10-18T11:27:15.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4516 1.75 MB/sec execute 59 sec latency 3606.460 ms 2023-10-18T11:27:16.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4541 1.73 MB/sec execute 60 sec latency 1392.988 ms 2023-10-18T11:27:17.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4567 1.73 MB/sec execute 61 sec latency 1257.545 ms 2023-10-18T11:27:18.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4580 1.70 MB/sec execute 62 sec latency 1112.555 ms 2023-10-18T11:27:19.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4607 1.73 MB/sec execute 63 sec latency 1296.232 ms 2023-10-18T11:27:20.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4622 1.71 MB/sec execute 64 sec latency 1174.528 ms 2023-10-18T11:27:21.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4647 1.74 MB/sec execute 65 sec latency 1032.534 ms 2023-10-18T11:27:22.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4672 1.73 MB/sec execute 66 sec latency 1066.700 ms 2023-10-18T11:27:23.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4687 1.72 MB/sec execute 67 sec latency 1360.645 ms 2023-10-18T11:27:24.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4702 1.70 MB/sec execute 68 sec latency 1564.276 ms 2023-10-18T11:27:25.061 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4713 1.67 MB/sec execute 69 sec latency 1412.852 ms 2023-10-18T11:27:26.062 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4731 1.69 MB/sec execute 70 sec latency 1304.841 ms 2023-10-18T11:27:27.062 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4743 1.68 MB/sec execute 71 sec latency 1603.331 ms 2023-10-18T11:27:28.062 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4772 1.66 MB/sec execute 72 sec latency 2026.933 ms 2023-10-18T11:27:29.062 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4782 1.64 MB/sec execute 73 sec latency 1495.098 ms 2023-10-18T11:27:30.062 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4790 1.62 MB/sec execute 74 sec latency 1366.410 ms 2023-10-18T11:27:31.062 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4801 1.60 MB/sec execute 75 sec latency 1200.417 ms 2023-10-18T11:27:32.062 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4814 1.62 MB/sec execute 76 sec latency 1482.816 ms 2023-10-18T11:27:33.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4829 1.62 MB/sec execute 77 sec latency 2160.991 ms 2023-10-18T11:27:34.062 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4844 1.63 MB/sec execute 78 sec latency 2863.191 ms 2023-10-18T11:27:35.062 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4872 1.62 MB/sec execute 79 sec latency 3154.345 ms 2023-10-18T11:27:36.063 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4888 1.62 MB/sec execute 80 sec latency 3176.648 ms 2023-10-18T11:27:37.063 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4924 1.60 MB/sec execute 81 sec latency 1977.883 ms 2023-10-18T11:27:38.063 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4958 1.62 MB/sec execute 82 sec latency 2039.006 ms 2023-10-18T11:27:38.608 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:27:38.617 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:27:39.063 INFO:tasks.workunit.client.0.smithi151.stdout: 10 4984 1.64 MB/sec execute 83 sec latency 949.212 ms 2023-10-18T11:27:40.063 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5026 1.67 MB/sec execute 84 sec latency 1359.828 ms 2023-10-18T11:27:41.063 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5048 1.65 MB/sec execute 85 sec latency 1024.487 ms 2023-10-18T11:27:42.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5080 1.66 MB/sec execute 86 sec latency 1271.191 ms 2023-10-18T11:27:43.064 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5099 1.64 MB/sec execute 87 sec latency 963.535 ms 2023-10-18T11:27:44.064 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5122 1.64 MB/sec execute 88 sec latency 979.137 ms 2023-10-18T11:27:45.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5153 1.63 MB/sec execute 89 sec latency 971.587 ms 2023-10-18T11:27:46.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5173 1.61 MB/sec execute 90 sec latency 1094.514 ms 2023-10-18T11:27:47.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5192 1.59 MB/sec execute 91 sec latency 1032.698 ms 2023-10-18T11:27:48.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5215 1.58 MB/sec execute 92 sec latency 885.392 ms 2023-10-18T11:27:49.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5243 1.59 MB/sec execute 93 sec latency 1249.849 ms 2023-10-18T11:27:50.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5272 1.57 MB/sec execute 94 sec latency 1088.350 ms 2023-10-18T11:27:51.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5295 1.56 MB/sec execute 95 sec latency 1146.901 ms 2023-10-18T11:27:52.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5336 1.58 MB/sec execute 96 sec latency 867.185 ms 2023-10-18T11:27:53.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5365 1.57 MB/sec execute 97 sec latency 1514.481 ms 2023-10-18T11:27:54.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5401 1.55 MB/sec execute 98 sec latency 912.509 ms 2023-10-18T11:27:55.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5435 1.55 MB/sec execute 99 sec latency 1146.119 ms 2023-10-18T11:27:56.065 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5482 1.55 MB/sec execute 100 sec latency 1082.893 ms 2023-10-18T11:27:57.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5522 1.56 MB/sec execute 101 sec latency 1082.945 ms 2023-10-18T11:27:58.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5550 1.55 MB/sec execute 102 sec latency 1418.813 ms 2023-10-18T11:27:59.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5586 1.54 MB/sec execute 103 sec latency 2045.535 ms 2023-10-18T11:28:00.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5626 1.56 MB/sec execute 104 sec latency 927.372 ms 2023-10-18T11:28:01.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5655 1.56 MB/sec execute 105 sec latency 1395.674 ms 2023-10-18T11:28:02.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5679 1.57 MB/sec execute 106 sec latency 1208.085 ms 2023-10-18T11:28:03.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5694 1.56 MB/sec execute 107 sec latency 1471.304 ms 2023-10-18T11:28:04.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5698 1.54 MB/sec execute 108 sec latency 2403.800 ms 2023-10-18T11:28:05.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5712 1.55 MB/sec execute 109 sec latency 2610.779 ms 2023-10-18T11:28:06.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5721 1.54 MB/sec execute 110 sec latency 3378.567 ms 2023-10-18T11:28:07.066 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5726 1.53 MB/sec execute 111 sec latency 4178.790 ms 2023-10-18T11:28:08.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5732 1.51 MB/sec execute 112 sec latency 2719.545 ms 2023-10-18T11:28:08.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:28:08.735 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:28:09.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5739 1.50 MB/sec execute 113 sec latency 3640.341 ms 2023-10-18T11:28:10.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5743 1.49 MB/sec execute 114 sec latency 3599.630 ms 2023-10-18T11:28:11.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5755 1.47 MB/sec execute 115 sec latency 4591.594 ms 2023-10-18T11:28:12.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5765 1.46 MB/sec execute 116 sec latency 2058.857 ms 2023-10-18T11:28:13.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5774 1.45 MB/sec execute 117 sec latency 1101.542 ms 2023-10-18T11:28:14.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5789 1.44 MB/sec execute 118 sec latency 1906.477 ms 2023-10-18T11:28:15.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5797 1.43 MB/sec execute 119 sec latency 2740.435 ms 2023-10-18T11:28:16.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5809 1.42 MB/sec execute 120 sec latency 1854.020 ms 2023-10-18T11:28:17.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5825 1.41 MB/sec execute 121 sec latency 2671.180 ms 2023-10-18T11:28:18.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5839 1.39 MB/sec execute 122 sec latency 1520.284 ms 2023-10-18T11:28:19.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5861 1.39 MB/sec execute 123 sec latency 1424.946 ms 2023-10-18T11:28:20.067 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5875 1.38 MB/sec execute 124 sec latency 1209.299 ms 2023-10-18T11:28:21.068 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5894 1.37 MB/sec execute 125 sec latency 1305.555 ms 2023-10-18T11:28:22.068 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5915 1.36 MB/sec execute 126 sec latency 1619.288 ms 2023-10-18T11:28:23.068 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5952 1.35 MB/sec execute 127 sec latency 1152.552 ms 2023-10-18T11:28:24.068 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5972 1.35 MB/sec execute 128 sec latency 2082.470 ms 2023-10-18T11:28:25.068 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5986 1.34 MB/sec execute 129 sec latency 2730.470 ms 2023-10-18T11:28:26.070 INFO:tasks.workunit.client.0.smithi151.stdout: 10 5993 1.33 MB/sec execute 130 sec latency 1301.477 ms 2023-10-18T11:28:27.068 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6009 1.32 MB/sec execute 131 sec latency 2301.569 ms 2023-10-18T11:28:28.068 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6032 1.32 MB/sec execute 132 sec latency 2546.065 ms 2023-10-18T11:28:29.068 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6049 1.32 MB/sec execute 133 sec latency 1519.008 ms 2023-10-18T11:28:30.068 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6067 1.31 MB/sec execute 134 sec latency 2010.067 ms 2023-10-18T11:28:31.069 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6091 1.30 MB/sec execute 135 sec latency 2327.882 ms 2023-10-18T11:28:32.069 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6107 1.29 MB/sec execute 136 sec latency 1124.759 ms 2023-10-18T11:28:33.069 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6132 1.29 MB/sec execute 137 sec latency 1262.242 ms 2023-10-18T11:28:34.070 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6146 1.28 MB/sec execute 138 sec latency 1585.590 ms 2023-10-18T11:28:35.069 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6162 1.28 MB/sec execute 139 sec latency 2585.719 ms 2023-10-18T11:28:36.069 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6199 1.30 MB/sec execute 140 sec latency 3230.777 ms 2023-10-18T11:28:37.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6227 1.29 MB/sec execute 141 sec latency 1326.977 ms 2023-10-18T11:28:38.070 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6253 1.29 MB/sec execute 142 sec latency 1466.491 ms 2023-10-18T11:28:38.858 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:28:38.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:28:39.070 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6276 1.29 MB/sec execute 143 sec latency 1899.202 ms 2023-10-18T11:28:40.070 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6309 1.30 MB/sec execute 144 sec latency 1732.191 ms 2023-10-18T11:28:41.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6337 1.30 MB/sec execute 145 sec latency 1673.600 ms 2023-10-18T11:28:42.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6372 1.30 MB/sec execute 146 sec latency 697.291 ms 2023-10-18T11:28:43.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6394 1.30 MB/sec execute 147 sec latency 768.634 ms 2023-10-18T11:28:44.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6416 1.30 MB/sec execute 148 sec latency 1037.075 ms 2023-10-18T11:28:45.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6442 1.29 MB/sec execute 149 sec latency 1271.551 ms 2023-10-18T11:28:46.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6456 1.29 MB/sec execute 150 sec latency 748.568 ms 2023-10-18T11:28:47.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6498 1.29 MB/sec execute 151 sec latency 712.520 ms 2023-10-18T11:28:48.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6529 1.30 MB/sec execute 152 sec latency 738.264 ms 2023-10-18T11:28:49.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6565 1.30 MB/sec execute 153 sec latency 879.764 ms 2023-10-18T11:28:50.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6615 1.33 MB/sec execute 154 sec latency 1056.354 ms 2023-10-18T11:28:51.071 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6644 1.32 MB/sec execute 155 sec latency 1247.966 ms 2023-10-18T11:28:52.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6703 1.36 MB/sec execute 156 sec latency 1335.385 ms 2023-10-18T11:28:53.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6748 1.37 MB/sec execute 157 sec latency 805.410 ms 2023-10-18T11:28:54.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6771 1.38 MB/sec execute 158 sec latency 1747.616 ms 2023-10-18T11:28:55.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6786 1.37 MB/sec execute 159 sec latency 2747.749 ms 2023-10-18T11:28:56.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6804 1.37 MB/sec execute 160 sec latency 3747.827 ms 2023-10-18T11:28:57.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6830 1.36 MB/sec execute 161 sec latency 4282.602 ms 2023-10-18T11:28:58.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6874 1.37 MB/sec execute 162 sec latency 1306.324 ms 2023-10-18T11:28:59.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6910 1.37 MB/sec execute 163 sec latency 1507.573 ms 2023-10-18T11:29:00.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 6954 1.38 MB/sec execute 164 sec latency 1061.326 ms 2023-10-18T11:29:01.072 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7008 1.41 MB/sec execute 165 sec latency 1129.987 ms 2023-10-18T11:29:02.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7065 1.43 MB/sec execute 166 sec latency 509.914 ms 2023-10-18T11:29:03.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7103 1.43 MB/sec execute 167 sec latency 761.771 ms 2023-10-18T11:29:04.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7137 1.43 MB/sec execute 168 sec latency 495.244 ms 2023-10-18T11:29:05.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7163 1.43 MB/sec execute 169 sec latency 499.024 ms 2023-10-18T11:29:06.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7198 1.44 MB/sec execute 170 sec latency 533.248 ms 2023-10-18T11:29:07.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7259 1.44 MB/sec execute 171 sec latency 631.789 ms 2023-10-18T11:29:08.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7283 1.44 MB/sec execute 172 sec latency 1307.756 ms 2023-10-18T11:29:08.999 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:29:09.006 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:29:09.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7325 1.44 MB/sec execute 173 sec latency 1483.969 ms 2023-10-18T11:29:10.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7355 1.44 MB/sec execute 174 sec latency 585.585 ms 2023-10-18T11:29:11.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7381 1.44 MB/sec execute 175 sec latency 635.594 ms 2023-10-18T11:29:12.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7428 1.45 MB/sec execute 176 sec latency 829.094 ms 2023-10-18T11:29:13.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7469 1.45 MB/sec execute 177 sec latency 802.333 ms 2023-10-18T11:29:14.073 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7511 1.47 MB/sec execute 178 sec latency 885.606 ms 2023-10-18T11:29:15.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7565 1.47 MB/sec execute 179 sec latency 522.552 ms 2023-10-18T11:29:16.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7580 1.46 MB/sec execute 180 sec latency 646.538 ms 2023-10-18T11:29:17.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7593 1.46 MB/sec execute 181 sec latency 1389.993 ms 2023-10-18T11:29:18.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7620 1.46 MB/sec execute 182 sec latency 2185.738 ms 2023-10-18T11:29:19.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7655 1.46 MB/sec execute 183 sec latency 3185.839 ms 2023-10-18T11:29:20.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7709 1.47 MB/sec execute 184 sec latency 3240.245 ms 2023-10-18T11:29:21.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7735 1.47 MB/sec execute 185 sec latency 508.749 ms 2023-10-18T11:29:22.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7796 1.51 MB/sec execute 186 sec latency 712.305 ms 2023-10-18T11:29:23.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7822 1.51 MB/sec execute 187 sec latency 677.531 ms 2023-10-18T11:29:24.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7833 1.50 MB/sec execute 188 sec latency 1010.766 ms 2023-10-18T11:29:25.074 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7845 1.49 MB/sec execute 189 sec latency 1246.706 ms 2023-10-18T11:29:26.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7878 1.50 MB/sec execute 190 sec latency 1842.438 ms 2023-10-18T11:29:27.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7895 1.50 MB/sec execute 191 sec latency 2842.564 ms 2023-10-18T11:29:28.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7907 1.49 MB/sec execute 192 sec latency 3842.658 ms 2023-10-18T11:29:29.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7932 1.48 MB/sec execute 193 sec latency 4591.334 ms 2023-10-18T11:29:30.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7950 1.48 MB/sec execute 194 sec latency 771.561 ms 2023-10-18T11:29:31.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 7974 1.48 MB/sec execute 195 sec latency 1166.787 ms 2023-10-18T11:29:32.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8006 1.48 MB/sec execute 196 sec latency 1171.393 ms 2023-10-18T11:29:33.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8039 1.50 MB/sec execute 197 sec latency 948.670 ms 2023-10-18T11:29:34.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8063 1.50 MB/sec execute 198 sec latency 1462.052 ms 2023-10-18T11:29:35.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8079 1.50 MB/sec execute 199 sec latency 1052.914 ms 2023-10-18T11:29:36.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8099 1.50 MB/sec execute 200 sec latency 1201.027 ms 2023-10-18T11:29:37.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8113 1.49 MB/sec execute 201 sec latency 1518.174 ms 2023-10-18T11:29:38.075 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8127 1.48 MB/sec execute 202 sec latency 2059.229 ms 2023-10-18T11:29:39.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8150 1.49 MB/sec execute 203 sec latency 2282.713 ms 2023-10-18T11:29:39.145 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:29:39.154 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:29:40.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8177 1.50 MB/sec execute 204 sec latency 2938.175 ms 2023-10-18T11:29:41.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8194 1.49 MB/sec execute 205 sec latency 1625.249 ms 2023-10-18T11:29:42.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8210 1.48 MB/sec execute 206 sec latency 2344.526 ms 2023-10-18T11:29:43.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8222 1.48 MB/sec execute 207 sec latency 3344.585 ms 2023-10-18T11:29:44.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8239 1.47 MB/sec execute 208 sec latency 3996.117 ms 2023-10-18T11:29:45.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8270 1.47 MB/sec execute 209 sec latency 2841.501 ms 2023-10-18T11:29:46.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8282 1.47 MB/sec execute 210 sec latency 2001.349 ms 2023-10-18T11:29:47.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8294 1.46 MB/sec execute 211 sec latency 2378.531 ms 2023-10-18T11:29:48.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8307 1.46 MB/sec execute 212 sec latency 1427.804 ms 2023-10-18T11:29:49.076 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8311 1.45 MB/sec execute 213 sec latency 2235.840 ms 2023-10-18T11:29:50.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8315 1.44 MB/sec execute 214 sec latency 3235.924 ms 2023-10-18T11:29:51.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8337 1.44 MB/sec execute 215 sec latency 3517.791 ms 2023-10-18T11:29:52.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8354 1.44 MB/sec execute 216 sec latency 3307.019 ms 2023-10-18T11:29:53.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8371 1.43 MB/sec execute 217 sec latency 1111.584 ms 2023-10-18T11:29:54.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8378 1.43 MB/sec execute 218 sec latency 1329.210 ms 2023-10-18T11:29:55.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8387 1.42 MB/sec execute 219 sec latency 2055.677 ms 2023-10-18T11:29:56.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8398 1.41 MB/sec execute 220 sec latency 1480.859 ms 2023-10-18T11:29:57.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8412 1.41 MB/sec execute 221 sec latency 1551.310 ms 2023-10-18T11:29:58.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8419 1.40 MB/sec execute 222 sec latency 1438.173 ms 2023-10-18T11:29:59.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8427 1.40 MB/sec execute 223 sec latency 2265.008 ms 2023-10-18T11:30:00.077 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8440 1.40 MB/sec execute 224 sec latency 3265.088 ms 2023-10-18T11:30:01.078 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8452 1.40 MB/sec execute 225 sec latency 4018.443 ms 2023-10-18T11:30:02.078 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8482 1.40 MB/sec execute 226 sec latency 4243.048 ms 2023-10-18T11:30:03.078 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8491 1.39 MB/sec execute 227 sec latency 2247.007 ms 2023-10-18T11:30:04.078 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8505 1.39 MB/sec execute 228 sec latency 2615.685 ms 2023-10-18T11:30:05.078 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8534 1.39 MB/sec execute 229 sec latency 1745.610 ms 2023-10-18T11:30:06.078 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8545 1.39 MB/sec execute 230 sec latency 2397.609 ms 2023-10-18T11:30:07.078 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8566 1.39 MB/sec execute 231 sec latency 2093.850 ms 2023-10-18T11:30:08.078 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8583 1.40 MB/sec execute 232 sec latency 1151.378 ms 2023-10-18T11:30:09.078 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8599 1.40 MB/sec execute 233 sec latency 2151.460 ms 2023-10-18T11:30:09.299 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:30:09.306 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:30:10.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8621 1.39 MB/sec execute 234 sec latency 2154.382 ms 2023-10-18T11:30:11.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8637 1.39 MB/sec execute 235 sec latency 1753.719 ms 2023-10-18T11:30:12.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8653 1.39 MB/sec execute 236 sec latency 2753.807 ms 2023-10-18T11:30:13.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8677 1.40 MB/sec execute 237 sec latency 3599.097 ms 2023-10-18T11:30:14.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8725 1.41 MB/sec execute 238 sec latency 1101.375 ms 2023-10-18T11:30:15.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8748 1.40 MB/sec execute 239 sec latency 2101.447 ms 2023-10-18T11:30:16.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8779 1.40 MB/sec execute 240 sec latency 2839.795 ms 2023-10-18T11:30:17.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8798 1.40 MB/sec execute 241 sec latency 1192.984 ms 2023-10-18T11:30:18.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8832 1.40 MB/sec execute 242 sec latency 1590.877 ms 2023-10-18T11:30:19.079 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8864 1.40 MB/sec execute 243 sec latency 1137.938 ms 2023-10-18T11:30:20.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8885 1.40 MB/sec execute 244 sec latency 1345.383 ms 2023-10-18T11:30:21.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8908 1.39 MB/sec execute 245 sec latency 1448.971 ms 2023-10-18T11:30:22.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8933 1.40 MB/sec execute 246 sec latency 818.448 ms 2023-10-18T11:30:23.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8954 1.39 MB/sec execute 247 sec latency 952.795 ms 2023-10-18T11:30:24.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8976 1.39 MB/sec execute 248 sec latency 839.791 ms 2023-10-18T11:30:25.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 8987 1.38 MB/sec execute 249 sec latency 1183.596 ms 2023-10-18T11:30:26.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9001 1.38 MB/sec execute 250 sec latency 1717.877 ms 2023-10-18T11:30:27.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9038 1.38 MB/sec execute 251 sec latency 1533.711 ms 2023-10-18T11:30:28.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9076 1.39 MB/sec execute 252 sec latency 994.324 ms 2023-10-18T11:30:29.080 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9101 1.39 MB/sec execute 253 sec latency 1147.010 ms 2023-10-18T11:30:30.081 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9129 1.38 MB/sec execute 254 sec latency 1028.638 ms 2023-10-18T11:30:31.081 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9159 1.38 MB/sec execute 255 sec latency 901.972 ms 2023-10-18T11:30:32.081 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9188 1.38 MB/sec execute 256 sec latency 968.689 ms 2023-10-18T11:30:33.081 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9216 1.39 MB/sec execute 257 sec latency 1419.178 ms 2023-10-18T11:30:34.081 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9228 1.38 MB/sec execute 258 sec latency 1097.920 ms 2023-10-18T11:30:35.081 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9251 1.39 MB/sec execute 259 sec latency 1160.132 ms 2023-10-18T11:30:36.081 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9261 1.39 MB/sec execute 260 sec latency 1336.996 ms 2023-10-18T11:30:37.081 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9273 1.38 MB/sec execute 261 sec latency 1813.542 ms 2023-10-18T11:30:38.081 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9288 1.38 MB/sec execute 262 sec latency 949.478 ms 2023-10-18T11:30:39.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9309 1.37 MB/sec execute 263 sec latency 1263.037 ms 2023-10-18T11:30:39.445 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:30:39.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:30:40.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9325 1.37 MB/sec execute 264 sec latency 1245.419 ms 2023-10-18T11:30:41.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9341 1.36 MB/sec execute 265 sec latency 1273.775 ms 2023-10-18T11:30:42.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9364 1.37 MB/sec execute 266 sec latency 1152.959 ms 2023-10-18T11:30:43.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9385 1.36 MB/sec execute 267 sec latency 1224.343 ms 2023-10-18T11:30:43.247 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:21:59.341 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:30:43.265 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:21:59.360 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:30:43.266 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:21:59.433 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:30:43.266 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:21:59.435 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:30:43.268 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:21:59.436 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:30:43.269 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:21:59.437 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:30:43.385 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:21:59.553 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:30:43.398 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:21:59.566 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:30:43.456 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:21:59.550 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:30:44.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9407 1.36 MB/sec execute 268 sec latency 1425.612 ms 2023-10-18T11:30:45.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9425 1.36 MB/sec execute 269 sec latency 860.973 ms 2023-10-18T11:30:46.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9439 1.35 MB/sec execute 270 sec latency 976.459 ms 2023-10-18T11:30:47.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9456 1.35 MB/sec execute 271 sec latency 1167.396 ms 2023-10-18T11:30:48.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9484 1.36 MB/sec execute 272 sec latency 1066.006 ms 2023-10-18T11:30:49.082 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9500 1.35 MB/sec execute 273 sec latency 1622.203 ms 2023-10-18T11:30:50.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9516 1.35 MB/sec execute 274 sec latency 1261.441 ms 2023-10-18T11:30:51.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9527 1.34 MB/sec execute 275 sec latency 1516.450 ms 2023-10-18T11:30:52.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9547 1.34 MB/sec execute 276 sec latency 2344.976 ms 2023-10-18T11:30:53.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9578 1.34 MB/sec execute 277 sec latency 2711.778 ms 2023-10-18T11:30:54.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9598 1.34 MB/sec execute 278 sec latency 1510.583 ms 2023-10-18T11:30:55.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9624 1.35 MB/sec execute 279 sec latency 1606.325 ms 2023-10-18T11:30:56.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9642 1.34 MB/sec execute 280 sec latency 2362.650 ms 2023-10-18T11:30:57.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9665 1.34 MB/sec execute 281 sec latency 2904.390 ms 2023-10-18T11:30:58.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9699 1.34 MB/sec execute 282 sec latency 3224.690 ms 2023-10-18T11:30:59.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9725 1.34 MB/sec execute 283 sec latency 1482.674 ms 2023-10-18T11:31:00.083 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9747 1.34 MB/sec execute 284 sec latency 1163.025 ms 2023-10-18T11:31:01.084 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9766 1.34 MB/sec execute 285 sec latency 1804.001 ms 2023-10-18T11:31:02.084 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9782 1.33 MB/sec execute 286 sec latency 2271.860 ms 2023-10-18T11:31:03.084 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9808 1.33 MB/sec execute 287 sec latency 1368.499 ms 2023-10-18T11:31:04.084 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9826 1.33 MB/sec execute 288 sec latency 979.447 ms 2023-10-18T11:31:05.084 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9844 1.32 MB/sec execute 289 sec latency 1288.619 ms 2023-10-18T11:31:06.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9868 1.32 MB/sec execute 290 sec latency 1982.822 ms 2023-10-18T11:31:07.084 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9891 1.32 MB/sec execute 291 sec latency 2839.738 ms 2023-10-18T11:31:08.084 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9933 1.32 MB/sec execute 292 sec latency 883.044 ms 2023-10-18T11:31:09.084 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9960 1.32 MB/sec execute 293 sec latency 936.958 ms 2023-10-18T11:31:09.604 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:31:09.609 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:31:10.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 9992 1.32 MB/sec execute 294 sec latency 974.106 ms 2023-10-18T11:31:11.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10014 1.31 MB/sec execute 295 sec latency 1320.388 ms 2023-10-18T11:31:12.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10051 1.32 MB/sec execute 296 sec latency 2028.480 ms 2023-10-18T11:31:13.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10076 1.32 MB/sec execute 297 sec latency 1309.949 ms 2023-10-18T11:31:14.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10119 1.33 MB/sec execute 298 sec latency 706.253 ms 2023-10-18T11:31:15.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10145 1.33 MB/sec execute 299 sec latency 1023.483 ms 2023-10-18T11:31:16.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10184 1.33 MB/sec execute 300 sec latency 900.669 ms 2023-10-18T11:31:17.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10223 1.33 MB/sec execute 301 sec latency 1008.906 ms 2023-10-18T11:31:18.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10256 1.33 MB/sec execute 302 sec latency 1172.469 ms 2023-10-18T11:31:19.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10272 1.33 MB/sec execute 303 sec latency 1190.433 ms 2023-10-18T11:31:20.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10308 1.34 MB/sec execute 304 sec latency 1667.055 ms 2023-10-18T11:31:21.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10321 1.34 MB/sec execute 305 sec latency 2667.127 ms 2023-10-18T11:31:22.085 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10336 1.34 MB/sec execute 306 sec latency 3667.258 ms 2023-10-18T11:31:23.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10352 1.34 MB/sec execute 307 sec latency 3785.012 ms 2023-10-18T11:31:24.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10375 1.34 MB/sec execute 308 sec latency 1163.826 ms 2023-10-18T11:31:25.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10401 1.34 MB/sec execute 309 sec latency 978.787 ms 2023-10-18T11:31:26.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10422 1.34 MB/sec execute 310 sec latency 1577.678 ms 2023-10-18T11:31:27.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10436 1.34 MB/sec execute 311 sec latency 1124.981 ms 2023-10-18T11:31:28.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10471 1.34 MB/sec execute 312 sec latency 1236.316 ms 2023-10-18T11:31:29.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10512 1.36 MB/sec execute 313 sec latency 994.122 ms 2023-10-18T11:31:30.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10546 1.36 MB/sec execute 314 sec latency 898.774 ms 2023-10-18T11:31:31.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10581 1.37 MB/sec execute 315 sec latency 1211.172 ms 2023-10-18T11:31:32.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10604 1.37 MB/sec execute 316 sec latency 1639.493 ms 2023-10-18T11:31:33.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10625 1.36 MB/sec execute 317 sec latency 1318.400 ms 2023-10-18T11:31:34.086 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10645 1.36 MB/sec execute 318 sec latency 1806.809 ms 2023-10-18T11:31:35.087 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10672 1.36 MB/sec execute 319 sec latency 1782.564 ms 2023-10-18T11:31:36.087 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10707 1.36 MB/sec execute 320 sec latency 848.610 ms 2023-10-18T11:31:37.087 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10735 1.35 MB/sec execute 321 sec latency 1200.766 ms 2023-10-18T11:31:38.087 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10758 1.36 MB/sec execute 322 sec latency 939.151 ms 2023-10-18T11:31:39.087 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10776 1.35 MB/sec execute 323 sec latency 1072.865 ms 2023-10-18T11:31:39.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:31:39.741 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:31:40.087 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10795 1.35 MB/sec execute 324 sec latency 1370.308 ms 2023-10-18T11:31:41.087 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10812 1.35 MB/sec execute 325 sec latency 1763.235 ms 2023-10-18T11:31:42.087 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10826 1.35 MB/sec execute 326 sec latency 1046.662 ms 2023-10-18T11:31:43.087 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10834 1.34 MB/sec execute 327 sec latency 1841.819 ms 2023-10-18T11:31:44.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10844 1.34 MB/sec execute 328 sec latency 2233.030 ms 2023-10-18T11:31:45.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10851 1.33 MB/sec execute 329 sec latency 1999.782 ms 2023-10-18T11:31:46.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10863 1.33 MB/sec execute 330 sec latency 2999.893 ms 2023-10-18T11:31:47.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10874 1.33 MB/sec execute 331 sec latency 3999.970 ms 2023-10-18T11:31:48.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10894 1.33 MB/sec execute 332 sec latency 5000.167 ms 2023-10-18T11:31:49.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10904 1.32 MB/sec execute 333 sec latency 5180.568 ms 2023-10-18T11:31:49.445 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:23:05.540 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:31:49.455 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:23:05.550 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:31:49.500 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:23:05.668 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:31:49.508 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:23:05.677 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:31:49.509 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:23:05.678 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:31:49.513 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:23:05.682 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:31:49.525 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:23:05.620 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:31:49.553 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:23:05.721 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:31:49.555 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:23:05.723 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:31:50.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10925 1.33 MB/sec execute 334 sec latency 1274.364 ms 2023-10-18T11:31:51.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10941 1.32 MB/sec execute 335 sec latency 1548.754 ms 2023-10-18T11:31:52.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10961 1.32 MB/sec execute 336 sec latency 1485.694 ms 2023-10-18T11:31:53.088 INFO:tasks.workunit.client.0.smithi151.stdout: 10 10980 1.32 MB/sec execute 337 sec latency 1619.452 ms 2023-10-18T11:31:54.089 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11013 1.32 MB/sec execute 338 sec latency 1402.577 ms 2023-10-18T11:31:55.089 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11036 1.32 MB/sec execute 339 sec latency 1993.574 ms 2023-10-18T11:31:56.089 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11053 1.32 MB/sec execute 340 sec latency 1420.620 ms 2023-10-18T11:31:57.089 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11072 1.32 MB/sec execute 341 sec latency 2232.899 ms 2023-10-18T11:31:58.089 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11099 1.32 MB/sec execute 342 sec latency 1250.564 ms 2023-10-18T11:31:59.089 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11125 1.31 MB/sec execute 343 sec latency 1498.700 ms 2023-10-18T11:32:00.089 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11153 1.32 MB/sec execute 344 sec latency 1842.151 ms 2023-10-18T11:32:01.089 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11185 1.33 MB/sec execute 345 sec latency 1486.643 ms 2023-10-18T11:32:02.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11205 1.33 MB/sec execute 346 sec latency 1764.631 ms 2023-10-18T11:32:03.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11235 1.34 MB/sec execute 347 sec latency 1095.678 ms 2023-10-18T11:32:04.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11245 1.34 MB/sec execute 348 sec latency 2062.099 ms 2023-10-18T11:32:05.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11268 1.34 MB/sec execute 349 sec latency 2737.902 ms 2023-10-18T11:32:06.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11297 1.34 MB/sec execute 350 sec latency 1804.940 ms 2023-10-18T11:32:07.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11311 1.34 MB/sec execute 351 sec latency 2278.165 ms 2023-10-18T11:32:08.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11321 1.33 MB/sec execute 352 sec latency 2955.783 ms 2023-10-18T11:32:09.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11338 1.33 MB/sec execute 353 sec latency 2343.402 ms 2023-10-18T11:32:09.855 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:32:09.862 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:32:10.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11348 1.33 MB/sec execute 354 sec latency 2651.029 ms 2023-10-18T11:32:11.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11377 1.32 MB/sec execute 355 sec latency 3283.083 ms 2023-10-18T11:32:12.090 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11410 1.33 MB/sec execute 356 sec latency 4112.127 ms 2023-10-18T11:32:13.091 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11459 1.33 MB/sec execute 357 sec latency 1454.953 ms 2023-10-18T11:32:14.091 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11474 1.33 MB/sec execute 358 sec latency 2114.250 ms 2023-10-18T11:32:15.091 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11493 1.33 MB/sec execute 359 sec latency 2465.942 ms 2023-10-18T11:32:16.091 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11500 1.33 MB/sec execute 360 sec latency 2092.910 ms 2023-10-18T11:32:17.091 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11509 1.33 MB/sec execute 361 sec latency 1851.979 ms 2023-10-18T11:32:18.091 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11521 1.33 MB/sec execute 362 sec latency 1439.424 ms 2023-10-18T11:32:19.091 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11529 1.32 MB/sec execute 363 sec latency 1495.410 ms 2023-10-18T11:32:20.091 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11540 1.32 MB/sec execute 364 sec latency 1610.959 ms 2023-10-18T11:32:21.091 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11547 1.32 MB/sec execute 365 sec latency 1332.420 ms 2023-10-18T11:32:22.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11566 1.32 MB/sec execute 366 sec latency 2332.547 ms 2023-10-18T11:32:23.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11575 1.32 MB/sec execute 367 sec latency 2561.681 ms 2023-10-18T11:32:24.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11586 1.32 MB/sec execute 368 sec latency 2364.769 ms 2023-10-18T11:32:25.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11591 1.32 MB/sec execute 369 sec latency 2879.025 ms 2023-10-18T11:32:26.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11596 1.31 MB/sec execute 370 sec latency 3879.115 ms 2023-10-18T11:32:27.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11606 1.31 MB/sec execute 371 sec latency 4013.154 ms 2023-10-18T11:32:28.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11623 1.31 MB/sec execute 372 sec latency 1042.276 ms 2023-10-18T11:32:29.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11641 1.31 MB/sec execute 373 sec latency 1293.220 ms 2023-10-18T11:32:30.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11651 1.30 MB/sec execute 374 sec latency 1463.281 ms 2023-10-18T11:32:31.092 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11654 1.30 MB/sec execute 375 sec latency 1406.954 ms 2023-10-18T11:32:32.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11660 1.30 MB/sec execute 376 sec latency 2208.774 ms 2023-10-18T11:32:33.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11673 1.29 MB/sec execute 377 sec latency 3200.073 ms 2023-10-18T11:32:34.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11679 1.29 MB/sec execute 378 sec latency 3426.642 ms 2023-10-18T11:32:35.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11683 1.29 MB/sec execute 379 sec latency 2584.693 ms 2023-10-18T11:32:36.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11689 1.28 MB/sec execute 380 sec latency 3544.085 ms 2023-10-18T11:32:37.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11696 1.28 MB/sec execute 381 sec latency 3720.269 ms 2023-10-18T11:32:38.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11706 1.28 MB/sec execute 382 sec latency 1350.999 ms 2023-10-18T11:32:39.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11721 1.27 MB/sec execute 383 sec latency 2351.085 ms 2023-10-18T11:32:39.985 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:32:39.996 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:32:40.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11739 1.27 MB/sec execute 384 sec latency 3351.155 ms 2023-10-18T11:32:41.093 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11762 1.27 MB/sec execute 385 sec latency 3631.706 ms 2023-10-18T11:32:42.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11779 1.27 MB/sec execute 386 sec latency 2461.955 ms 2023-10-18T11:32:43.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11788 1.26 MB/sec execute 387 sec latency 3462.059 ms 2023-10-18T11:32:44.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11828 1.26 MB/sec execute 388 sec latency 3628.971 ms 2023-10-18T11:32:45.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11858 1.26 MB/sec execute 389 sec latency 745.062 ms 2023-10-18T11:32:46.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11874 1.26 MB/sec execute 390 sec latency 1549.657 ms 2023-10-18T11:32:47.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11896 1.26 MB/sec execute 391 sec latency 1944.022 ms 2023-10-18T11:32:48.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11923 1.26 MB/sec execute 392 sec latency 1293.885 ms 2023-10-18T11:32:49.095 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11958 1.26 MB/sec execute 393 sec latency 1793.969 ms 2023-10-18T11:32:50.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 11974 1.26 MB/sec execute 394 sec latency 1388.042 ms 2023-10-18T11:32:51.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12006 1.26 MB/sec execute 395 sec latency 1487.840 ms 2023-10-18T11:32:52.094 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12035 1.26 MB/sec execute 396 sec latency 2487.908 ms 2023-10-18T11:32:53.095 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12059 1.26 MB/sec execute 397 sec latency 2797.132 ms 2023-10-18T11:32:54.095 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12078 1.26 MB/sec execute 398 sec latency 699.993 ms 2023-10-18T11:32:55.095 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12097 1.25 MB/sec execute 399 sec latency 982.856 ms 2023-10-18T11:32:56.096 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12102 1.25 MB/sec execute 400 sec latency 1180.779 ms 2023-10-18T11:32:57.096 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12123 1.25 MB/sec execute 401 sec latency 1503.072 ms 2023-10-18T11:32:58.096 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12173 1.26 MB/sec execute 402 sec latency 1269.430 ms 2023-10-18T11:32:59.096 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12215 1.26 MB/sec execute 403 sec latency 708.380 ms 2023-10-18T11:33:00.096 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12244 1.27 MB/sec execute 404 sec latency 1263.785 ms 2023-10-18T11:33:01.096 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12278 1.27 MB/sec execute 405 sec latency 1726.804 ms 2023-10-18T11:33:02.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12297 1.27 MB/sec execute 406 sec latency 2270.947 ms 2023-10-18T11:33:03.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12325 1.27 MB/sec execute 407 sec latency 1207.734 ms 2023-10-18T11:33:04.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12350 1.26 MB/sec execute 408 sec latency 693.856 ms 2023-10-18T11:33:05.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12386 1.26 MB/sec execute 409 sec latency 807.080 ms 2023-10-18T11:33:06.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12407 1.26 MB/sec execute 410 sec latency 1201.925 ms 2023-10-18T11:33:07.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12429 1.26 MB/sec execute 411 sec latency 1138.140 ms 2023-10-18T11:33:08.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12461 1.27 MB/sec execute 412 sec latency 1388.785 ms 2023-10-18T11:33:09.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12489 1.26 MB/sec execute 413 sec latency 692.720 ms 2023-10-18T11:33:10.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12515 1.27 MB/sec execute 414 sec latency 1241.474 ms 2023-10-18T11:33:10.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:33:10.143 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:33:11.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12532 1.27 MB/sec execute 415 sec latency 656.565 ms 2023-10-18T11:33:12.097 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12561 1.27 MB/sec execute 416 sec latency 711.737 ms 2023-10-18T11:33:13.098 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12600 1.27 MB/sec execute 417 sec latency 924.271 ms 2023-10-18T11:33:14.098 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12620 1.27 MB/sec execute 418 sec latency 1132.105 ms 2023-10-18T11:33:15.098 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12663 1.27 MB/sec execute 419 sec latency 685.250 ms 2023-10-18T11:33:16.098 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12718 1.28 MB/sec execute 420 sec latency 659.861 ms 2023-10-18T11:33:17.098 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12745 1.29 MB/sec execute 421 sec latency 679.194 ms 2023-10-18T11:33:18.098 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12761 1.28 MB/sec execute 422 sec latency 1227.193 ms 2023-10-18T11:33:19.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12787 1.29 MB/sec execute 423 sec latency 1767.497 ms 2023-10-18T11:33:20.098 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12802 1.29 MB/sec execute 424 sec latency 1202.444 ms 2023-10-18T11:33:21.098 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12829 1.28 MB/sec execute 425 sec latency 823.236 ms 2023-10-18T11:33:22.098 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12834 1.28 MB/sec execute 426 sec latency 1575.011 ms 2023-10-18T11:33:23.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12848 1.29 MB/sec execute 427 sec latency 1407.024 ms 2023-10-18T11:33:24.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12870 1.29 MB/sec execute 428 sec latency 2378.502 ms 2023-10-18T11:33:25.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12890 1.29 MB/sec execute 429 sec latency 3043.966 ms 2023-10-18T11:33:26.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12914 1.29 MB/sec execute 430 sec latency 1607.486 ms 2023-10-18T11:33:27.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12939 1.29 MB/sec execute 431 sec latency 1070.136 ms 2023-10-18T11:33:28.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12960 1.29 MB/sec execute 432 sec latency 1171.273 ms 2023-10-18T11:33:29.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 12989 1.29 MB/sec execute 433 sec latency 1173.983 ms 2023-10-18T11:33:30.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13008 1.29 MB/sec execute 434 sec latency 1108.620 ms 2023-10-18T11:33:31.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13028 1.30 MB/sec execute 435 sec latency 1345.218 ms 2023-10-18T11:33:32.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13045 1.30 MB/sec execute 436 sec latency 1610.265 ms 2023-10-18T11:33:33.099 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13058 1.29 MB/sec execute 437 sec latency 2276.834 ms 2023-10-18T11:33:34.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13081 1.30 MB/sec execute 438 sec latency 2434.622 ms 2023-10-18T11:33:35.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13103 1.30 MB/sec execute 439 sec latency 1956.903 ms 2023-10-18T11:33:36.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13127 1.30 MB/sec execute 440 sec latency 2956.959 ms 2023-10-18T11:33:37.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13136 1.30 MB/sec execute 441 sec latency 3373.950 ms 2023-10-18T11:33:38.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13151 1.30 MB/sec execute 442 sec latency 1842.398 ms 2023-10-18T11:33:39.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13175 1.29 MB/sec execute 443 sec latency 907.765 ms 2023-10-18T11:33:40.101 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13190 1.29 MB/sec execute 444 sec latency 813.757 ms 2023-10-18T11:33:40.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:33:40.286 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:33:41.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13210 1.29 MB/sec execute 445 sec latency 813.663 ms 2023-10-18T11:33:42.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13239 1.29 MB/sec execute 446 sec latency 1095.916 ms 2023-10-18T11:33:43.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13266 1.29 MB/sec execute 447 sec latency 994.842 ms 2023-10-18T11:33:44.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13285 1.29 MB/sec execute 448 sec latency 1031.245 ms 2023-10-18T11:33:45.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13301 1.28 MB/sec execute 449 sec latency 1415.595 ms 2023-10-18T11:33:46.100 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13337 1.28 MB/sec execute 450 sec latency 1586.698 ms 2023-10-18T11:33:47.101 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13372 1.28 MB/sec execute 451 sec latency 1189.356 ms 2023-10-18T11:33:48.101 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13400 1.28 MB/sec execute 452 sec latency 1418.521 ms 2023-10-18T11:33:49.101 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13431 1.28 MB/sec execute 453 sec latency 656.457 ms 2023-10-18T11:33:50.101 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13450 1.28 MB/sec execute 454 sec latency 1357.498 ms 2023-10-18T11:33:51.101 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13463 1.28 MB/sec execute 455 sec latency 1886.590 ms 2023-10-18T11:33:52.101 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13472 1.28 MB/sec execute 456 sec latency 2886.703 ms 2023-10-18T11:33:53.101 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13495 1.28 MB/sec execute 457 sec latency 3200.911 ms 2023-10-18T11:33:54.101 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13508 1.28 MB/sec execute 458 sec latency 1714.458 ms 2023-10-18T11:33:55.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13528 1.28 MB/sec execute 459 sec latency 2217.130 ms 2023-10-18T11:33:56.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13538 1.28 MB/sec execute 460 sec latency 1685.645 ms 2023-10-18T11:33:57.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13548 1.28 MB/sec execute 461 sec latency 1246.031 ms 2023-10-18T11:33:58.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13561 1.28 MB/sec execute 462 sec latency 1567.280 ms 2023-10-18T11:33:59.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13568 1.27 MB/sec execute 463 sec latency 1367.567 ms 2023-10-18T11:34:00.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13589 1.27 MB/sec execute 464 sec latency 1577.336 ms 2023-10-18T11:34:00.327 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:25:16.422 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:00.335 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:25:16.429 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:00.337 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:25:16.505 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:00.339 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:25:16.508 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:00.342 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:25:16.510 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:00.345 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:25:16.513 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:00.410 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:25:16.578 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:00.417 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:25:16.586 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:00.426 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:25:16.521 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:01.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13599 1.27 MB/sec execute 465 sec latency 1818.202 ms 2023-10-18T11:34:02.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13610 1.27 MB/sec execute 466 sec latency 2299.841 ms 2023-10-18T11:34:03.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13628 1.27 MB/sec execute 467 sec latency 2488.736 ms 2023-10-18T11:34:04.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13649 1.27 MB/sec execute 468 sec latency 3153.492 ms 2023-10-18T11:34:05.102 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13673 1.27 MB/sec execute 469 sec latency 833.281 ms 2023-10-18T11:34:06.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13695 1.27 MB/sec execute 470 sec latency 1184.056 ms 2023-10-18T11:34:07.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13717 1.27 MB/sec execute 471 sec latency 771.663 ms 2023-10-18T11:34:08.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13741 1.27 MB/sec execute 472 sec latency 1050.162 ms 2023-10-18T11:34:09.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13755 1.27 MB/sec execute 473 sec latency 880.926 ms 2023-10-18T11:34:10.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13774 1.27 MB/sec execute 474 sec latency 741.143 ms 2023-10-18T11:34:10.461 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:34:10.468 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:34:11.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13805 1.26 MB/sec execute 475 sec latency 845.415 ms 2023-10-18T11:34:12.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13836 1.27 MB/sec execute 476 sec latency 788.120 ms 2023-10-18T11:34:13.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13860 1.27 MB/sec execute 477 sec latency 1016.832 ms 2023-10-18T11:34:14.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13893 1.28 MB/sec execute 478 sec latency 2016.926 ms 2023-10-18T11:34:15.103 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13913 1.28 MB/sec execute 479 sec latency 2600.246 ms 2023-10-18T11:34:16.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13936 1.28 MB/sec execute 480 sec latency 1147.633 ms 2023-10-18T11:34:17.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13952 1.27 MB/sec execute 481 sec latency 883.843 ms 2023-10-18T11:34:18.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13967 1.27 MB/sec execute 482 sec latency 1041.466 ms 2023-10-18T11:34:19.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13975 1.27 MB/sec execute 483 sec latency 988.670 ms 2023-10-18T11:34:20.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13989 1.27 MB/sec execute 484 sec latency 1057.905 ms 2023-10-18T11:34:21.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 13995 1.27 MB/sec execute 485 sec latency 1281.668 ms 2023-10-18T11:34:22.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14010 1.27 MB/sec execute 486 sec latency 2056.119 ms 2023-10-18T11:34:23.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14030 1.26 MB/sec execute 487 sec latency 3056.225 ms 2023-10-18T11:34:24.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14054 1.27 MB/sec execute 488 sec latency 3227.019 ms 2023-10-18T11:34:25.104 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14067 1.27 MB/sec execute 489 sec latency 926.021 ms 2023-10-18T11:34:26.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14092 1.26 MB/sec execute 490 sec latency 963.199 ms 2023-10-18T11:34:27.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14102 1.26 MB/sec execute 491 sec latency 1067.960 ms 2023-10-18T11:34:28.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14129 1.27 MB/sec execute 492 sec latency 1054.862 ms 2023-10-18T11:34:29.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14150 1.27 MB/sec execute 493 sec latency 809.057 ms 2023-10-18T11:34:30.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14166 1.26 MB/sec execute 494 sec latency 686.397 ms 2023-10-18T11:34:30.434 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:25:46.529 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:30.495 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:25:46.590 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:30.531 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:25:46.626 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:30.553 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:25:46.722 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:30.557 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:25:46.725 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:30.561 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:25:46.729 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:30.566 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:25:46.734 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:30.583 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:25:46.751 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:30.590 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:25:46.758 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:34:31.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14179 1.26 MB/sec execute 495 sec latency 823.997 ms 2023-10-18T11:34:32.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14203 1.27 MB/sec execute 496 sec latency 973.571 ms 2023-10-18T11:34:33.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14225 1.27 MB/sec execute 497 sec latency 838.685 ms 2023-10-18T11:34:34.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14249 1.26 MB/sec execute 498 sec latency 1130.062 ms 2023-10-18T11:34:35.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14270 1.27 MB/sec execute 499 sec latency 726.667 ms 2023-10-18T11:34:36.105 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14285 1.26 MB/sec execute 500 sec latency 1569.399 ms 2023-10-18T11:34:37.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14307 1.27 MB/sec execute 501 sec latency 746.431 ms 2023-10-18T11:34:38.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14320 1.26 MB/sec execute 502 sec latency 641.846 ms 2023-10-18T11:34:39.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14336 1.26 MB/sec execute 503 sec latency 880.994 ms 2023-10-18T11:34:40.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14360 1.26 MB/sec execute 504 sec latency 847.757 ms 2023-10-18T11:34:40.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:34:40.599 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:34:41.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14373 1.26 MB/sec execute 505 sec latency 897.916 ms 2023-10-18T11:34:42.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14387 1.26 MB/sec execute 506 sec latency 1407.703 ms 2023-10-18T11:34:43.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14403 1.26 MB/sec execute 507 sec latency 1680.600 ms 2023-10-18T11:34:44.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14422 1.26 MB/sec execute 508 sec latency 602.807 ms 2023-10-18T11:34:45.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14437 1.25 MB/sec execute 509 sec latency 1192.333 ms 2023-10-18T11:34:46.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14443 1.25 MB/sec execute 510 sec latency 1349.073 ms 2023-10-18T11:34:47.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14451 1.25 MB/sec execute 511 sec latency 1496.557 ms 2023-10-18T11:34:48.106 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14488 1.25 MB/sec execute 512 sec latency 1196.023 ms 2023-10-18T11:34:49.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14500 1.25 MB/sec execute 513 sec latency 965.547 ms 2023-10-18T11:34:50.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14511 1.25 MB/sec execute 514 sec latency 656.158 ms 2023-10-18T11:34:51.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14532 1.25 MB/sec execute 515 sec latency 763.185 ms 2023-10-18T11:34:52.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14549 1.24 MB/sec execute 516 sec latency 1209.611 ms 2023-10-18T11:34:53.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14566 1.24 MB/sec execute 517 sec latency 2048.187 ms 2023-10-18T11:34:54.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14596 1.25 MB/sec execute 518 sec latency 2159.780 ms 2023-10-18T11:34:55.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14615 1.25 MB/sec execute 519 sec latency 1098.884 ms 2023-10-18T11:34:56.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14640 1.24 MB/sec execute 520 sec latency 1174.847 ms 2023-10-18T11:34:57.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14656 1.24 MB/sec execute 521 sec latency 1448.804 ms 2023-10-18T11:34:58.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14678 1.24 MB/sec execute 522 sec latency 1178.593 ms 2023-10-18T11:34:59.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14717 1.25 MB/sec execute 523 sec latency 1351.784 ms 2023-10-18T11:35:00.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14734 1.24 MB/sec execute 524 sec latency 860.360 ms 2023-10-18T11:35:01.107 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14757 1.24 MB/sec execute 525 sec latency 1087.827 ms 2023-10-18T11:35:02.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14769 1.24 MB/sec execute 526 sec latency 1873.915 ms 2023-10-18T11:35:03.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14777 1.24 MB/sec execute 527 sec latency 1420.215 ms 2023-10-18T11:35:04.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14808 1.24 MB/sec execute 528 sec latency 1537.219 ms 2023-10-18T11:35:05.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14824 1.24 MB/sec execute 529 sec latency 1202.743 ms 2023-10-18T11:35:06.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14834 1.24 MB/sec execute 530 sec latency 1713.954 ms 2023-10-18T11:35:07.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14859 1.24 MB/sec execute 531 sec latency 863.333 ms 2023-10-18T11:35:08.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14874 1.24 MB/sec execute 532 sec latency 1863.392 ms 2023-10-18T11:35:09.109 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14894 1.23 MB/sec execute 533 sec latency 2194.028 ms 2023-10-18T11:35:10.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14916 1.23 MB/sec execute 534 sec latency 1145.734 ms 2023-10-18T11:35:10.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:35:10.728 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:35:11.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14941 1.23 MB/sec execute 535 sec latency 1376.580 ms 2023-10-18T11:35:12.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14974 1.23 MB/sec execute 536 sec latency 884.029 ms 2023-10-18T11:35:13.108 INFO:tasks.workunit.client.0.smithi151.stdout: 10 14996 1.23 MB/sec execute 537 sec latency 1379.215 ms 2023-10-18T11:35:14.109 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15030 1.23 MB/sec execute 538 sec latency 1428.073 ms 2023-10-18T11:35:15.109 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15075 1.23 MB/sec execute 539 sec latency 779.544 ms 2023-10-18T11:35:16.109 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15126 1.24 MB/sec execute 540 sec latency 927.680 ms 2023-10-18T11:35:17.109 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15145 1.24 MB/sec execute 541 sec latency 1599.238 ms 2023-10-18T11:35:18.109 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15163 1.24 MB/sec execute 542 sec latency 1174.544 ms 2023-10-18T11:35:19.109 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15183 1.24 MB/sec execute 543 sec latency 1400.188 ms 2023-10-18T11:35:20.109 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15202 1.24 MB/sec execute 544 sec latency 936.853 ms 2023-10-18T11:35:21.109 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15237 1.24 MB/sec execute 545 sec latency 1047.016 ms 2023-10-18T11:35:22.110 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15255 1.24 MB/sec execute 546 sec latency 1013.937 ms 2023-10-18T11:35:23.110 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15277 1.23 MB/sec execute 547 sec latency 1269.294 ms 2023-10-18T11:35:24.110 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15302 1.23 MB/sec execute 548 sec latency 1252.805 ms 2023-10-18T11:35:25.110 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15322 1.23 MB/sec execute 549 sec latency 1213.399 ms 2023-10-18T11:35:26.110 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15360 1.24 MB/sec execute 550 sec latency 1470.374 ms 2023-10-18T11:35:27.110 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15402 1.25 MB/sec execute 551 sec latency 1584.786 ms 2023-10-18T11:35:28.110 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15417 1.24 MB/sec execute 552 sec latency 2443.840 ms 2023-10-18T11:35:29.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15427 1.24 MB/sec execute 553 sec latency 2824.853 ms 2023-10-18T11:35:30.110 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15452 1.25 MB/sec execute 554 sec latency 2884.634 ms 2023-10-18T11:35:31.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15489 1.25 MB/sec execute 555 sec latency 3140.822 ms 2023-10-18T11:35:32.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15511 1.25 MB/sec execute 556 sec latency 3448.542 ms 2023-10-18T11:35:33.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15545 1.25 MB/sec execute 557 sec latency 3225.781 ms 2023-10-18T11:35:34.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15562 1.25 MB/sec execute 558 sec latency 4225.914 ms 2023-10-18T11:35:35.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15581 1.25 MB/sec execute 559 sec latency 5226.016 ms 2023-10-18T11:35:36.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15612 1.25 MB/sec execute 560 sec latency 6059.958 ms 2023-10-18T11:35:37.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15626 1.25 MB/sec execute 561 sec latency 2482.063 ms 2023-10-18T11:35:38.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15649 1.25 MB/sec execute 562 sec latency 1258.561 ms 2023-10-18T11:35:39.111 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15678 1.25 MB/sec execute 563 sec latency 2161.251 ms 2023-10-18T11:35:40.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15699 1.25 MB/sec execute 564 sec latency 1081.278 ms 2023-10-18T11:35:40.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:35:40.841 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:35:41.112 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15720 1.25 MB/sec execute 565 sec latency 1463.028 ms 2023-10-18T11:35:42.112 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15744 1.25 MB/sec execute 566 sec latency 1617.946 ms 2023-10-18T11:35:43.112 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15754 1.25 MB/sec execute 567 sec latency 2524.840 ms 2023-10-18T11:35:44.112 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15769 1.25 MB/sec execute 568 sec latency 3086.030 ms 2023-10-18T11:35:45.112 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15798 1.25 MB/sec execute 569 sec latency 2483.979 ms 2023-10-18T11:35:46.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15825 1.25 MB/sec execute 570 sec latency 3484.198 ms 2023-10-18T11:35:47.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15841 1.24 MB/sec execute 571 sec latency 4484.287 ms 2023-10-18T11:35:48.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15860 1.24 MB/sec execute 572 sec latency 4565.510 ms 2023-10-18T11:35:49.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15881 1.25 MB/sec execute 573 sec latency 1854.474 ms 2023-10-18T11:35:50.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15900 1.25 MB/sec execute 574 sec latency 2611.724 ms 2023-10-18T11:35:51.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15910 1.24 MB/sec execute 575 sec latency 1516.587 ms 2023-10-18T11:35:52.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15918 1.24 MB/sec execute 576 sec latency 2096.906 ms 2023-10-18T11:35:53.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15950 1.24 MB/sec execute 577 sec latency 1798.189 ms 2023-10-18T11:35:54.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15959 1.24 MB/sec execute 578 sec latency 2068.301 ms 2023-10-18T11:35:55.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15973 1.24 MB/sec execute 579 sec latency 1241.643 ms 2023-10-18T11:35:56.113 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15985 1.24 MB/sec execute 580 sec latency 1693.901 ms 2023-10-18T11:35:57.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 15998 1.24 MB/sec execute 581 sec latency 1569.592 ms 2023-10-18T11:35:58.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16011 1.23 MB/sec execute 582 sec latency 2047.143 ms 2023-10-18T11:35:59.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16023 1.23 MB/sec execute 583 sec latency 2451.699 ms 2023-10-18T11:36:00.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16039 1.23 MB/sec execute 584 sec latency 1739.570 ms 2023-10-18T11:36:01.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16057 1.23 MB/sec execute 585 sec latency 1148.498 ms 2023-10-18T11:36:02.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16079 1.23 MB/sec execute 586 sec latency 1211.333 ms 2023-10-18T11:36:03.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16107 1.23 MB/sec execute 587 sec latency 1286.909 ms 2023-10-18T11:36:04.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16140 1.23 MB/sec execute 588 sec latency 1147.565 ms 2023-10-18T11:36:05.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16149 1.23 MB/sec execute 589 sec latency 1498.263 ms 2023-10-18T11:36:06.114 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16171 1.23 MB/sec execute 590 sec latency 1625.961 ms 2023-10-18T11:36:07.115 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16201 1.23 MB/sec execute 591 sec latency 1237.854 ms 2023-10-18T11:36:08.115 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16228 1.22 MB/sec execute 592 sec latency 1371.026 ms 2023-10-18T11:36:09.115 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16265 1.23 MB/sec execute 593 sec latency 1056.554 ms 2023-10-18T11:36:10.115 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16293 1.23 MB/sec execute 594 sec latency 1283.986 ms 2023-10-18T11:36:10.947 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:36:10.960 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:36:11.115 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16306 1.23 MB/sec execute 595 sec latency 1158.379 ms 2023-10-18T11:36:12.115 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16321 1.22 MB/sec execute 596 sec latency 1366.400 ms 2023-10-18T11:36:13.115 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16329 1.22 MB/sec execute 597 sec latency 1479.811 ms 2023-10-18T11:36:14.115 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16341 1.22 MB/sec execute 598 sec latency 1694.617 ms 2023-10-18T11:36:15.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 16350 1.22 MB/sec execute 599 sec latency 1389.101 ms 2023-10-18T11:36:16.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 600 sec 2023-10-18T11:36:17.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 601 sec 2023-10-18T11:36:18.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 602 sec 2023-10-18T11:36:19.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 603 sec 2023-10-18T11:36:20.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 604 sec 2023-10-18T11:36:21.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 605 sec 2023-10-18T11:36:22.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 606 sec 2023-10-18T11:36:23.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 607 sec 2023-10-18T11:36:24.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 608 sec 2023-10-18T11:36:25.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 609 sec 2023-10-18T11:36:26.116 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 610 sec 2023-10-18T11:36:27.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 611 sec 2023-10-18T11:36:28.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 612 sec 2023-10-18T11:36:29.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 613 sec 2023-10-18T11:36:30.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 614 sec 2023-10-18T11:36:31.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 615 sec 2023-10-18T11:36:32.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 616 sec 2023-10-18T11:36:33.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 617 sec 2023-10-18T11:36:34.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 618 sec 2023-10-18T11:36:35.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 619 sec 2023-10-18T11:36:36.117 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 620 sec 2023-10-18T11:36:37.118 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 621 sec 2023-10-18T11:36:38.118 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 622 sec 2023-10-18T11:36:39.118 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 623 sec 2023-10-18T11:36:40.118 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 624 sec 2023-10-18T11:36:41.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:36:41.081 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:36:41.118 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 625 sec 2023-10-18T11:36:42.118 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 626 sec 2023-10-18T11:36:43.119 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 627 sec 2023-10-18T11:36:44.119 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 628 sec 2023-10-18T11:36:45.119 INFO:tasks.workunit.client.0.smithi151.stdout: 10 cleanup 629 sec 2023-10-18T11:36:46.119 INFO:tasks.workunit.client.0.smithi151.stdout: 9 cleanup 630 sec 2023-10-18T11:36:47.119 INFO:tasks.workunit.client.0.smithi151.stdout: 8 cleanup 631 sec 2023-10-18T11:36:48.120 INFO:tasks.workunit.client.0.smithi151.stdout: 8 cleanup 632 sec 2023-10-18T11:36:49.119 INFO:tasks.workunit.client.0.smithi151.stdout: 7 cleanup 633 sec 2023-10-18T11:36:50.120 INFO:tasks.workunit.client.0.smithi151.stdout: 6 cleanup 634 sec 2023-10-18T11:36:51.120 INFO:tasks.workunit.client.0.smithi151.stdout: 6 cleanup 635 sec 2023-10-18T11:36:52.120 INFO:tasks.workunit.client.0.smithi151.stdout: 6 cleanup 636 sec 2023-10-18T11:36:53.120 INFO:tasks.workunit.client.0.smithi151.stdout: 6 cleanup 637 sec 2023-10-18T11:36:54.120 INFO:tasks.workunit.client.0.smithi151.stdout: 6 cleanup 638 sec 2023-10-18T11:36:55.120 INFO:tasks.workunit.client.0.smithi151.stdout: 5 cleanup 639 sec 2023-10-18T11:36:56.120 INFO:tasks.workunit.client.0.smithi151.stdout: 5 cleanup 640 sec 2023-10-18T11:36:57.121 INFO:tasks.workunit.client.0.smithi151.stdout: 5 cleanup 641 sec 2023-10-18T11:36:58.121 INFO:tasks.workunit.client.0.smithi151.stdout: 5 cleanup 642 sec 2023-10-18T11:36:59.121 INFO:tasks.workunit.client.0.smithi151.stdout: 4 cleanup 643 sec 2023-10-18T11:37:00.121 INFO:tasks.workunit.client.0.smithi151.stdout: 3 cleanup 644 sec 2023-10-18T11:37:01.122 INFO:tasks.workunit.client.0.smithi151.stdout: 2 cleanup 645 sec 2023-10-18T11:37:02.121 INFO:tasks.workunit.client.0.smithi151.stdout: 2 cleanup 646 sec 2023-10-18T11:37:03.121 INFO:tasks.workunit.client.0.smithi151.stdout: 2 cleanup 647 sec 2023-10-18T11:37:04.121 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 648 sec 2023-10-18T11:37:05.121 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 649 sec 2023-10-18T11:37:06.121 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 650 sec 2023-10-18T11:37:07.122 INFO:tasks.workunit.client.0.smithi151.stdout: 1 cleanup 651 sec 2023-10-18T11:37:07.698 INFO:tasks.workunit.client.0.smithi151.stdout: 0 cleanup 652 sec 2023-10-18T11:37:07.698 INFO:tasks.workunit.client.0.smithi151.stdout: 2023-10-18T11:37:07.698 INFO:tasks.workunit.client.0.smithi151.stdout: Operation Count AvgLat MaxLat 2023-10-18T11:37:07.699 INFO:tasks.workunit.client.0.smithi151.stdout: ---------------------------------------- 2023-10-18T11:37:07.699 INFO:tasks.workunit.client.0.smithi151.stdout: NTCreateX 23559 113.849 4407.202 2023-10-18T11:37:07.699 INFO:tasks.workunit.client.0.smithi151.stdout: Close 17335 0.012 0.333 2023-10-18T11:37:07.699 INFO:tasks.workunit.client.0.smithi151.stdout: Rename 979 524.055 6059.928 2023-10-18T11:37:07.699 INFO:tasks.workunit.client.0.smithi151.stdout: Unlink 4700 196.264 4945.568 2023-10-18T11:37:07.700 INFO:tasks.workunit.client.0.smithi151.stdout: Qpathinfo 21480 67.896 4591.577 2023-10-18T11:37:07.700 INFO:tasks.workunit.client.0.smithi151.stdout: Qfileinfo 3719 0.016 14.941 2023-10-18T11:37:07.700 INFO:tasks.workunit.client.0.smithi151.stdout: Qfsinfo 3885 9.265 293.862 2023-10-18T11:37:07.700 INFO:tasks.workunit.client.0.smithi151.stdout: Sfileinfo 1827 21.814 3230.759 2023-10-18T11:37:07.700 INFO:tasks.workunit.client.0.smithi151.stdout: Find 8253 15.679 3240.227 2023-10-18T11:37:07.700 INFO:tasks.workunit.client.0.smithi151.stdout: WriteX 11584 4.198 1474.620 2023-10-18T11:37:07.701 INFO:tasks.workunit.client.0.smithi151.stdout: ReadX 36885 0.909 1640.559 2023-10-18T11:37:07.701 INFO:tasks.workunit.client.0.smithi151.stdout: LockX 76 116.292 574.511 2023-10-18T11:37:07.701 INFO:tasks.workunit.client.0.smithi151.stdout: UnlockX 76 100.435 518.921 2023-10-18T11:37:07.701 INFO:tasks.workunit.client.0.smithi151.stdout: Flush 1606 78.952 1206.462 2023-10-18T11:37:07.701 INFO:tasks.workunit.client.0.smithi151.stdout: 2023-10-18T11:37:07.702 INFO:tasks.workunit.client.0.smithi151.stdout:Throughput 1.22104 MB/sec 10 clients 10 procs max_latency=6059.958 ms 2023-10-18T11:37:07.703 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-18T11:37:07.703 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-18T11:37:11.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:37:11.222 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:37:22.036 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:28:38.130 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:37:22.036 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:28:38.204 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:37:22.038 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:28:38.206 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:37:22.039 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:28:38.207 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:37:22.041 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:28:38.209 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:37:22.051 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:28:38.145 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:37:22.110 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:28:38.278 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:37:22.113 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:28:38.281 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:37:22.201 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:28:38.295 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:37:41.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:37:41.391 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:37:55.249 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-10-18T11:37:55.249 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-18T11:37:56.258 DEBUG:teuthology.parallel:result is None 2023-10-18T11:37:56.259 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-18T11:37:57.403 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-18T11:37:57.403 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-18T11:37:57.413 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-18T11:37:57.414 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:37:57.414 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T11:37:57.474 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-18T11:37:57.474 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T11:37:57.521 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:37:57.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.766+0000 7fd3c98f3640 1 Processor -- start 2023-10-18T11:37:57.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.766+0000 7fd3c98f3640 1 -- start start 2023-10-18T11:37:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.767+0000 7fd3c98f3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406faf0 0x7fd3c40c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.767+0000 7fd3c98f3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd3c406a620 0x7fd3c415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.767+0000 7fd3c98f3640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40c7470 con 0x7fd3c406a240 2023-10-18T11:37:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.767+0000 7fd3c98f3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40c5670 con 0x7fd3c406a620 2023-10-18T11:37:57.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.767+0000 7fd3c98f3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40705f0 con 0x7fd3c406faf0 2023-10-18T11:37:57.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.768+0000 7fd3c88f1640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd3c406a240 0x7fd3c4150bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:43928/0 (socket says 172.21.15.151:43928) 2023-10-18T11:37:57.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.768+0000 7fd3c88f1640 1 -- 172.21.15.151:0/3644619490 learned_addr learned my addr 172.21.15.151:0/3644619490 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:37:57.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.768+0000 7fd3bbfff640 1 --2- 172.21.15.151:0/3644619490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406faf0 0x7fd3c40c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:57.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.768+0000 7fd3c90f2640 1 --2- 172.21.15.151:0/3644619490 >> v2:172.21.15.151:3300/0 conn(0x7fd3c406a620 0x7fd3c415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:57.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.771+0000 7fd3bb7fe640 1 -- 172.21.15.151:0/3644619490 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500106639 0 0) 0x7fd3c40c7470 con 0x7fd3c406a240 2023-10-18T11:37:57.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.771+0000 7fd3bb7fe640 1 -- 172.21.15.151:0/3644619490 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ac003520 con 0x7fd3c406a240 2023-10-18T11:37:57.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.771+0000 7fd3bbfff640 1 -- 172.21.15.151:0/3644619490 >> v2:172.21.15.151:3300/0 conn(0x7fd3c406a620 msgr2=0x7fd3c415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:37:57.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.771+0000 7fd3bbfff640 1 --2- 172.21.15.151:0/3644619490 >> v2:172.21.15.151:3300/0 conn(0x7fd3c406a620 0x7fd3c415a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:57.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.771+0000 7fd3bbfff640 1 -- 172.21.15.151:0/3644619490 >> v1:172.21.15.169:6789/0 conn(0x7fd3c406a240 legacy=0x7fd3c4150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:57.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.771+0000 7fd3bbfff640 1 -- 172.21.15.151:0/3644619490 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40c4dd0 con 0x7fd3c406faf0 2023-10-18T11:37:57.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.774+0000 7fd3bbfff640 1 --2- 172.21.15.151:0/3644619490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406faf0 0x7fd3c40c7900 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40097a0 tx=0x7fd3b402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f896aa28f4bb520 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:37:57.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.777+0000 7fd3bb7fe640 1 -- 172.21.15.151:0/3644619490 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b402d040 con 0x7fd3c406faf0 2023-10-18T11:37:57.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.777+0000 7fd3bb7fe640 1 -- 172.21.15.151:0/3644619490 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b4031810 con 0x7fd3c406faf0 2023-10-18T11:37:57.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.777+0000 7fd3bb7fe640 1 -- 172.21.15.151:0/3644619490 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4031ba0 con 0x7fd3c406faf0 2023-10-18T11:37:57.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.778+0000 7fd3c98f3640 1 -- 172.21.15.151:0/3644619490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406faf0 msgr2=0x7fd3c40c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:57.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.778+0000 7fd3c98f3640 1 --2- 172.21.15.151:0/3644619490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406faf0 0x7fd3c40c7900 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40097a0 tx=0x7fd3b402b8b0 comp rx=0 tx=0).stop 2023-10-18T11:37:57.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.778+0000 7fd3c98f3640 1 -- 172.21.15.151:0/3644619490 shutdown_connections 2023-10-18T11:37:57.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.778+0000 7fd3c98f3640 1 --2- 172.21.15.151:0/3644619490 >> v2:172.21.15.151:3300/0 conn(0x7fd3c406a620 0x7fd3c415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:57.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.778+0000 7fd3c98f3640 1 --2- 172.21.15.151:0/3644619490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406faf0 0x7fd3c40c7900 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:57.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.778+0000 7fd3c98f3640 1 -- 172.21.15.151:0/3644619490 >> 172.21.15.151:0/3644619490 conn(0x7fd3c40659d0 msgr2=0x7fd3c4065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:37:57.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.778+0000 7fd3c98f3640 1 -- 172.21.15.151:0/3644619490 shutdown_connections 2023-10-18T11:37:57.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.778+0000 7fd3c98f3640 1 -- 172.21.15.151:0/3644619490 wait complete. 2023-10-18T11:37:57.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.780+0000 7fd3c98f3640 1 Processor -- start 2023-10-18T11:37:57.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.780+0000 7fd3c98f3640 1 -- start start 2023-10-18T11:37:57.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.781+0000 7fd3c98f3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c406a240 0x7fd3c4142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:57.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.781+0000 7fd3c98f3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406a620 0x7fd3c4159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:57.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.781+0000 7fd3c98f3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3c406faf0 0x7fd3c4146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.781+0000 7fd3c98f3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c41436c0 con 0x7fd3c406a240 2023-10-18T11:37:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.781+0000 7fd3c98f3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4158150 con 0x7fd3c406faf0 2023-10-18T11:37:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.781+0000 7fd3c98f3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c41584e0 con 0x7fd3c406a620 2023-10-18T11:37:57.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.782+0000 7fd3bbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406a620 0x7fd3c4159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:57.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.782+0000 7fd3c88f1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c406a240 0x7fd3c4142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:57.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.782+0000 7fd3c90f2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3c406faf0 0x7fd3c4146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:57.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.782+0000 7fd3bbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406a620 0x7fd3c4159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:45122/0 (socket says 172.21.15.151:45122) 2023-10-18T11:37:57.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.782+0000 7fd3bbfff640 1 -- 172.21.15.151:0/2093592777 learned_addr learned my addr 172.21.15.151:0/2093592777 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:37:57.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.786+0000 7fd3bbfff640 1 -- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3c406faf0 msgr2=0x7fd3c4146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:57.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.786+0000 7fd3bbfff640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3c406faf0 0x7fd3c4146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:57.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.786+0000 7fd3bbfff640 1 -- 172.21.15.151:0/2093592777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c406a240 msgr2=0x7fd3c4142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:57.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.786+0000 7fd3bbfff640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c406a240 0x7fd3c4142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:57.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.786+0000 7fd3bbfff640 1 -- 172.21.15.151:0/2093592777 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b4009400 con 0x7fd3c406a620 2023-10-18T11:37:57.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.788+0000 7fd3bbfff640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406a620 0x7fd3c4159c30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40098c0 tx=0x7fd3b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:37:57.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.792+0000 7fd3b97fa640 1 -- 172.21.15.151:0/2093592777 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4031610 con 0x7fd3c406a620 2023-10-18T11:37:57.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.792+0000 7fd3b97fa640 1 -- 172.21.15.151:0/2093592777 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b403ad60 con 0x7fd3c406a620 2023-10-18T11:37:57.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.792+0000 7fd3b97fa640 1 -- 172.21.15.151:0/2093592777 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4042630 con 0x7fd3c406a620 2023-10-18T11:37:57.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.792+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c4158a10 con 0x7fd3c406a620 2023-10-18T11:37:57.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.792+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c40c2d60 con 0x7fd3c406a620 2023-10-18T11:37:57.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.793+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c404e160 con 0x7fd3c406a620 2023-10-18T11:37:57.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.812+0000 7fd3b97fa640 1 -- 172.21.15.151:0/2093592777 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd3b404b3b0 con 0x7fd3c406a620 2023-10-18T11:37:57.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.814+0000 7fd3b97fa640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd3b006aec0 0x7fd3b006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:57.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.814+0000 7fd3c88f1640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd3b006aec0 0x7fd3b006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:57.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.814+0000 7fd3b97fa640 1 -- 172.21.15.151:0/2093592777 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3b407a690 con 0x7fd3c406a620 2023-10-18T11:37:57.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:57.815+0000 7fd3c88f1640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd3b006aec0 0x7fd3b006d380 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00011e0 tx=0x7fd3c0007d30 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:37:58.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.060+0000 7fd3b97fa640 1 -- 172.21.15.151:0/2093592777 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3b40769d0 con 0x7fd3c406a620 2023-10-18T11:37:58.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.268+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3c414eeb0 con 0x7fd3c406a620 2023-10-18T11:37:58.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.307+0000 7fd3b97fa640 1 -- 172.21.15.151:0/2093592777 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7fd3b4079ff0 con 0x7fd3c406a620 2023-10-18T11:37:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:37:58.310 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:37:58.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd3b006aec0 msgr2=0x7fd3b006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:58.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd3b006aec0 0x7fd3b006d380 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00011e0 tx=0x7fd3c0007d30 comp rx=0 tx=0).stop 2023-10-18T11:37:58.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406a620 msgr2=0x7fd3c4159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:58.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406a620 0x7fd3c4159c30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40098c0 tx=0x7fd3b40046c0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 shutdown_connections 2023-10-18T11:37:58.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd3b006aec0 0x7fd3b006d380 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3c406faf0 0x7fd3c4146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3c406a620 0x7fd3c4159c30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 --2- 172.21.15.151:0/2093592777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c406a240 0x7fd3c4142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 >> 172.21.15.151:0/2093592777 conn(0x7fd3c40659d0 msgr2=0x7fd3c41486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:37:58.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 shutdown_connections 2023-10-18T11:37:58.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.311+0000 7fd3c98f3640 1 -- 172.21.15.151:0/2093592777 wait complete. 2023-10-18T11:37:58.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T11:09:16.833723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T11:09:34.803213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T11:09:37.000724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T11:09:43.858153+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T11:37:58.334 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T11:37:58.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.536+0000 7f74375f5640 1 Processor -- start 2023-10-18T11:37:58.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.536+0000 7f74375f5640 1 -- start start 2023-10-18T11:37:58.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.538+0000 7f74375f5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7430151150 0x7f74300c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:58.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.538+0000 7f74375f5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:58.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.538+0000 7f74375f5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743015b3c0 con 0x7f7430157170 2023-10-18T11:37:58.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.538+0000 7f74375f5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74300c1e20 con 0x7f7430151150 2023-10-18T11:37:58.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.538+0000 7f74375f5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743015a7b0 con 0x7f7430151530 2023-10-18T11:37:58.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.539+0000 7f7434b90640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:58.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.539+0000 7f7434b90640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:45130/0 (socket says 172.21.15.151:45130) 2023-10-18T11:37:58.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.539+0000 7f7434b90640 1 -- 172.21.15.151:0/1045767170 learned_addr learned my addr 172.21.15.151:0/1045767170 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:37:58.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.539+0000 7f7435391640 1 --2- 172.21.15.151:0/1045767170 >> v2:172.21.15.151:3300/0 conn(0x7f7430151150 0x7f74300c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:58.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.541+0000 7f7434b90640 1 -- 172.21.15.151:0/1045767170 >> v2:172.21.15.151:3300/0 conn(0x7f7430151150 msgr2=0x7f74300c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:37:58.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.541+0000 7f7434b90640 1 --2- 172.21.15.151:0/1045767170 >> v2:172.21.15.151:3300/0 conn(0x7f7430151150 0x7f74300c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.541+0000 7f7434b90640 1 -- 172.21.15.151:0/1045767170 >> v1:172.21.15.151:6789/0 conn(0x7f7430157170 legacy=0x7f74301575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:58.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.541+0000 7f7434b90640 1 -- 172.21.15.151:0/1045767170 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743015aa90 con 0x7f7430151530 2023-10-18T11:37:58.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.544+0000 7f7434b90640 1 --2- 172.21.15.151:0/1045767170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c18e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7420009870 tx=0x7f742002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1bfb4c11aec5a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:37:58.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.548+0000 7f7427fff640 1 -- 172.21.15.151:0/1045767170 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742002f840 con 0x7f7430151530 2023-10-18T11:37:58.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.548+0000 7f7427fff640 1 -- 172.21.15.151:0/1045767170 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742002f9a0 con 0x7f7430151530 2023-10-18T11:37:58.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.548+0000 7f7427fff640 1 -- 172.21.15.151:0/1045767170 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742002fd30 con 0x7f7430151530 2023-10-18T11:37:58.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.548+0000 7f74375f5640 1 -- 172.21.15.151:0/1045767170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 msgr2=0x7f74300c18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:58.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.548+0000 7f74375f5640 1 --2- 172.21.15.151:0/1045767170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c18e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7420009870 tx=0x7f742002ba20 comp rx=0 tx=0).stop 2023-10-18T11:37:58.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.549+0000 7f74375f5640 1 -- 172.21.15.151:0/1045767170 shutdown_connections 2023-10-18T11:37:58.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.549+0000 7f74375f5640 1 --2- 172.21.15.151:0/1045767170 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c18e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.549+0000 7f74375f5640 1 --2- 172.21.15.151:0/1045767170 >> v2:172.21.15.151:3300/0 conn(0x7f7430151150 0x7f74300c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.549+0000 7f74375f5640 1 -- 172.21.15.151:0/1045767170 >> 172.21.15.151:0/1045767170 conn(0x7f7430069d90 msgr2=0x7f743006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:37:58.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.549+0000 7f74375f5640 1 -- 172.21.15.151:0/1045767170 shutdown_connections 2023-10-18T11:37:58.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.549+0000 7f74375f5640 1 -- 172.21.15.151:0/1045767170 wait complete. 2023-10-18T11:37:58.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.551+0000 7f74375f5640 1 Processor -- start 2023-10-18T11:37:58.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.552+0000 7f74375f5640 1 -- start start 2023-10-18T11:37:58.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.553+0000 7f74375f5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7430151150 0x7f74300bf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:58.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.553+0000 7f74375f5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:58.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.553+0000 7f74375f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7430157170 0x7f74300c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:58.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.553+0000 7f74375f5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300be700 con 0x7f7430151150 2023-10-18T11:37:58.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.553+0000 7f74375f5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74301ef520 con 0x7f7430157170 2023-10-18T11:37:58.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.553+0000 7f74375f5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74301ef800 con 0x7f7430151530 2023-10-18T11:37:58.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.554+0000 7f7435391640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7430151150 0x7f74300bf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:58.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.554+0000 7f7434b90640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:58.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.554+0000 7f7435b92640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7430157170 0x7f74300c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:58.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.554+0000 7f7435391640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7430151150 0x7f74300bf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33442/0 (socket says 172.21.15.151:33442) 2023-10-18T11:37:58.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.554+0000 7f7435391640 1 -- 172.21.15.151:0/1157366176 learned_addr learned my addr 172.21.15.151:0/1157366176 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:37:58.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.557+0000 7f7434b90640 1 -- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7430157170 msgr2=0x7f74300c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:58.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.557+0000 7f7434b90640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7430157170 0x7f74300c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.557+0000 7f7434b90640 1 -- 172.21.15.151:0/1157366176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7430151150 msgr2=0x7f74300bf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:58.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.557+0000 7f7434b90640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7430151150 0x7f74300bf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:58.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.557+0000 7f7434b90640 1 -- 172.21.15.151:0/1157366176 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200094d0 con 0x7f7430151530 2023-10-18T11:37:58.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.560+0000 7f7434b90640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c9310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7420033000 tx=0x7f7420004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:37:58.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.563+0000 7f7425ffb640 1 -- 172.21.15.151:0/1157366176 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420037bc0 con 0x7f7430151530 2023-10-18T11:37:58.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.564+0000 7f7425ffb640 1 -- 172.21.15.151:0/1157366176 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7420037d20 con 0x7f7430151530 2023-10-18T11:37:58.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.564+0000 7f7425ffb640 1 -- 172.21.15.151:0/1157366176 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420041640 con 0x7f7430151530 2023-10-18T11:37:58.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.564+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743006fc80 con 0x7f7430151530 2023-10-18T11:37:58.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.564+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7430070240 con 0x7f7430151530 2023-10-18T11:37:58.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.565+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743004e160 con 0x7f7430151530 2023-10-18T11:37:58.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.585+0000 7f7425ffb640 1 -- 172.21.15.151:0/1157366176 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f74200417a0 con 0x7f7430151530 2023-10-18T11:37:58.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.586+0000 7f7425ffb640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aec0 0x7f741406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:58.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.586+0000 7f7435391640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aec0 0x7f741406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:58.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.587+0000 7f7435391640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aec0 0x7f741406d380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f742c009c00 tx=0x7f742c009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:37:58.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.814+0000 7f7425ffb640 1 -- 172.21.15.151:0/1157366176 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f742003c070 con 0x7f7430151530 2023-10-18T11:37:58.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:58.825+0000 7f7425ffb640 1 -- 172.21.15.151:0/1157366176 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7420078060 con 0x7f7430151530 2023-10-18T11:37:59.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.028+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74300c0520 con 0x7f7430151530 2023-10-18T11:37:59.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.033+0000 7f7425ffb640 1 -- 172.21.15.151:0/1157366176 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f742007b680 con 0x7f7430151530 2023-10-18T11:37:59.036 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-10-18T11:37:59.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aec0 msgr2=0x7f741406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:59.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aec0 0x7f741406d380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f742c009c00 tx=0x7f742c009190 comp rx=0 tx=0).stop 2023-10-18T11:37:59.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 msgr2=0x7f74300c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:59.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c9310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7420033000 tx=0x7f7420004730 comp rx=0 tx=0).stop 2023-10-18T11:37:59.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 shutdown_connections 2023-10-18T11:37:59.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f741406aec0 0x7f741406d380 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7430157170 0x7f74300c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7430151530 0x7f74300c9310 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 --2- 172.21.15.151:0/1157366176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7430151150 0x7f74300bf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.036+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 >> 172.21.15.151:0/1157366176 conn(0x7f7430069d90 msgr2=0x7f74300c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:37:59.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.037+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 shutdown_connections 2023-10-18T11:37:59.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.037+0000 7f74375f5640 1 -- 172.21.15.151:0/1157366176 wait complete. 2023-10-18T11:37:59.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T11:37:59.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.265+0000 7f05a13d0640 1 Processor -- start 2023-10-18T11:37:59.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.265+0000 7f05a13d0640 1 -- start start 2023-10-18T11:37:59.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.266+0000 7f05a13d0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0cbe20 0x7f059c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:59.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.266+0000 7f05a13d0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f059c0b1340 0x7f059c0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:59.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.266+0000 7f05a13d0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c153870 con 0x7f059c0c9650 2023-10-18T11:37:59.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.266+0000 7f05a13d0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0cc200 con 0x7f059c0b1340 2023-10-18T11:37:59.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.266+0000 7f05a13d0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b1e30 con 0x7f059c0cbe20 2023-10-18T11:37:59.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.267+0000 7f059b7fe640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f059c0c9650 0x7f059c06acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:41430/0 (socket says 172.21.15.151:41430) 2023-10-18T11:37:59.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.267+0000 7f059b7fe640 1 -- 172.21.15.151:0/2221554069 learned_addr learned my addr 172.21.15.151:0/2221554069 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:37:59.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.270+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528298346 0 0) 0x7f059c153870 con 0x7f059c0c9650 2023-10-18T11:37:59.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.270+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0588003520 con 0x7f059c0c9650 2023-10-18T11:37:59.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 <== mon.0 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3399735133 0 0) 0x7f0588003520 con 0x7f059c0c9650 2023-10-18T11:37:59.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0cbe20 msgr2=0x7f059c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:37:59.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 --2- 172.21.15.151:0/2221554069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0cbe20 0x7f059c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 >> v2:172.21.15.169:3300/0 conn(0x7f059c0b1340 msgr2=0x7f059c0cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:37:59.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 --2- 172.21.15.151:0/2221554069 >> v2:172.21.15.169:3300/0 conn(0x7f059c0b1340 0x7f059c0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c1590d0 con 0x7f059c0c9650 2023-10-18T11:37:59.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 <== mon.0 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f0594001670 con 0x7f059c0c9650 2023-10-18T11:37:59.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 >> v1:172.21.15.151:6789/0 conn(0x7f059c0c9650 legacy=0x7f059c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:59.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 --2- 172.21.15.151:0/2221554069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0588003970 0x7f0588003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:59.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.274+0000 7f0599ffb640 1 --2- 172.21.15.151:0/2221554069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f0588004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:59.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.275+0000 7f0599ffb640 1 --2- 172.21.15.151:0/2221554069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0cbe20 0x7f058800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:59.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.275+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0cc200 con 0x7f05880047c0 2023-10-18T11:37:59.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.275+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b1e30 con 0x7f0588003970 2023-10-18T11:37:59.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.275+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05880055d0 con 0x7f059c0cbe20 2023-10-18T11:37:59.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.278+0000 7f059a7fc640 1 --2- 172.21.15.151:0/2221554069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f0588004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:59.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.280+0000 7f059a7fc640 1 -- 172.21.15.151:0/2221554069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0cbe20 msgr2=0x7f058800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:37:59.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.280+0000 7f059a7fc640 1 --2- 172.21.15.151:0/2221554069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0cbe20 0x7f058800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.280+0000 7f059a7fc640 1 -- 172.21.15.151:0/2221554069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0588003970 msgr2=0x7f0588003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:37:59.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.280+0000 7f059a7fc640 1 --2- 172.21.15.151:0/2221554069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0588003970 0x7f0588003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.280+0000 7f059a7fc640 1 -- 172.21.15.151:0/2221554069 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0588003520 con 0x7f05880047c0 2023-10-18T11:37:59.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.283+0000 7f059a7fc640 1 --2- 172.21.15.151:0/2221554069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f0588004c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0584009860 tx=0x7f05880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c331703ab8ed38 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:37:59.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.290+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584032600 con 0x7f05880047c0 2023-10-18T11:37:59.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.290+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058402e050 con 0x7f05880047c0 2023-10-18T11:37:59.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.290+0000 7f0599ffb640 1 -- 172.21.15.151:0/2221554069 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840329c0 con 0x7f05880047c0 2023-10-18T11:37:59.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.290+0000 7f05a13d0640 1 -- 172.21.15.151:0/2221554069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 msgr2=0x7f0588004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:59.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.290+0000 7f05a13d0640 1 --2- 172.21.15.151:0/2221554069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f0588004c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0584009860 tx=0x7f05880057f0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.290+0000 7f059b7fe640 1 -- 172.21.15.151:0/2221554069 reap_dead start 2023-10-18T11:37:59.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.291+0000 7f05a13d0640 1 -- 172.21.15.151:0/2221554069 shutdown_connections 2023-10-18T11:37:59.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.291+0000 7f05a13d0640 1 -- 172.21.15.151:0/2221554069 >> 172.21.15.151:0/2221554069 conn(0x7f059c0659d0 msgr2=0x7f059c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:37:59.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.291+0000 7f05a13d0640 1 -- 172.21.15.151:0/2221554069 shutdown_connections 2023-10-18T11:37:59.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.291+0000 7f05a13d0640 1 -- 172.21.15.151:0/2221554069 wait complete. 2023-10-18T11:37:59.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.293+0000 7f05a13d0640 1 Processor -- start 2023-10-18T11:37:59.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.293+0000 7f05a13d0640 1 -- start start 2023-10-18T11:37:59.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.294+0000 7f05a13d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f059c0c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:59.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.294+0000 7f05a13d0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0c47b0 0x7f059c0c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:59.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.294+0000 7f05a13d0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f059c0c3090 0x7f059c14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:59.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.294+0000 7f05a13d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c153f10 con 0x7f05880047c0 2023-10-18T11:37:59.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.294+0000 7f05a13d0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c1ef200 con 0x7f059c0c3090 2023-10-18T11:37:59.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.294+0000 7f05a13d0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0c34f0 con 0x7f059c0c47b0 2023-10-18T11:37:59.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.295+0000 7f059affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f059c0c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:59.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.295+0000 7f059affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f059c0c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33460/0 (socket says 172.21.15.151:33460) 2023-10-18T11:37:59.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.295+0000 7f059affd640 1 -- 172.21.15.151:0/1650928601 learned_addr learned my addr 172.21.15.151:0/1650928601 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:37:59.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.297+0000 7f059b7fe640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f059c0c3090 0x7f059c14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:59.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.299+0000 7f059affd640 1 -- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0c47b0 msgr2=0x7f059c0c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:59.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.299+0000 7f059affd640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0c47b0 0x7f059c0c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.299+0000 7f059affd640 1 -- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f059c0c3090 msgr2=0x7f059c14b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:59.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.299+0000 7f059affd640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f059c0c3090 0x7f059c14b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.299+0000 7f059affd640 1 -- 172.21.15.151:0/1650928601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c1ef6f0 con 0x7f05880047c0 2023-10-18T11:37:59.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.304+0000 7f059affd640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f059c0c50c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f058c00b970 tx=0x7f058c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:37:59.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.308+0000 7f05937fe640 1 -- 172.21.15.151:0/1650928601 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00cb40 con 0x7f05880047c0 2023-10-18T11:37:59.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.308+0000 7f05937fe640 1 -- 172.21.15.151:0/1650928601 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00ccc0 con 0x7f05880047c0 2023-10-18T11:37:59.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.308+0000 7f05937fe640 1 -- 172.21.15.151:0/1650928601 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c014680 con 0x7f05880047c0 2023-10-18T11:37:59.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.309+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c153b70 con 0x7f05880047c0 2023-10-18T11:37:59.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.309+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c1ef410 con 0x7f05880047c0 2023-10-18T11:37:59.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.310+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c0b3d60 con 0x7f05880047c0 2023-10-18T11:37:59.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.606+0000 7f05937fe640 1 -- 172.21.15.151:0/1650928601 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f058c01d3b0 con 0x7f05880047c0 2023-10-18T11:37:59.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.608+0000 7f05937fe640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f057c06aec0 0x7f057c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:37:59.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.608+0000 7f059a7fc640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f057c06aec0 0x7f057c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:37:59.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.610+0000 7f059a7fc640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f057c06aec0 0x7f057c06d380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0584034000 tx=0x7f058402f000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:37:59.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.690+0000 7f05937fe640 1 -- 172.21.15.151:0/1650928601 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f058c00ce30 con 0x7f05880047c0 2023-10-18T11:37:59.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.691+0000 7f05937fe640 1 -- 172.21.15.151:0/1650928601 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f058c0584c0 con 0x7f05880047c0 2023-10-18T11:37:59.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.890+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f059c04e160 con 0x7f05880047c0 2023-10-18T11:37:59.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.906+0000 7f05937fe640 1 -- 172.21.15.151:0/1650928601 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f058c0190a0 con 0x7f05880047c0 2023-10-18T11:37:59.909 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:37:59.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f057c06aec0 msgr2=0x7f057c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:59.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f057c06aec0 0x7f057c06d380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0584034000 tx=0x7f058402f000 comp rx=0 tx=0).stop 2023-10-18T11:37:59.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 msgr2=0x7f059c0c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:37:59.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f059c0c50c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f058c00b970 tx=0x7f058c00be30 comp rx=0 tx=0).stop 2023-10-18T11:37:59.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 shutdown_connections 2023-10-18T11:37:59.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f057c06aec0 0x7f057c06d380 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f059c0c3090 0x7f059c14b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f059c0c47b0 0x7f059c0c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 --2- 172.21.15.151:0/1650928601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05880047c0 0x7f059c0c50c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:37:59.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 >> 172.21.15.151:0/1650928601 conn(0x7f059c0659d0 msgr2=0x7f059c065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:37:59.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 shutdown_connections 2023-10-18T11:37:59.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:37:59.909+0000 7f05a13d0640 1 -- 172.21.15.151:0/1650928601 wait complete. 2023-10-18T11:37:59.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T11:38:00.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.142+0000 7f4e6619e640 1 Processor -- start 2023-10-18T11:38:00.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.143+0000 7f4e6619e640 1 -- start start 2023-10-18T11:38:00.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.144+0000 7f4e6619e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60153430 0x7f4e60071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.144+0000 7f4e6619e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4e6015c5d0 0x7f4e6015ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.144+0000 7f4e6619e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e600c51b0 con 0x7f4e600c5f10 2023-10-18T11:38:00.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.144+0000 7f4e6619e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e60070810 con 0x7f4e6015c5d0 2023-10-18T11:38:00.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.144+0000 7f4e6619e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600c5b10 con 0x7f4e60153430 2023-10-18T11:38:00.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.145+0000 7f4e5f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60153430 0x7f4e60071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.145+0000 7f4e5ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4e6015c5d0 0x7f4e6015ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.145+0000 7f4e5f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60153430 0x7f4e60071560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:45162/0 (socket says 172.21.15.151:45162) 2023-10-18T11:38:00.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.145+0000 7f4e5f7fe640 1 -- 172.21.15.151:0/1671413285 learned_addr learned my addr 172.21.15.151:0/1671413285 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:00.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.148+0000 7f4e5f7fe640 1 -- 172.21.15.151:0/1671413285 >> v2:172.21.15.169:3300/0 conn(0x7f4e6015c5d0 msgr2=0x7f4e6015ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:00.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.148+0000 7f4e5f7fe640 1 --2- 172.21.15.151:0/1671413285 >> v2:172.21.15.169:3300/0 conn(0x7f4e6015c5d0 0x7f4e6015ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.148+0000 7f4e5f7fe640 1 -- 172.21.15.151:0/1671413285 >> v1:172.21.15.169:6789/0 conn(0x7f4e600c5f10 legacy=0x7f4e6006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.148+0000 7f4e5f7fe640 1 -- 172.21.15.151:0/1671413285 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600c6350 con 0x7f4e60153430 2023-10-18T11:38:00.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.150+0000 7f4e5f7fe640 1 --2- 172.21.15.151:0/1671413285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60153430 0x7f4e60071560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e5002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e364fa7e67629dce server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:00.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.154+0000 7f4e5effd640 1 -- 172.21.15.151:0/1671413285 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50030840 con 0x7f4e60153430 2023-10-18T11:38:00.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.154+0000 7f4e5effd640 1 -- 172.21.15.151:0/1671413285 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e500309a0 con 0x7f4e60153430 2023-10-18T11:38:00.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.154+0000 7f4e5effd640 1 -- 172.21.15.151:0/1671413285 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50030d30 con 0x7f4e60153430 2023-10-18T11:38:00.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.155+0000 7f4e6619e640 1 -- 172.21.15.151:0/1671413285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60153430 msgr2=0x7f4e60071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.155+0000 7f4e6619e640 1 --2- 172.21.15.151:0/1671413285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60153430 0x7f4e60071560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e5002b980 comp rx=0 tx=0).stop 2023-10-18T11:38:00.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.155+0000 7f4e6619e640 1 -- 172.21.15.151:0/1671413285 shutdown_connections 2023-10-18T11:38:00.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.155+0000 7f4e6619e640 1 --2- 172.21.15.151:0/1671413285 >> v2:172.21.15.169:3300/0 conn(0x7f4e6015c5d0 0x7f4e6015ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.155+0000 7f4e6619e640 1 --2- 172.21.15.151:0/1671413285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e60153430 0x7f4e60071560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.155+0000 7f4e6619e640 1 -- 172.21.15.151:0/1671413285 >> 172.21.15.151:0/1671413285 conn(0x7f4e60069f70 msgr2=0x7f4e6006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:00.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.155+0000 7f4e6619e640 1 -- 172.21.15.151:0/1671413285 shutdown_connections 2023-10-18T11:38:00.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.155+0000 7f4e6619e640 1 -- 172.21.15.151:0/1671413285 wait complete. 2023-10-18T11:38:00.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.157+0000 7f4e6619e640 1 Processor -- start 2023-10-18T11:38:00.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.158+0000 7f4e6619e640 1 -- start start 2023-10-18T11:38:00.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.159+0000 7f4e6619e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e600c5f10 0x7f4e6014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.159+0000 7f4e6619e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e60153430 0x7f4e6006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.159+0000 7f4e6619e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e6015c5d0 0x7f4e60144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.159+0000 7f4e6619e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600c2080 con 0x7f4e60153430 2023-10-18T11:38:00.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.159+0000 7f4e6619e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6014a790 con 0x7f4e600c5f10 2023-10-18T11:38:00.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.159+0000 7f4e6619e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e601f22f0 con 0x7f4e6015c5d0 2023-10-18T11:38:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.159+0000 7f4e5f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e600c5f10 0x7f4e6014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.159+0000 7f4e57fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e60153430 0x7f4e6006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.160+0000 7f4e5ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e6015c5d0 0x7f4e60144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.160+0000 7f4e5f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e600c5f10 0x7f4e6014a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:48056/0 (socket says 172.21.15.151:48056) 2023-10-18T11:38:00.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.160+0000 7f4e5f7fe640 1 -- 172.21.15.151:0/381029479 learned_addr learned my addr 172.21.15.151:0/381029479 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:00.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.163+0000 7f4e5f7fe640 1 -- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e6015c5d0 msgr2=0x7f4e60144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.163+0000 7f4e5f7fe640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e6015c5d0 0x7f4e60144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.163+0000 7f4e5f7fe640 1 -- 172.21.15.151:0/381029479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e60153430 msgr2=0x7f4e6006d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.163+0000 7f4e5f7fe640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e60153430 0x7f4e6006d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.163+0000 7f4e5f7fe640 1 -- 172.21.15.151:0/381029479 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e500094d0 con 0x7f4e600c5f10 2023-10-18T11:38:00.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.165+0000 7f4e5f7fe640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e600c5f10 0x7f4e6014a250 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e50000c00 tx=0x7f4e50004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:00.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.169+0000 7f4e5cff9640 1 -- 172.21.15.151:0/381029479 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50039c90 con 0x7f4e600c5f10 2023-10-18T11:38:00.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.169+0000 7f4e5cff9640 1 -- 172.21.15.151:0/381029479 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e50039e10 con 0x7f4e600c5f10 2023-10-18T11:38:00.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.169+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e601f25b0 con 0x7f4e600c5f10 2023-10-18T11:38:00.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.169+0000 7f4e5cff9640 1 -- 172.21.15.151:0/381029479 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50043640 con 0x7f4e600c5f10 2023-10-18T11:38:00.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.170+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e601f2b70 con 0x7f4e600c5f10 2023-10-18T11:38:00.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.171+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e60151f90 con 0x7f4e600c5f10 2023-10-18T11:38:00.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.191+0000 7f4e5cff9640 1 -- 172.21.15.151:0/381029479 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4e500437a0 con 0x7f4e600c5f10 2023-10-18T11:38:00.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.192+0000 7f4e5cff9640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4e4006aef0 0x7f4e4006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.193+0000 7f4e57fff640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4e4006aef0 0x7f4e4006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.194+0000 7f4e57fff640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4e4006aef0 0x7f4e4006d3b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4e6006dc50 tx=0x7f4e48009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:00.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.425+0000 7f4e5cff9640 1 -- 172.21.15.151:0/381029479 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e5003e070 con 0x7f4e600c5f10 2023-10-18T11:38:00.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.436+0000 7f4e5cff9640 1 -- 172.21.15.151:0/381029479 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e50078130 con 0x7f4e600c5f10 2023-10-18T11:38:00.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.638+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e6004e160 con 0x7f4e600c5f10 2023-10-18T11:38:00.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.643+0000 7f4e5cff9640 1 -- 172.21.15.151:0/381029479 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e500340a0 con 0x7f4e600c5f10 2023-10-18T11:38:00.646 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-10-18T11:38:00.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4e4006aef0 msgr2=0x7f4e4006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4e4006aef0 0x7f4e4006d3b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4e6006dc50 tx=0x7f4e48009040 comp rx=0 tx=0).stop 2023-10-18T11:38:00.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e600c5f10 msgr2=0x7f4e6014a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e600c5f10 0x7f4e6014a250 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e50000c00 tx=0x7f4e50004730 comp rx=0 tx=0).stop 2023-10-18T11:38:00.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 shutdown_connections 2023-10-18T11:38:00.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e6015c5d0 0x7f4e60144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e60153430 0x7f4e6006d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4e4006aef0 0x7f4e4006d3b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 --2- 172.21.15.151:0/381029479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e600c5f10 0x7f4e6014a250 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.646+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 >> 172.21.15.151:0/381029479 conn(0x7f4e60069f70 msgr2=0x7f4e6006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:00.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.647+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 shutdown_connections 2023-10-18T11:38:00.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.647+0000 7f4e6619e640 1 -- 172.21.15.151:0/381029479 wait complete. 2023-10-18T11:38:00.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T11:38:00.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.894+0000 7f99a35f0640 1 Processor -- start 2023-10-18T11:38:00.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.894+0000 7f99a35f0640 1 -- start start 2023-10-18T11:38:00.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.896+0000 7f99a35f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c0c2180 0x7f999c06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.896+0000 7f99a35f0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999c0c25a0 con 0x7f999c06de00 2023-10-18T11:38:00.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.896+0000 7f99a35f0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999c06d430 con 0x7f999c1510a0 2023-10-18T11:38:00.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.896+0000 7f99a35f0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c151480 con 0x7f999c0c2180 2023-10-18T11:38:00.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.896+0000 7f99a138c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f999c1510a0 0x7f999c157770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:43946/0 (socket says 172.21.15.151:43946) 2023-10-18T11:38:00.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.896+0000 7f99a138c640 1 -- 172.21.15.151:0/3077471297 learned_addr learned my addr 172.21.15.151:0/3077471297 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:00.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.896+0000 7f99a0b8b640 1 --2- 172.21.15.151:0/3077471297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c0c2180 0x7f999c06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.899+0000 7f9993fff640 1 -- 172.21.15.151:0/3077471297 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935475692 0 0) 0x7f999c06d430 con 0x7f999c1510a0 2023-10-18T11:38:00.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.899+0000 7f9993fff640 1 -- 172.21.15.151:0/3077471297 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9988003520 con 0x7f999c1510a0 2023-10-18T11:38:00.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.899+0000 7f99a0b8b640 1 -- 172.21.15.151:0/3077471297 >> v1:172.21.15.169:6789/0 conn(0x7f999c1510a0 legacy=0x7f999c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.899+0000 7f99a0b8b640 1 -- 172.21.15.151:0/3077471297 >> v1:172.21.15.151:6789/0 conn(0x7f999c06de00 legacy=0x7f999c0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.899+0000 7f99a0b8b640 1 -- 172.21.15.151:0/3077471297 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0c27d0 con 0x7f999c0c2180 2023-10-18T11:38:00.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.901+0000 7f99a0b8b640 1 --2- 172.21.15.151:0/3077471297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c0c2180 0x7f999c06d8c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f998c0097d0 tx=0x7f998c02b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ab7842aa1af9915 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:00.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.905+0000 7f9993fff640 1 -- 172.21.15.151:0/3077471297 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c030890 con 0x7f999c0c2180 2023-10-18T11:38:00.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.905+0000 7f9993fff640 1 -- 172.21.15.151:0/3077471297 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c0309f0 con 0x7f999c0c2180 2023-10-18T11:38:00.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.905+0000 7f9993fff640 1 -- 172.21.15.151:0/3077471297 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c030d80 con 0x7f999c0c2180 2023-10-18T11:38:00.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.906+0000 7f99a35f0640 1 -- 172.21.15.151:0/3077471297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c0c2180 msgr2=0x7f999c06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.906+0000 7f99a35f0640 1 --2- 172.21.15.151:0/3077471297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c0c2180 0x7f999c06d8c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f998c0097d0 tx=0x7f998c02b9d0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.906+0000 7f99a35f0640 1 -- 172.21.15.151:0/3077471297 shutdown_connections 2023-10-18T11:38:00.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.906+0000 7f99a35f0640 1 --2- 172.21.15.151:0/3077471297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c0c2180 0x7f999c06d8c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.906+0000 7f99a35f0640 1 -- 172.21.15.151:0/3077471297 >> 172.21.15.151:0/3077471297 conn(0x7f999c069f70 msgr2=0x7f999c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:00.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.906+0000 7f99a35f0640 1 -- 172.21.15.151:0/3077471297 shutdown_connections 2023-10-18T11:38:00.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.906+0000 7f99a35f0640 1 -- 172.21.15.151:0/3077471297 wait complete. 2023-10-18T11:38:00.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.908+0000 7f99a35f0640 1 Processor -- start 2023-10-18T11:38:00.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.908+0000 7f99a35f0640 1 -- start start 2023-10-18T11:38:00.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.909+0000 7f99a35f0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f999c06de00 0x7f999c0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a35f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f999c0c2180 0x7f999c14f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a35f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c1510a0 0x7f999c146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a35f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c0c92e0 con 0x7f999c0c2180 2023-10-18T11:38:00.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a35f0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c0ca9c0 con 0x7f999c06de00 2023-10-18T11:38:00.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a35f0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c157150 con 0x7f999c1510a0 2023-10-18T11:38:00.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a138c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f999c06de00 0x7f999c0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a0b8b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f999c0c2180 0x7f999c14f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a1b8d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c1510a0 0x7f999c146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a138c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f999c06de00 0x7f999c0cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:48058/0 (socket says 172.21.15.151:48058) 2023-10-18T11:38:00.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.910+0000 7f99a138c640 1 -- 172.21.15.151:0/3540847983 learned_addr learned my addr 172.21.15.151:0/3540847983 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:00.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.914+0000 7f99a1b8d640 1 -- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f999c06de00 msgr2=0x7f999c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.914+0000 7f99a1b8d640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f999c06de00 0x7f999c0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.914+0000 7f99a1b8d640 1 -- 172.21.15.151:0/3540847983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f999c0c2180 msgr2=0x7f999c14f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:00.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.914+0000 7f99a1b8d640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f999c0c2180 0x7f999c14f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:00.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.914+0000 7f99a1b8d640 1 -- 172.21.15.151:0/3540847983 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c009400 con 0x7f999c1510a0 2023-10-18T11:38:00.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.916+0000 7f99a1b8d640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c1510a0 0x7f999c146ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f999400c690 tx=0x7f999400cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:00.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.920+0000 7f9991ffb640 1 -- 172.21.15.151:0/3540847983 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994003b70 con 0x7f999c1510a0 2023-10-18T11:38:00.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.920+0000 7f9991ffb640 1 -- 172.21.15.151:0/3540847983 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9994003cd0 con 0x7f999c1510a0 2023-10-18T11:38:00.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.920+0000 7f9991ffb640 1 -- 172.21.15.151:0/3540847983 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994005310 con 0x7f999c1510a0 2023-10-18T11:38:00.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.920+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c0c9b70 con 0x7f999c1510a0 2023-10-18T11:38:00.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.920+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c1573a0 con 0x7f999c1510a0 2023-10-18T11:38:00.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.922+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999c04e160 con 0x7f999c1510a0 2023-10-18T11:38:00.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.940+0000 7f9991ffb640 1 -- 172.21.15.151:0/3540847983 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9994005470 con 0x7f999c1510a0 2023-10-18T11:38:00.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.941+0000 7f9991ffb640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f998006aef0 0x7f998006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:00.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.942+0000 7f99a138c640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f998006aef0 0x7f998006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:00.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.942+0000 7f99a138c640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f998006aef0 0x7f998006d3b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99980011e0 tx=0x7f9998009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:00.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:00.944+0000 7f9991ffb640 1 -- 172.21.15.151:0/3540847983 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9994058ae0 con 0x7f999c1510a0 2023-10-18T11:38:01.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.185+0000 7f9991ffb640 1 -- 172.21.15.151:0/3540847983 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9994054e20 con 0x7f999c1510a0 2023-10-18T11:38:01.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.387+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f999c0c5960 con 0x7f999c1510a0 2023-10-18T11:38:01.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.407+0000 7f9991ffb640 1 -- 172.21.15.151:0/3540847983 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9994058440 con 0x7f999c1510a0 2023-10-18T11:38:01.410 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-10-18T11:38:01.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f998006aef0 msgr2=0x7f998006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:01.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f998006aef0 0x7f998006d3b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99980011e0 tx=0x7f9998009040 comp rx=0 tx=0).stop 2023-10-18T11:38:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c1510a0 msgr2=0x7f999c146ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c1510a0 0x7f999c146ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f999400c690 tx=0x7f999400cb50 comp rx=0 tx=0).stop 2023-10-18T11:38:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 shutdown_connections 2023-10-18T11:38:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f999c1510a0 0x7f999c146ec0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f999c0c2180 0x7f999c14f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f998006aef0 0x7f998006d3b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 --2- 172.21.15.151:0/3540847983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f999c06de00 0x7f999c0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 >> 172.21.15.151:0/3540847983 conn(0x7f999c069f70 msgr2=0x7f999c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 shutdown_connections 2023-10-18T11:38:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.410+0000 7f99a35f0640 1 -- 172.21.15.151:0/3540847983 wait complete. 2023-10-18T11:38:01.433 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T11:38:01.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.636+0000 7f3a349e9640 1 Processor -- start 2023-10-18T11:38:01.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.637+0000 7f3a349e9640 1 -- start start 2023-10-18T11:38:01.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.638+0000 7f3a349e9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3a3006e860 0x7f3a3006ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:01.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.638+0000 7f3a349e9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300c7e20 con 0x7f3a300c5070 2023-10-18T11:38:01.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.638+0000 7f3a349e9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300c5450 con 0x7f3a30159bf0 2023-10-18T11:38:01.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.638+0000 7f3a349e9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a30071f40 con 0x7f3a3006e860 2023-10-18T11:38:01.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.645+0000 7f3a2e59c640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f3a300c5070 0x7f3a30071830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:41446/0 (socket says 172.21.15.151:41446) 2023-10-18T11:38:01.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.645+0000 7f3a2e59c640 1 -- 172.21.15.151:0/3737648982 learned_addr learned my addr 172.21.15.151:0/3737648982 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:01.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.649+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862560486 0 0) 0x7f3a20001110 con 0x7f3a300c5070 2023-10-18T11:38:01.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.649+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a1c003520 con 0x7f3a300c5070 2023-10-18T11:38:01.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 <== mon.0 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1595154035 0 0) 0x7f3a1c003520 con 0x7f3a300c5070 2023-10-18T11:38:01.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 >> v2:172.21.15.169:3300/0 conn(0x7f3a3006e860 msgr2=0x7f3a3006ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:01.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 --2- 172.21.15.151:0/3737648982 >> v2:172.21.15.169:3300/0 conn(0x7f3a3006e860 0x7f3a3006ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 >> v1:172.21.15.169:6789/0 conn(0x7f3a30159bf0 legacy=0x7f3a30069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:01.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3015a040 con 0x7f3a300c5070 2023-10-18T11:38:01.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 <== mon.0 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f3a20001800 con 0x7f3a300c5070 2023-10-18T11:38:01.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 >> v1:172.21.15.151:6789/0 conn(0x7f3a300c5070 legacy=0x7f3a30071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:01.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 --2- 172.21.15.151:0/3737648982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a1c0039c0 0x7f3a1c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:01.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 --2- 172.21.15.151:0/3737648982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a1c0047c0 0x7f3a1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:01.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 --2- 172.21.15.151:0/3737648982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a1c0052a0 0x7f3a1c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:01.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30071f40 con 0x7f3a1c0047c0 2023-10-18T11:38:01.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c00c1f0 con 0x7f3a1c0039c0 2023-10-18T11:38:01.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.653+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c00c3b0 con 0x7f3a1c0052a0 2023-10-18T11:38:01.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.656+0000 7f3a27fff640 1 --2- 172.21.15.151:0/3737648982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a1c0047c0 0x7f3a1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:01.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.660+0000 7f3a27fff640 1 -- 172.21.15.151:0/3737648982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a1c0052a0 msgr2=0x7f3a1c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:01.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.660+0000 7f3a27fff640 1 --2- 172.21.15.151:0/3737648982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a1c0052a0 0x7f3a1c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.660+0000 7f3a27fff640 1 -- 172.21.15.151:0/3737648982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a1c0039c0 msgr2=0x7f3a1c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:01.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.660+0000 7f3a27fff640 1 --2- 172.21.15.151:0/3737648982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a1c0039c0 0x7f3a1c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.660+0000 7f3a27fff640 1 -- 172.21.15.151:0/3737648982 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c003520 con 0x7f3a1c0047c0 2023-10-18T11:38:01.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.660+0000 7f3a2ed9d640 1 -- 172.21.15.151:0/3737648982 reap_dead start 2023-10-18T11:38:01.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.663+0000 7f3a27fff640 1 --2- 172.21.15.151:0/3737648982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a1c0047c0 0x7f3a1c004c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a18001620 tx=0x7f3a1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc4af39ec86155f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:01.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.666+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18005070 con 0x7f3a1c0047c0 2023-10-18T11:38:01.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.668+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1802e070 con 0x7f3a1c0047c0 2023-10-18T11:38:01.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.668+0000 7f3a2dd9b640 1 -- 172.21.15.151:0/3737648982 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18005430 con 0x7f3a1c0047c0 2023-10-18T11:38:01.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.669+0000 7f3a349e9640 1 -- 172.21.15.151:0/3737648982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a1c0047c0 msgr2=0x7f3a1c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:01.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.669+0000 7f3a349e9640 1 --2- 172.21.15.151:0/3737648982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a1c0047c0 0x7f3a1c004c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a18001620 tx=0x7f3a1c0057f0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.669+0000 7f3a349e9640 1 -- 172.21.15.151:0/3737648982 shutdown_connections 2023-10-18T11:38:01.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.669+0000 7f3a349e9640 1 --2- 172.21.15.151:0/3737648982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a1c0047c0 0x7f3a1c004c40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.669+0000 7f3a349e9640 1 -- 172.21.15.151:0/3737648982 >> 172.21.15.151:0/3737648982 conn(0x7f3a3006b080 msgr2=0x7f3a3006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:01.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.669+0000 7f3a349e9640 1 -- 172.21.15.151:0/3737648982 shutdown_connections 2023-10-18T11:38:01.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.669+0000 7f3a349e9640 1 -- 172.21.15.151:0/3737648982 wait complete. 2023-10-18T11:38:01.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.671+0000 7f3a349e9640 1 Processor -- start 2023-10-18T11:38:01.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.672+0000 7f3a349e9640 1 -- start start 2023-10-18T11:38:01.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.673+0000 7f3a349e9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a1c0047c0 0x7f3a30154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:01.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.673+0000 7f3a349e9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a30156190 0x7f3a30069f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:01.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.673+0000 7f3a349e9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a30153880 0x7f3a3014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:01.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.673+0000 7f3a349e9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a301553e0 con 0x7f3a30153880 2023-10-18T11:38:01.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.673+0000 7f3a349e9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30153d70 con 0x7f3a30156190 2023-10-18T11:38:01.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.673+0000 7f3a349e9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30154050 con 0x7f3a1c0047c0 2023-10-18T11:38:01.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.673+0000 7f3a2ed9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a30153880 0x7f3a3014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:01.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.674+0000 7f3a2ed9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a30153880 0x7f3a3014e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33500/0 (socket says 172.21.15.151:33500) 2023-10-18T11:38:01.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.674+0000 7f3a2ed9d640 1 -- 172.21.15.151:0/2735092424 learned_addr learned my addr 172.21.15.151:0/2735092424 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:01.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.678+0000 7f3a2ed9d640 1 -- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a1c0047c0 msgr2=0x7f3a30154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:01.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.678+0000 7f3a2ed9d640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a1c0047c0 0x7f3a30154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.678+0000 7f3a2ed9d640 1 -- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a30156190 msgr2=0x7f3a30069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.678+0000 7f3a2ed9d640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a30156190 0x7f3a30069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.678+0000 7f3a2ed9d640 1 -- 172.21.15.151:0/2735092424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300bb370 con 0x7f3a30153880 2023-10-18T11:38:01.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.681+0000 7f3a2ed9d640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a30153880 0x7f3a3014e500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a30156d10 tx=0x7f3a2800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:01.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.683+0000 7f3a26ffd640 1 -- 172.21.15.151:0/2735092424 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2800aa20 con 0x7f3a30153880 2023-10-18T11:38:01.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.683+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a300bb650 con 0x7f3a30153880 2023-10-18T11:38:01.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.683+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a300bbc10 con 0x7f3a30153880 2023-10-18T11:38:01.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.684+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a300bbe00 con 0x7f3a30153880 2023-10-18T11:38:01.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.685+0000 7f3a26ffd640 1 -- 172.21.15.151:0/2735092424 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2800cec0 con 0x7f3a30153880 2023-10-18T11:38:01.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.686+0000 7f3a26ffd640 1 -- 172.21.15.151:0/2735092424 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2800ad80 con 0x7f3a30153880 2023-10-18T11:38:01.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.996+0000 7f3a26ffd640 1 -- 172.21.15.151:0/2735092424 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3a28012400 con 0x7f3a30153880 2023-10-18T11:38:02.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:01.999+0000 7f3a26ffd640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3a1006aea0 0x7f3a1006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:02.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.000+0000 7f3a2e59c640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3a1006aea0 0x7f3a1006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:02.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.001+0000 7f3a2e59c640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3a1006aea0 0x7f3a1006d360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a20000ff0 tx=0x7f3a200018e0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:02.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.042+0000 7f3a26ffd640 1 -- 172.21.15.151:0/2735092424 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3a280588d0 con 0x7f3a30153880 2023-10-18T11:38:02.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.043+0000 7f3a26ffd640 1 -- 172.21.15.151:0/2735092424 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a28054510 con 0x7f3a30153880 2023-10-18T11:38:02.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.265+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3a3004e160 con 0x7f3a30153880 2023-10-18T11:38:02.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.271+0000 7f3a26ffd640 1 -- 172.21.15.151:0/2735092424 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3a28017080 con 0x7f3a30153880 2023-10-18T11:38:02.274 INFO:teuthology.orchestra.run.smithi151.stderr:listed 0 entries 2023-10-18T11:38:02.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3a1006aea0 msgr2=0x7f3a1006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:02.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3a1006aea0 0x7f3a1006d360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a20000ff0 tx=0x7f3a200018e0 comp rx=0 tx=0).stop 2023-10-18T11:38:02.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a30153880 msgr2=0x7f3a3014e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:02.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a30153880 0x7f3a3014e500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a30156d10 tx=0x7f3a2800ccd0 comp rx=0 tx=0).stop 2023-10-18T11:38:02.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 shutdown_connections 2023-10-18T11:38:02.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a30153880 0x7f3a3014e500 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:02.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3a1006aea0 0x7f3a1006d360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:02.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a30156190 0x7f3a30069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:02.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 --2- 172.21.15.151:0/2735092424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a1c0047c0 0x7f3a30154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:02.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.274+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 >> 172.21.15.151:0/2735092424 conn(0x7f3a3006b080 msgr2=0x7f3a300c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:02.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.275+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 shutdown_connections 2023-10-18T11:38:02.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:02.275+0000 7f3a349e9640 1 -- 172.21.15.151:0/2735092424 wait complete. 2023-10-18T11:38:02.295 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-18T11:38:02.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:38:02.296 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-18T11:38:03.208 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:38:03.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:38:03.209 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-18T11:38:03.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:38:03.256 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-18T11:38:03.343 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-18T11:38:03.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:38:03.344 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T11:38:03.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T11:38:03.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-10-18T11:38:03.592 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-18T11:38:03.602 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-18T11:38:03.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:38:03.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.795+0000 7f8cc90da640 1 Processor -- start 2023-10-18T11:38:03.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.795+0000 7f8cc90da640 1 -- start start 2023-10-18T11:38:03.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.797+0000 7f8cc90da640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc415ad60 0x7f8cc4157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:03.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.797+0000 7f8cc90da640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40c6820 con 0x7f8cc4150ec0 2023-10-18T11:38:03.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.797+0000 7f8cc90da640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40c6b00 con 0x7f8cc40c57a0 2023-10-18T11:38:03.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.797+0000 7f8cc90da640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40c3b00 con 0x7f8cc415ad60 2023-10-18T11:38:03.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.797+0000 7f8cc2d9d640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8cc4150ec0 0x7f8cc406d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:41460/0 (socket says 172.21.15.151:41460) 2023-10-18T11:38:03.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.797+0000 7f8cc2d9d640 1 -- 172.21.15.151:0/1203634414 learned_addr learned my addr 172.21.15.151:0/1203634414 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:03.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.798+0000 7f8cc359e640 1 --2- 172.21.15.151:0/1203634414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc415ad60 0x7f8cc4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:03.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.800+0000 7f8cc259c640 1 -- 172.21.15.151:0/1203634414 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516090230 0 0) 0x7f8cc40c6820 con 0x7f8cc4150ec0 2023-10-18T11:38:03.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.801+0000 7f8cc259c640 1 -- 172.21.15.151:0/1203634414 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb0003520 con 0x7f8cc4150ec0 2023-10-18T11:38:03.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.801+0000 7f8cc259c640 1 -- 172.21.15.151:0/1203634414 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192968500 0 0) 0x7f8cc40c6b00 con 0x7f8cc40c57a0 2023-10-18T11:38:03.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.801+0000 7f8cc259c640 1 -- 172.21.15.151:0/1203634414 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc40c6820 con 0x7f8cc40c57a0 2023-10-18T11:38:03.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.801+0000 7f8cc359e640 1 -- 172.21.15.151:0/1203634414 >> v1:172.21.15.169:6789/0 conn(0x7f8cc40c57a0 legacy=0x7f8cc415a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:03.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.801+0000 7f8cc359e640 1 -- 172.21.15.151:0/1203634414 >> v1:172.21.15.151:6789/0 conn(0x7f8cc4150ec0 legacy=0x7f8cc406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:03.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.801+0000 7f8cc359e640 1 -- 172.21.15.151:0/1203634414 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40c1ab0 con 0x7f8cc415ad60 2023-10-18T11:38:03.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.804+0000 7f8cc359e640 1 --2- 172.21.15.151:0/1203634414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc415ad60 0x7f8cc4157790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009dc0 tx=0x7f8cbc02bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dbc4709f0c7070b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:03.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.807+0000 7f8cc259c640 1 -- 172.21.15.151:0/1203634414 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc02ccc0 con 0x7f8cc415ad60 2023-10-18T11:38:03.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.807+0000 7f8cc259c640 1 -- 172.21.15.151:0/1203634414 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc02ce20 con 0x7f8cc415ad60 2023-10-18T11:38:03.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.807+0000 7f8cc259c640 1 -- 172.21.15.151:0/1203634414 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc034660 con 0x7f8cc415ad60 2023-10-18T11:38:03.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.808+0000 7f8cc90da640 1 -- 172.21.15.151:0/1203634414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc415ad60 msgr2=0x7f8cc4157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:03.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.808+0000 7f8cc90da640 1 --2- 172.21.15.151:0/1203634414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc415ad60 0x7f8cc4157790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009dc0 tx=0x7f8cbc02bf10 comp rx=0 tx=0).stop 2023-10-18T11:38:03.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.808+0000 7f8cc90da640 1 -- 172.21.15.151:0/1203634414 shutdown_connections 2023-10-18T11:38:03.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.808+0000 7f8cc90da640 1 --2- 172.21.15.151:0/1203634414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc415ad60 0x7f8cc4157790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:03.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.808+0000 7f8cc90da640 1 -- 172.21.15.151:0/1203634414 >> 172.21.15.151:0/1203634414 conn(0x7f8cc40c6f10 msgr2=0x7f8cc40c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:03.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.808+0000 7f8cc90da640 1 -- 172.21.15.151:0/1203634414 shutdown_connections 2023-10-18T11:38:03.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.808+0000 7f8cc90da640 1 -- 172.21.15.151:0/1203634414 wait complete. 2023-10-18T11:38:03.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.810+0000 7f8cc90da640 1 Processor -- start 2023-10-18T11:38:03.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.810+0000 7f8cc90da640 1 -- start start 2023-10-18T11:38:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.811+0000 7f8cc90da640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc40c57a0 0x7f8cc40c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.811+0000 7f8cc90da640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc4150ec0 0x7f8cc40c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.811+0000 7f8cc90da640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc415ad60 0x7f8cc41f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.811+0000 7f8cc90da640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc41583c0 con 0x7f8cc4150ec0 2023-10-18T11:38:03.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.811+0000 7f8cc90da640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40c8680 con 0x7f8cc415ad60 2023-10-18T11:38:03.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.811+0000 7f8cc90da640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4159690 con 0x7f8cc40c57a0 2023-10-18T11:38:03.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.812+0000 7f8cc359e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc415ad60 0x7f8cc41f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:03.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.812+0000 7f8cc2d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc40c57a0 0x7f8cc40c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:03.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.812+0000 7f8cbbfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc4150ec0 0x7f8cc40c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:03.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.812+0000 7f8cc2d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc40c57a0 0x7f8cc40c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:45216/0 (socket says 172.21.15.151:45216) 2023-10-18T11:38:03.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.812+0000 7f8cc2d9d640 1 -- 172.21.15.151:0/1373201539 learned_addr learned my addr 172.21.15.151:0/1373201539 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:03.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.816+0000 7f8cc2d9d640 1 -- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc415ad60 msgr2=0x7f8cc41f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:03.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.816+0000 7f8cc2d9d640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc415ad60 0x7f8cc41f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:03.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.816+0000 7f8cc2d9d640 1 -- 172.21.15.151:0/1373201539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc4150ec0 msgr2=0x7f8cc40c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:03.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.816+0000 7f8cc2d9d640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc4150ec0 0x7f8cc40c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:03.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.816+0000 7f8cc2d9d640 1 -- 172.21.15.151:0/1373201539 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc009a70 con 0x7f8cc40c57a0 2023-10-18T11:38:03.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.818+0000 7f8cc2d9d640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc40c57a0 0x7f8cc40c8b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400c500 tx=0x7f8cb400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:03.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.822+0000 7f8cbb7fe640 1 -- 172.21.15.151:0/1373201539 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4005ce0 con 0x7f8cc40c57a0 2023-10-18T11:38:03.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.822+0000 7f8cbb7fe640 1 -- 172.21.15.151:0/1373201539 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb4005e60 con 0x7f8cc40c57a0 2023-10-18T11:38:03.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.822+0000 7f8cbb7fe640 1 -- 172.21.15.151:0/1373201539 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4007330 con 0x7f8cc40c57a0 2023-10-18T11:38:03.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.822+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc41590d0 con 0x7f8cc40c57a0 2023-10-18T11:38:03.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.822+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc40c8310 con 0x7f8cc40c57a0 2023-10-18T11:38:03.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.824+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc40c84d0 con 0x7f8cc40c57a0 2023-10-18T11:38:03.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.842+0000 7f8cbb7fe640 1 -- 172.21.15.151:0/1373201539 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8cb4007550 con 0x7f8cc40c57a0 2023-10-18T11:38:03.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.843+0000 7f8cbb7fe640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8ca406aec0 0x7f8ca406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:03.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.843+0000 7f8cbbfff640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8ca406aec0 0x7f8ca406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:03.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.844+0000 7f8cbbfff640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8ca406aec0 0x7f8ca406d380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4154cc0 tx=0x7f8cac009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:03.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:03.844+0000 7f8cbb7fe640 1 -- 172.21.15.151:0/1373201539 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8cb4013e70 con 0x7f8cc40c57a0 2023-10-18T11:38:04.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.084+0000 7f8cbb7fe640 1 -- 172.21.15.151:0/1373201539 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8cb4054280 con 0x7f8cc40c57a0 2023-10-18T11:38:04.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.279+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cc40c2070 con 0x7f8ca406aec0 2023-10-18T11:38:04.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.291+0000 7f8cbb7fe640 1 -- 172.21.15.151:0/1373201539 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370649 (secure 0 0 0) 0x7f8cac001430 con 0x7f8ca406aec0 2023-10-18T11:38:04.296 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:38:04.302 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:38:04.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8ca406aec0 msgr2=0x7f8ca406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:04.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8ca406aec0 0x7f8ca406d380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4154cc0 tx=0x7f8cac009040 comp rx=0 tx=0).stop 2023-10-18T11:38:04.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc40c57a0 msgr2=0x7f8cc40c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:04.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc40c57a0 0x7f8cc40c8b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400c500 tx=0x7f8cb400c9c0 comp rx=0 tx=0).stop 2023-10-18T11:38:04.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 shutdown_connections 2023-10-18T11:38:04.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f8ca406aec0 0x7f8ca406d380 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:04.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc415ad60 0x7f8cc41f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:04.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc4150ec0 0x7f8cc40c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:04.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 --2- 172.21.15.151:0/1373201539 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc40c57a0 0x7f8cc40c8b10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:04.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 >> 172.21.15.151:0/1373201539 conn(0x7f8cc40c6f10 msgr2=0x7f8cc4146a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:04.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 shutdown_connections 2023-10-18T11:38:04.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.302+0000 7f8cc90da640 1 -- 172.21.15.151:0/1373201539 wait complete. 2023-10-18T11:38:04.326 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":887,"stamp":"2023-10-18T11:38:02.606401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":100593805,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":4304,"num_read_kb":487225,"num_write":36977,"num_write_kb":691388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45219,"ondisk_log_size":45219,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":893032,"kb_used_data":157992,"kb_used_omap":12,"kb_used_meta":734963,"kb_avail":754081688,"statfs":{"total":773094113280,"available":772179648512,"internally_reserved":0,"allocated":161783808,"data_stored":202265090,"data_compressed":12494466,"data_compressed_allocated":19447808,"data_compressed_original":61759488,"omap_allocated":12742,"internal_metadata":752602682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":143430,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":142,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002705"},"pg_stats":[{"pgid":"2.1f","version":"31'1782","reported_seq":1816,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.435031+0000","last_change":"2023-10-18T11:09:36.796784+0000","last_active":"2023-10-18T11:37:57.435031+0000","last_peered":"2023-10-18T11:37:57.435031+0000","last_clean":"2023-10-18T11:37:57.435031+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:37:57.435031+0000","last_undegraded":"2023-10-18T11:37:57.435031+0000","last_fullsized":"2023-10-18T11:37:57.435031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1782,"log_dups_size":0,"ondisk_log_size":1782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9274710,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1779,"num_write_kb":10008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'108","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.524602+0000","last_change":"2023-10-18T11:09:39.421701+0000","last_active":"2023-10-18T11:37:04.524602+0000","last_peered":"2023-10-18T11:37:04.524602+0000","last_clean":"2023-10-18T11:37:04.524602+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:37:04.524602+0000","last_undegraded":"2023-10-18T11:37:04.524602+0000","last_fullsized":"2023-10-18T11:37:04.524602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'384","reported_seq":457,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.525040+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:37:00.525040+0000","last_peered":"2023-10-18T11:37:00.525040+0000","last_clean":"2023-10-18T11:37:00.525040+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:37:00.525040+0000","last_undegraded":"2023-10-18T11:37:00.525040+0000","last_fullsized":"2023-10-18T11:37:00.525040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":285,"num_write_kb":10314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'1437","reported_seq":1472,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:36.414409+0000","last_change":"2023-10-18T11:09:36.909894+0000","last_active":"2023-10-18T11:37:36.414409+0000","last_peered":"2023-10-18T11:37:36.414409+0000","last_clean":"2023-10-18T11:37:36.414409+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:37:36.414409+0000","last_undegraded":"2023-10-18T11:37:36.414409+0000","last_fullsized":"2023-10-18T11:37:36.414409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1437,"log_dups_size":0,"ondisk_log_size":1437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1431,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'129","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.778362+0000","last_change":"2023-10-18T11:09:39.363102+0000","last_active":"2023-10-18T11:37:04.778362+0000","last_peered":"2023-10-18T11:37:04.778362+0000","last_clean":"2023-10-18T11:37:04.778362+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:37:04.778362+0000","last_undegraded":"2023-10-18T11:37:04.778362+0000","last_fullsized":"2023-10-18T11:37:04.778362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'453","reported_seq":592,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.264450+0000","last_change":"2023-10-18T11:09:46.109981+0000","last_active":"2023-10-18T11:37:08.264450+0000","last_peered":"2023-10-18T11:37:08.264450+0000","last_clean":"2023-10-18T11:37:08.264450+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:37:08.264450+0000","last_undegraded":"2023-10-18T11:37:08.264450+0000","last_fullsized":"2023-10-18T11:37:08.264450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:26.971949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":14204,"num_write":357,"num_write_kb":21017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'815","reported_seq":847,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.512091+0000","last_change":"2023-10-18T11:09:36.896708+0000","last_active":"2023-10-18T11:37:57.512091+0000","last_peered":"2023-10-18T11:37:57.512091+0000","last_clean":"2023-10-18T11:37:57.512091+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:37:57.512091+0000","last_undegraded":"2023-10-18T11:37:57.512091+0000","last_fullsized":"2023-10-18T11:37:57.512091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3060108,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'105","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.255149+0000","last_change":"2023-10-18T11:09:39.397225+0000","last_active":"2023-10-18T11:36:58.255149+0000","last_peered":"2023-10-18T11:36:58.255149+0000","last_clean":"2023-10-18T11:36:58.255149+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:36:58.255149+0000","last_undegraded":"2023-10-18T11:36:58.255149+0000","last_fullsized":"2023-10-18T11:36:58.255149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'331","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.775789+0000","last_change":"2023-10-18T11:09:46.114798+0000","last_active":"2023-10-18T11:37:07.775789+0000","last_peered":"2023-10-18T11:37:07.775789+0000","last_clean":"2023-10-18T11:37:07.775789+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:37:07.775789+0000","last_undegraded":"2023-10-18T11:37:07.775789+0000","last_fullsized":"2023-10-18T11:37:07.775789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:57.280120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":213,"num_write_kb":9865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:34:36.253199+0000","last_change":"2023-10-18T11:09:36.795004+0000","last_active":"2023-10-18T11:34:36.253199+0000","last_peered":"2023-10-18T11:34:36.253199+0000","last_clean":"2023-10-18T11:34:36.253199+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:34:36.253199+0000","last_undegraded":"2023-10-18T11:34:36.253199+0000","last_fullsized":"2023-10-18T11:34:36.253199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'116","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.751037+0000","last_change":"2023-10-18T11:09:39.398621+0000","last_active":"2023-10-18T11:37:07.751037+0000","last_peered":"2023-10-18T11:37:07.751037+0000","last_clean":"2023-10-18T11:37:07.751037+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:37:07.751037+0000","last_undegraded":"2023-10-18T11:37:07.751037+0000","last_fullsized":"2023-10-18T11:37:07.751037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'461","reported_seq":543,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.586761+0000","last_change":"2023-10-18T11:09:46.115280+0000","last_active":"2023-10-18T11:37:03.586761+0000","last_peered":"2023-10-18T11:37:03.586761+0000","last_clean":"2023-10-18T11:37:03.586761+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:37:03.586761+0000","last_undegraded":"2023-10-18T11:37:03.586761+0000","last_fullsized":"2023-10-18T11:37:03.586761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:26.647416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":15764,"num_write":351,"num_write_kb":32860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'100","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.808165+0000","last_change":"2023-10-18T11:09:39.397253+0000","last_active":"2023-10-18T11:37:07.808165+0000","last_peered":"2023-10-18T11:37:07.808165+0000","last_clean":"2023-10-18T11:37:07.808165+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:37:07.808165+0000","last_undegraded":"2023-10-18T11:37:07.808165+0000","last_fullsized":"2023-10-18T11:37:07.808165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'767","reported_seq":800,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.393018+0000","last_change":"2023-10-18T11:09:36.893066+0000","last_active":"2023-10-18T11:37:42.393018+0000","last_peered":"2023-10-18T11:37:42.393018+0000","last_clean":"2023-10-18T11:37:42.393018+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:37:42.393018+0000","last_undegraded":"2023-10-18T11:37:42.393018+0000","last_fullsized":"2023-10-18T11:37:42.393018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:32.587464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'437","reported_seq":509,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.656541+0000","last_change":"2023-10-18T11:09:46.096113+0000","last_active":"2023-10-18T11:37:00.656541+0000","last_peered":"2023-10-18T11:37:00.656541+0000","last_clean":"2023-10-18T11:37:00.656541+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:37:00.656541+0000","last_undegraded":"2023-10-18T11:37:00.656541+0000","last_fullsized":"2023-10-18T11:37:00.656541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:09.971210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":11430,"num_write":325,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'106","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.691647+0000","last_change":"2023-10-18T11:09:39.423651+0000","last_active":"2023-10-18T11:36:59.691647+0000","last_peered":"2023-10-18T11:36:59.691647+0000","last_clean":"2023-10-18T11:36:59.691647+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:36:59.691647+0000","last_undegraded":"2023-10-18T11:36:59.691647+0000","last_fullsized":"2023-10-18T11:36:59.691647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'485","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.026143+0000","last_change":"2023-10-18T11:09:36.913611+0000","last_active":"2023-10-18T11:37:54.026143+0000","last_peered":"2023-10-18T11:37:54.026143+0000","last_clean":"2023-10-18T11:37:54.026143+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:37:54.026143+0000","last_undegraded":"2023-10-18T11:37:54.026143+0000","last_fullsized":"2023-10-18T11:37:54.026143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'427","reported_seq":518,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.167961+0000","last_change":"2023-10-18T11:09:46.114729+0000","last_active":"2023-10-18T11:37:05.167961+0000","last_peered":"2023-10-18T11:37:05.167961+0000","last_clean":"2023-10-18T11:37:05.167961+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:37:05.167961+0000","last_undegraded":"2023-10-18T11:37:05.167961+0000","last_fullsized":"2023-10-18T11:37:05.167961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:50.156790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":327,"num_write_kb":17650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'110","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.132888+0000","last_change":"2023-10-18T11:09:39.420146+0000","last_active":"2023-10-18T11:37:07.132888+0000","last_peered":"2023-10-18T11:37:07.132888+0000","last_clean":"2023-10-18T11:37:07.132888+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:37:07.132888+0000","last_undegraded":"2023-10-18T11:37:07.132888+0000","last_fullsized":"2023-10-18T11:37:07.132888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'280","reported_seq":314,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.910291+0000","last_change":"2023-10-18T11:09:36.915198+0000","last_active":"2023-10-18T11:37:42.910291+0000","last_peered":"2023-10-18T11:37:42.910291+0000","last_clean":"2023-10-18T11:37:42.910291+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:37:42.910291+0000","last_undegraded":"2023-10-18T11:37:42.910291+0000","last_fullsized":"2023-10-18T11:37:42.910291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:18.429550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'423","reported_seq":480,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:52.201304+0000","last_change":"2023-10-18T11:10:10.413988+0000","last_active":"2023-10-18T11:36:52.201304+0000","last_peered":"2023-10-18T11:36:52.201304+0000","last_clean":"2023-10-18T11:36:52.201304+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:36:52.201304+0000","last_undegraded":"2023-10-18T11:36:52.201304+0000","last_fullsized":"2023-10-18T11:36:52.201304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":324,"num_write_kb":16893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'91","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.025485+0000","last_change":"2023-10-18T11:09:39.399181+0000","last_active":"2023-10-18T11:37:00.025485+0000","last_peered":"2023-10-18T11:37:00.025485+0000","last_clean":"2023-10-18T11:37:00.025485+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:37:00.025485+0000","last_undegraded":"2023-10-18T11:37:00.025485+0000","last_fullsized":"2023-10-18T11:37:00.025485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:13.349921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.981750+0000","last_change":"2023-10-18T11:09:36.797637+0000","last_active":"2023-10-18T11:37:42.981750+0000","last_peered":"2023-10-18T11:37:42.981750+0000","last_clean":"2023-10-18T11:37:42.981750+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:37:42.981750+0000","last_undegraded":"2023-10-18T11:37:42.981750+0000","last_fullsized":"2023-10-18T11:37:42.981750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:08.109221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'432","reported_seq":615,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.552717+0000","last_change":"2023-10-18T11:09:46.109408+0000","last_active":"2023-10-18T11:37:04.552717+0000","last_peered":"2023-10-18T11:37:04.552717+0000","last_clean":"2023-10-18T11:37:04.552717+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:37:04.552717+0000","last_undegraded":"2023-10-18T11:37:04.552717+0000","last_fullsized":"2023-10-18T11:37:04.552717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":19825,"num_write":333,"num_write_kb":19445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'103","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.854148+0000","last_change":"2023-10-18T11:09:39.366234+0000","last_active":"2023-10-18T11:36:55.854148+0000","last_peered":"2023-10-18T11:36:55.854148+0000","last_clean":"2023-10-18T11:36:55.854148+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:36:55.854148+0000","last_undegraded":"2023-10-18T11:36:55.854148+0000","last_fullsized":"2023-10-18T11:36:55.854148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.152488+0000","last_change":"2023-10-18T11:09:36.896533+0000","last_active":"2023-10-18T11:37:54.152488+0000","last_peered":"2023-10-18T11:37:54.152488+0000","last_clean":"2023-10-18T11:37:54.152488+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:37:54.152488+0000","last_undegraded":"2023-10-18T11:37:54.152488+0000","last_fullsized":"2023-10-18T11:37:54.152488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'438","reported_seq":520,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.518223+0000","last_change":"2023-10-18T11:09:46.094196+0000","last_active":"2023-10-18T11:37:03.518223+0000","last_peered":"2023-10-18T11:37:03.518223+0000","last_clean":"2023-10-18T11:37:03.518223+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:37:03.518223+0000","last_undegraded":"2023-10-18T11:37:03.518223+0000","last_fullsized":"2023-10-18T11:37:03.518223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:43.456989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":16856,"num_write":335,"num_write_kb":23716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'108","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.131193+0000","last_change":"2023-10-18T11:09:39.420016+0000","last_active":"2023-10-18T11:37:07.131193+0000","last_peered":"2023-10-18T11:37:07.131193+0000","last_clean":"2023-10-18T11:37:07.131193+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:37:07.131193+0000","last_undegraded":"2023-10-18T11:37:07.131193+0000","last_fullsized":"2023-10-18T11:37:07.131193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'288","reported_seq":322,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.247981+0000","last_change":"2023-10-18T11:09:36.913659+0000","last_active":"2023-10-18T11:37:56.247981+0000","last_peered":"2023-10-18T11:37:56.247981+0000","last_clean":"2023-10-18T11:37:56.247981+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:37:56.247981+0000","last_undegraded":"2023-10-18T11:37:56.247981+0000","last_fullsized":"2023-10-18T11:37:56.247981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'450","reported_seq":535,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.819051+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:37:08.819051+0000","last_peered":"2023-10-18T11:37:08.819051+0000","last_clean":"2023-10-18T11:37:08.819051+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:37:08.819051+0000","last_undegraded":"2023-10-18T11:37:08.819051+0000","last_fullsized":"2023-10-18T11:37:08.819051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":337,"num_write_kb":25264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'104","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.551663+0000","last_change":"2023-10-18T11:09:39.243607+0000","last_active":"2023-10-18T11:37:03.551663+0000","last_peered":"2023-10-18T11:37:03.551663+0000","last_clean":"2023-10-18T11:37:03.551663+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:37:03.551663+0000","last_undegraded":"2023-10-18T11:37:03.551663+0000","last_fullsized":"2023-10-18T11:37:03.551663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'242","reported_seq":276,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:40.777847+0000","last_change":"2023-10-18T11:09:36.798396+0000","last_active":"2023-10-18T11:37:40.777847+0000","last_peered":"2023-10-18T11:37:40.777847+0000","last_clean":"2023-10-18T11:37:40.777847+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:37:40.777847+0000","last_undegraded":"2023-10-18T11:37:40.777847+0000","last_fullsized":"2023-10-18T11:37:40.777847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:04.311252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'490","reported_seq":562,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:53.863488+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:36:53.863488+0000","last_peered":"2023-10-18T11:36:53.863488+0000","last_clean":"2023-10-18T11:36:53.863488+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:36:53.863488+0000","last_undegraded":"2023-10-18T11:36:53.863488+0000","last_fullsized":"2023-10-18T11:36:53.863488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":390,"num_write_kb":31170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'136","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.283144+0000","last_change":"2023-10-18T11:09:39.417304+0000","last_active":"2023-10-18T11:37:07.283144+0000","last_peered":"2023-10-18T11:37:07.283144+0000","last_clean":"2023-10-18T11:37:07.283144+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:37:07.283144+0000","last_undegraded":"2023-10-18T11:37:07.283144+0000","last_fullsized":"2023-10-18T11:37:07.283144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'790","reported_seq":824,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:31.939729+0000","last_change":"2023-10-18T11:09:36.909623+0000","last_active":"2023-10-18T11:37:31.939729+0000","last_peered":"2023-10-18T11:37:31.939729+0000","last_clean":"2023-10-18T11:37:31.939729+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:37:31.939729+0000","last_undegraded":"2023-10-18T11:37:31.939729+0000","last_fullsized":"2023-10-18T11:37:31.939729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'468","reported_seq":527,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.789125+0000","last_change":"2023-10-18T11:09:46.100735+0000","last_active":"2023-10-18T11:36:58.789125+0000","last_peered":"2023-10-18T11:36:58.789125+0000","last_clean":"2023-10-18T11:36:58.789125+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:36:58.789125+0000","last_undegraded":"2023-10-18T11:36:58.789125+0000","last_fullsized":"2023-10-18T11:36:58.789125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":9414,"num_write":343,"num_write_kb":17104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'108","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:53.879961+0000","last_change":"2023-10-18T11:09:39.400602+0000","last_active":"2023-10-18T11:36:53.879961+0000","last_peered":"2023-10-18T11:36:53.879961+0000","last_clean":"2023-10-18T11:36:53.879961+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:36:53.879961+0000","last_undegraded":"2023-10-18T11:36:53.879961+0000","last_fullsized":"2023-10-18T11:36:53.879961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:37.020893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1648","reported_seq":1682,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.966733+0000","last_change":"2023-10-18T11:09:36.915028+0000","last_active":"2023-10-18T11:37:53.966733+0000","last_peered":"2023-10-18T11:37:53.966733+0000","last_clean":"2023-10-18T11:37:53.966733+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:37:53.966733+0000","last_undegraded":"2023-10-18T11:37:53.966733+0000","last_fullsized":"2023-10-18T11:37:53.966733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1639,"num_write_kb":9112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'412","reported_seq":497,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.555132+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:37:03.555132+0000","last_peered":"2023-10-18T11:37:03.555132+0000","last_clean":"2023-10-18T11:37:03.555132+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:37:03.555132+0000","last_undegraded":"2023-10-18T11:37:03.555132+0000","last_fullsized":"2023-10-18T11:37:03.555132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":14478,"num_write":303,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'106","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.760732+0000","last_change":"2023-10-18T11:09:39.243829+0000","last_active":"2023-10-18T11:37:07.760732+0000","last_peered":"2023-10-18T11:37:07.760732+0000","last_clean":"2023-10-18T11:37:07.760732+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:37:07.760732+0000","last_undegraded":"2023-10-18T11:37:07.760732+0000","last_fullsized":"2023-10-18T11:37:07.760732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'1264","reported_seq":1755,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:58.340539+0000","last_change":"2023-10-18T11:09:36.910270+0000","last_active":"2023-10-18T11:37:58.340539+0000","last_peered":"2023-10-18T11:37:58.340539+0000","last_clean":"2023-10-18T11:37:58.340539+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:37:58.340539+0000","last_undegraded":"2023-10-18T11:37:58.340539+0000","last_fullsized":"2023-10-18T11:37:58.340539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4329052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":492,"num_write":1258,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'421","reported_seq":527,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.303116+0000","last_change":"2023-10-18T11:09:46.114610+0000","last_active":"2023-10-18T11:37:07.303116+0000","last_peered":"2023-10-18T11:37:07.303116+0000","last_clean":"2023-10-18T11:37:07.303116+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:37:07.303116+0000","last_undegraded":"2023-10-18T11:37:07.303116+0000","last_fullsized":"2023-10-18T11:37:07.303116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":19812,"num_write":327,"num_write_kb":12739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'102","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:52.025272+0000","last_change":"2023-10-18T11:09:39.404210+0000","last_active":"2023-10-18T11:36:52.025272+0000","last_peered":"2023-10-18T11:36:52.025272+0000","last_clean":"2023-10-18T11:36:52.025272+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:36:52.025272+0000","last_undegraded":"2023-10-18T11:36:52.025272+0000","last_fullsized":"2023-10-18T11:36:52.025272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'373","reported_seq":408,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.981272+0000","last_change":"2023-10-18T11:09:36.913804+0000","last_active":"2023-10-18T11:37:42.981272+0000","last_peered":"2023-10-18T11:37:42.981272+0000","last_clean":"2023-10-18T11:37:42.981272+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:37:42.981272+0000","last_undegraded":"2023-10-18T11:37:42.981272+0000","last_fullsized":"2023-10-18T11:37:42.981272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956268,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'424","reported_seq":516,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:06.995346+0000","last_change":"2023-10-18T11:09:46.092566+0000","last_active":"2023-10-18T11:37:06.995346+0000","last_peered":"2023-10-18T11:37:06.995346+0000","last_clean":"2023-10-18T11:37:06.995346+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:37:06.995346+0000","last_undegraded":"2023-10-18T11:37:06.995346+0000","last_fullsized":"2023-10-18T11:37:06.995346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:42.848835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":329,"num_write_kb":22819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'106","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:56.609366+0000","last_change":"2023-10-18T11:09:39.422507+0000","last_active":"2023-10-18T11:36:56.609366+0000","last_peered":"2023-10-18T11:36:56.609366+0000","last_clean":"2023-10-18T11:36:56.609366+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:36:56.609366+0000","last_undegraded":"2023-10-18T11:36:56.609366+0000","last_fullsized":"2023-10-18T11:36:56.609366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'9","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.822485+0000","last_change":"2023-10-18T11:09:36.828474+0000","last_active":"2023-10-18T11:37:16.822485+0000","last_peered":"2023-10-18T11:37:16.822485+0000","last_clean":"2023-10-18T11:37:16.822485+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:37:16.822485+0000","last_undegraded":"2023-10-18T11:37:16.822485+0000","last_fullsized":"2023-10-18T11:37:16.822485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:35:21.257875+0000","last_change":"2023-10-18T11:09:19.365660+0000","last_active":"2023-10-18T11:35:21.257875+0000","last_peered":"2023-10-18T11:35:21.257875+0000","last_clean":"2023-10-18T11:35:21.257875+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:35:21.257875+0000","last_undegraded":"2023-10-18T11:35:21.257875+0000","last_fullsized":"2023-10-18T11:35:21.257875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_clean_scrub_stamp":"2023-10-18T11:09:17.711667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:34:53.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'526","reported_seq":631,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.294647+0000","last_change":"2023-10-18T11:09:46.118571+0000","last_active":"2023-10-18T11:37:07.294647+0000","last_peered":"2023-10-18T11:37:07.294647+0000","last_clean":"2023-10-18T11:37:07.294647+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:37:07.294647+0000","last_undegraded":"2023-10-18T11:37:07.294647+0000","last_fullsized":"2023-10-18T11:37:07.294647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:46.781070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":19822,"num_write":415,"num_write_kb":19524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'114","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.707662+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:36:59.707662+0000","last_peered":"2023-10-18T11:36:59.707662+0000","last_clean":"2023-10-18T11:36:59.707662+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:36:59.707662+0000","last_undegraded":"2023-10-18T11:36:59.707662+0000","last_fullsized":"2023-10-18T11:36:59.707662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'899","reported_seq":932,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:36.378659+0000","last_change":"2023-10-18T11:09:36.829100+0000","last_active":"2023-10-18T11:36:36.378659+0000","last_peered":"2023-10-18T11:36:36.378659+0000","last_clean":"2023-10-18T11:36:36.378659+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:36:36.378659+0000","last_undegraded":"2023-10-18T11:36:36.378659+0000","last_fullsized":"2023-10-18T11:36:36.378659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'411","reported_seq":522,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.809149+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:37:07.809149+0000","last_peered":"2023-10-18T11:37:07.809149+0000","last_clean":"2023-10-18T11:37:07.809149+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:37:07.809149+0000","last_undegraded":"2023-10-18T11:37:07.809149+0000","last_fullsized":"2023-10-18T11:37:07.809149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":18796,"num_write":308,"num_write_kb":13390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'100","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.585947+0000","last_change":"2023-10-18T11:09:39.419862+0000","last_active":"2023-10-18T11:37:03.585947+0000","last_peered":"2023-10-18T11:37:03.585947+0000","last_clean":"2023-10-18T11:37:03.585947+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:37:03.585947+0000","last_undegraded":"2023-10-18T11:37:03.585947+0000","last_fullsized":"2023-10-18T11:37:03.585947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'1290","reported_seq":1323,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.409200+0000","last_change":"2023-10-18T11:09:36.912905+0000","last_active":"2023-10-18T11:37:56.409200+0000","last_peered":"2023-10-18T11:37:56.409200+0000","last_clean":"2023-10-18T11:37:56.409200+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:37:56.409200+0000","last_undegraded":"2023-10-18T11:37:56.409200+0000","last_fullsized":"2023-10-18T11:37:56.409200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7520680,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'435","reported_seq":548,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.568333+0000","last_change":"2023-10-18T11:09:46.097744+0000","last_active":"2023-10-18T11:37:03.568333+0000","last_peered":"2023-10-18T11:37:03.568333+0000","last_clean":"2023-10-18T11:37:03.568333+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:37:03.568333+0000","last_undegraded":"2023-10-18T11:37:03.568333+0000","last_fullsized":"2023-10-18T11:37:03.568333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:20.073279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":340,"num_write_kb":14424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'98","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:51.638498+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:36:51.638498+0000","last_peered":"2023-10-18T11:36:51.638498+0000","last_clean":"2023-10-18T11:36:51.638498+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:36:51.638498+0000","last_undegraded":"2023-10-18T11:36:51.638498+0000","last_fullsized":"2023-10-18T11:36:51.638498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:51.220855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'7","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:36.378712+0000","last_change":"2023-10-18T11:09:36.907280+0000","last_active":"2023-10-18T11:36:36.378712+0000","last_peered":"2023-10-18T11:36:36.378712+0000","last_clean":"2023-10-18T11:36:36.378712+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:36:36.378712+0000","last_undegraded":"2023-10-18T11:36:36.378712+0000","last_fullsized":"2023-10-18T11:36:36.378712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'409","reported_seq":498,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.751846+0000","last_change":"2023-10-18T11:09:46.096894+0000","last_active":"2023-10-18T11:37:07.751846+0000","last_peered":"2023-10-18T11:37:07.751846+0000","last_clean":"2023-10-18T11:37:07.751846+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:37:07.751846+0000","last_undegraded":"2023-10-18T11:37:07.751846+0000","last_fullsized":"2023-10-18T11:37:07.751846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":17064,"num_write":295,"num_write_kb":17834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'106","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.565157+0000","last_change":"2023-10-18T11:09:39.399750+0000","last_active":"2023-10-18T11:37:04.565157+0000","last_peered":"2023-10-18T11:37:04.565157+0000","last_clean":"2023-10-18T11:37:04.565157+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:37:04.565157+0000","last_undegraded":"2023-10-18T11:37:04.565157+0000","last_fullsized":"2023-10-18T11:37:04.565157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:35.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'253","reported_seq":286,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.049497+0000","last_change":"2023-10-18T11:09:36.897906+0000","last_active":"2023-10-18T11:37:54.049497+0000","last_peered":"2023-10-18T11:37:54.049497+0000","last_clean":"2023-10-18T11:37:54.049497+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:37:54.049497+0000","last_undegraded":"2023-10-18T11:37:54.049497+0000","last_fullsized":"2023-10-18T11:37:54.049497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:41:27.304152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'390","reported_seq":458,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.563216+0000","last_change":"2023-10-18T11:09:46.109151+0000","last_active":"2023-10-18T11:37:03.563216+0000","last_peered":"2023-10-18T11:37:03.563216+0000","last_clean":"2023-10-18T11:37:03.563216+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:37:03.563216+0000","last_undegraded":"2023-10-18T11:37:03.563216+0000","last_fullsized":"2023-10-18T11:37:03.563216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:41.785820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":302,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.153530+0000","last_change":"2023-10-18T11:09:39.397483+0000","last_active":"2023-10-18T11:37:05.153530+0000","last_peered":"2023-10-18T11:37:05.153530+0000","last_clean":"2023-10-18T11:37:05.153530+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:37:05.153530+0000","last_undegraded":"2023-10-18T11:37:05.153530+0000","last_fullsized":"2023-10-18T11:37:05.153530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'1792","reported_seq":1825,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.572727+0000","last_change":"2023-10-18T11:09:36.916080+0000","last_active":"2023-10-18T11:37:57.572727+0000","last_peered":"2023-10-18T11:37:57.572727+0000","last_clean":"2023-10-18T11:37:57.572727+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:37:57.572727+0000","last_undegraded":"2023-10-18T11:37:57.572727+0000","last_fullsized":"2023-10-18T11:37:57.572727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:22.058134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":9197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'468","reported_seq":550,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:56.570360+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:36:56.570360+0000","last_peered":"2023-10-18T11:36:56.570360+0000","last_clean":"2023-10-18T11:36:56.570360+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:36:56.570360+0000","last_undegraded":"2023-10-18T11:36:56.570360+0000","last_fullsized":"2023-10-18T11:36:56.570360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":372,"num_write_kb":11119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.777715+0000","last_change":"2023-10-18T11:09:39.358262+0000","last_active":"2023-10-18T11:37:04.777715+0000","last_peered":"2023-10-18T11:37:04.777715+0000","last_clean":"2023-10-18T11:37:04.777715+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:37:04.777715+0000","last_undegraded":"2023-10-18T11:37:04.777715+0000","last_fullsized":"2023-10-18T11:37:04.777715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'909","reported_seq":942,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:40.118546+0000","last_change":"2023-10-18T11:09:36.893045+0000","last_active":"2023-10-18T11:37:40.118546+0000","last_peered":"2023-10-18T11:37:40.118546+0000","last_clean":"2023-10-18T11:37:40.118546+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:37:40.118546+0000","last_undegraded":"2023-10-18T11:37:40.118546+0000","last_fullsized":"2023-10-18T11:37:40.118546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'408","reported_seq":477,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.655594+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:37:00.655594+0000","last_peered":"2023-10-18T11:37:00.655594+0000","last_clean":"2023-10-18T11:37:00.655594+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:37:00.655594+0000","last_undegraded":"2023-10-18T11:37:00.655594+0000","last_fullsized":"2023-10-18T11:37:00.655594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:27.567970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":10922,"num_write":302,"num_write_kb":9791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'114","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.992359+0000","last_change":"2023-10-18T11:09:39.399188+0000","last_active":"2023-10-18T11:37:04.992359+0000","last_peered":"2023-10-18T11:37:04.992359+0000","last_clean":"2023-10-18T11:37:04.992359+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:37:04.992359+0000","last_undegraded":"2023-10-18T11:37:04.992359+0000","last_fullsized":"2023-10-18T11:37:04.992359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'1001","reported_seq":1034,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.671167+0000","last_change":"2023-10-18T11:09:36.905576+0000","last_active":"2023-10-18T11:37:54.671167+0000","last_peered":"2023-10-18T11:37:54.671167+0000","last_clean":"2023-10-18T11:37:54.671167+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:37:54.671167+0000","last_undegraded":"2023-10-18T11:37:54.671167+0000","last_fullsized":"2023-10-18T11:37:54.671167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1001,"log_dups_size":0,"ondisk_log_size":1001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":4702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'374","reported_seq":447,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.509846+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:37:03.509846+0000","last_peered":"2023-10-18T11:37:03.509846+0000","last_clean":"2023-10-18T11:37:03.509846+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:37:03.509846+0000","last_undegraded":"2023-10-18T11:37:03.509846+0000","last_fullsized":"2023-10-18T11:37:03.509846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:47.871773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":12454,"num_write":279,"num_write_kb":12302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'115","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.517027+0000","last_change":"2023-10-18T11:09:39.361805+0000","last_active":"2023-10-18T11:37:03.517027+0000","last_peered":"2023-10-18T11:37:03.517027+0000","last_clean":"2023-10-18T11:37:03.517027+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:37:03.517027+0000","last_undegraded":"2023-10-18T11:37:03.517027+0000","last_fullsized":"2023-10-18T11:37:03.517027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'404","reported_seq":828,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.660982+0000","last_change":"2023-10-18T11:09:36.894141+0000","last_active":"2023-10-18T11:37:54.660982+0000","last_peered":"2023-10-18T11:37:54.660982+0000","last_clean":"2023-10-18T11:37:54.660982+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:37:54.660982+0000","last_undegraded":"2023-10-18T11:37:54.660982+0000","last_fullsized":"2023-10-18T11:37:54.660982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":443,"num_write":404,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'508","reported_seq":637,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.390056+0000","last_change":"2023-10-18T11:09:46.114944+0000","last_active":"2023-10-18T11:37:04.390056+0000","last_peered":"2023-10-18T11:37:04.390056+0000","last_clean":"2023-10-18T11:37:04.390056+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:37:04.390056+0000","last_undegraded":"2023-10-18T11:37:04.390056+0000","last_fullsized":"2023-10-18T11:37:04.390056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":22458,"num_write":413,"num_write_kb":26305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'101","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.994506+0000","last_change":"2023-10-18T11:09:39.420430+0000","last_active":"2023-10-18T11:36:55.994506+0000","last_peered":"2023-10-18T11:36:55.994506+0000","last_clean":"2023-10-18T11:36:55.994506+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:36:55.994506+0000","last_undegraded":"2023-10-18T11:36:55.994506+0000","last_fullsized":"2023-10-18T11:36:55.994506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:12.994704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1124","reported_seq":1157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.963360+0000","last_change":"2023-10-18T11:09:36.904648+0000","last_active":"2023-10-18T11:37:53.963360+0000","last_peered":"2023-10-18T11:37:53.963360+0000","last_clean":"2023-10-18T11:37:53.963360+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:37:53.963360+0000","last_undegraded":"2023-10-18T11:37:53.963360+0000","last_fullsized":"2023-10-18T11:37:53.963360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'423","reported_seq":501,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.097162+0000","last_change":"2023-10-18T11:09:46.101866+0000","last_active":"2023-10-18T11:37:05.097162+0000","last_peered":"2023-10-18T11:37:05.097162+0000","last_clean":"2023-10-18T11:37:05.097162+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:37:05.097162+0000","last_undegraded":"2023-10-18T11:37:05.097162+0000","last_fullsized":"2023-10-18T11:37:05.097162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:41.150485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":12954,"num_write":319,"num_write_kb":22076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.402120+0000","last_change":"2023-10-18T11:09:39.398597+0000","last_active":"2023-10-18T11:37:00.402120+0000","last_peered":"2023-10-18T11:37:00.402120+0000","last_clean":"2023-10-18T11:37:00.402120+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:37:00.402120+0000","last_undegraded":"2023-10-18T11:37:00.402120+0000","last_fullsized":"2023-10-18T11:37:00.402120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:10.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'280","reported_seq":312,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.665451+0000","last_change":"2023-10-18T11:09:36.913285+0000","last_active":"2023-10-18T11:37:54.665451+0000","last_peered":"2023-10-18T11:37:54.665451+0000","last_clean":"2023-10-18T11:37:54.665451+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:37:54.665451+0000","last_undegraded":"2023-10-18T11:37:54.665451+0000","last_fullsized":"2023-10-18T11:37:54.665451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'511","reported_seq":600,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.825243+0000","last_change":"2023-10-18T11:09:46.094205+0000","last_active":"2023-10-18T11:37:08.825243+0000","last_peered":"2023-10-18T11:37:08.825243+0000","last_clean":"2023-10-18T11:37:08.825243+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:37:08.825243+0000","last_undegraded":"2023-10-18T11:37:08.825243+0000","last_fullsized":"2023-10-18T11:37:08.825243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:13.509608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":22028,"num_write":389,"num_write_kb":39504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'110","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.388245+0000","last_change":"2023-10-18T11:09:39.363739+0000","last_active":"2023-10-18T11:37:00.388245+0000","last_peered":"2023-10-18T11:37:00.388245+0000","last_clean":"2023-10-18T11:37:00.388245+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:37:00.388245+0000","last_undegraded":"2023-10-18T11:37:00.388245+0000","last_fullsized":"2023-10-18T11:37:00.388245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:52.069782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'400","reported_seq":822,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:31.927344+0000","last_change":"2023-10-18T11:09:36.896767+0000","last_active":"2023-10-18T11:37:31.927344+0000","last_peered":"2023-10-18T11:37:31.927344+0000","last_clean":"2023-10-18T11:37:31.927344+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:37:31.927344+0000","last_undegraded":"2023-10-18T11:37:31.927344+0000","last_fullsized":"2023-10-18T11:37:31.927344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180134,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":390,"num_read_kb":469,"num_write":396,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'442","reported_seq":537,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.774393+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:37:04.774393+0000","last_peered":"2023-10-18T11:37:04.774393+0000","last_clean":"2023-10-18T11:37:04.774393+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:37:04.774393+0000","last_undegraded":"2023-10-18T11:37:04.774393+0000","last_fullsized":"2023-10-18T11:37:04.774393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17404,"num_write":347,"num_write_kb":27808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'113","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:52.328137+0000","last_change":"2023-10-18T11:09:39.351468+0000","last_active":"2023-10-18T11:36:52.328137+0000","last_peered":"2023-10-18T11:36:52.328137+0000","last_clean":"2023-10-18T11:36:52.328137+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:36:52.328137+0000","last_undegraded":"2023-10-18T11:36:52.328137+0000","last_fullsized":"2023-10-18T11:36:52.328137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'186","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.886900+0000","last_change":"2023-10-18T11:09:36.896596+0000","last_active":"2023-10-18T11:37:42.886900+0000","last_peered":"2023-10-18T11:37:42.886900+0000","last_clean":"2023-10-18T11:37:42.886900+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:37:42.886900+0000","last_undegraded":"2023-10-18T11:37:42.886900+0000","last_fullsized":"2023-10-18T11:37:42.886900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'380","reported_seq":473,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.146546+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:37:05.146546+0000","last_peered":"2023-10-18T11:37:05.146546+0000","last_clean":"2023-10-18T11:37:05.146546+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:37:05.146546+0000","last_undegraded":"2023-10-18T11:37:05.146546+0000","last_fullsized":"2023-10-18T11:37:05.146546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":277,"num_write_kb":11173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'503","reported_seq":585,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.159115+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:37:07.159115+0000","last_peered":"2023-10-18T11:37:07.159115+0000","last_clean":"2023-10-18T11:37:07.159115+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:37:07.159115+0000","last_undegraded":"2023-10-18T11:37:07.159115+0000","last_fullsized":"2023-10-18T11:37:07.159115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:09.785576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":392,"num_write_kb":15493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'123","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.528664+0000","last_change":"2023-10-18T11:09:39.418416+0000","last_active":"2023-10-18T11:37:00.528664+0000","last_peered":"2023-10-18T11:37:00.528664+0000","last_clean":"2023-10-18T11:37:00.528664+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:37:00.528664+0000","last_undegraded":"2023-10-18T11:37:00.528664+0000","last_fullsized":"2023-10-18T11:37:00.528664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'1033","reported_seq":1065,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.964257+0000","last_change":"2023-10-18T11:09:36.893158+0000","last_active":"2023-10-18T11:37:53.964257+0000","last_peered":"2023-10-18T11:37:53.964257+0000","last_clean":"2023-10-18T11:37:53.964257+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:37:53.964257+0000","last_undegraded":"2023-10-18T11:37:53.964257+0000","last_fullsized":"2023-10-18T11:37:53.964257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119259,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":6520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'495","reported_seq":600,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.153166+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:37:05.153166+0000","last_peered":"2023-10-18T11:37:05.153166+0000","last_clean":"2023-10-18T11:37:05.153166+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:37:05.153166+0000","last_undegraded":"2023-10-18T11:37:05.153166+0000","last_fullsized":"2023-10-18T11:37:05.153166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":22638,"num_write":397,"num_write_kb":22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'126","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.264492+0000","last_change":"2023-10-18T11:09:39.421160+0000","last_active":"2023-10-18T11:37:08.264492+0000","last_peered":"2023-10-18T11:37:08.264492+0000","last_clean":"2023-10-18T11:37:08.264492+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:37:08.264492+0000","last_undegraded":"2023-10-18T11:37:08.264492+0000","last_fullsized":"2023-10-18T11:37:08.264492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'472","reported_seq":968,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.886860+0000","last_change":"2023-10-18T11:09:36.911629+0000","last_active":"2023-10-18T11:37:42.886860+0000","last_peered":"2023-10-18T11:37:42.886860+0000","last_clean":"2023-10-18T11:37:42.886860+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:37:42.886860+0000","last_undegraded":"2023-10-18T11:37:42.886860+0000","last_fullsized":"2023-10-18T11:37:42.886860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:53.929992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":464,"num_read_kb":507,"num_write":469,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'1258","reported_seq":1759,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.546699+0000","last_change":"2023-10-18T11:09:36.894351+0000","last_active":"2023-10-18T11:37:57.546699+0000","last_peered":"2023-10-18T11:37:57.546699+0000","last_clean":"2023-10-18T11:37:57.546699+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:37:57.546699+0000","last_undegraded":"2023-10-18T11:37:57.546699+0000","last_fullsized":"2023-10-18T11:37:57.546699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:11.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4346422,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":505,"num_write":1257,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'110","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.809537+0000","last_change":"2023-10-18T11:09:39.404508+0000","last_active":"2023-10-18T11:37:07.809537+0000","last_peered":"2023-10-18T11:37:07.809537+0000","last_clean":"2023-10-18T11:37:07.809537+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:37:07.809537+0000","last_undegraded":"2023-10-18T11:37:07.809537+0000","last_fullsized":"2023-10-18T11:37:07.809537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'380","reported_seq":476,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.259191+0000","last_change":"2023-10-18T11:09:46.117246+0000","last_active":"2023-10-18T11:36:58.259191+0000","last_peered":"2023-10-18T11:36:58.259191+0000","last_clean":"2023-10-18T11:36:58.259191+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:36:58.259191+0000","last_undegraded":"2023-10-18T11:36:58.259191+0000","last_fullsized":"2023-10-18T11:36:58.259191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:59.808082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":9856,"num_write":276,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2733","reported_seq":2765,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.975579+0000","last_change":"2023-10-18T11:09:36.912013+0000","last_active":"2023-10-18T11:37:42.975579+0000","last_peered":"2023-10-18T11:37:42.975579+0000","last_clean":"2023-10-18T11:37:42.975579+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:37:42.975579+0000","last_undegraded":"2023-10-18T11:37:42.975579+0000","last_fullsized":"2023-10-18T11:37:42.975579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2733,"log_dups_size":0,"ondisk_log_size":2733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:49.950001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2726,"num_write_kb":13571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'125","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.585465+0000","last_change":"2023-10-18T11:09:39.400362+0000","last_active":"2023-10-18T11:37:03.585465+0000","last_peered":"2023-10-18T11:37:03.585465+0000","last_clean":"2023-10-18T11:37:03.585465+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:37:03.585465+0000","last_undegraded":"2023-10-18T11:37:03.585465+0000","last_fullsized":"2023-10-18T11:37:03.585465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:50.136754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'415","reported_seq":490,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.751948+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:37:07.751948+0000","last_peered":"2023-10-18T11:37:07.751948+0000","last_clean":"2023-10-18T11:37:07.751948+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:37:07.751948+0000","last_undegraded":"2023-10-18T11:37:07.751948+0000","last_fullsized":"2023-10-18T11:37:07.751948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:52:09.414015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":317,"num_write_kb":9906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'130","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.106481+0000","last_change":"2023-10-18T11:09:39.359747+0000","last_active":"2023-10-18T11:37:07.106481+0000","last_peered":"2023-10-18T11:37:07.106481+0000","last_clean":"2023-10-18T11:37:07.106481+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:37:07.106481+0000","last_undegraded":"2023-10-18T11:37:07.106481+0000","last_fullsized":"2023-10-18T11:37:07.106481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'106","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.635598+0000","last_change":"2023-10-18T11:09:39.242600+0000","last_active":"2023-10-18T11:36:59.635598+0000","last_peered":"2023-10-18T11:36:59.635598+0000","last_clean":"2023-10-18T11:36:59.635598+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:36:59.635598+0000","last_undegraded":"2023-10-18T11:36:59.635598+0000","last_fullsized":"2023-10-18T11:36:59.635598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:45.076093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'122","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.788629+0000","last_change":"2023-10-18T11:10:10.416758+0000","last_active":"2023-10-18T11:36:58.788629+0000","last_peered":"2023-10-18T11:36:58.788629+0000","last_clean":"2023-10-18T11:36:58.788629+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:36:58.788629+0000","last_undegraded":"2023-10-18T11:36:58.788629+0000","last_fullsized":"2023-10-18T11:36:58.788629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"31'107","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:47.039197+0000","last_change":"2023-10-18T11:09:39.425505+0000","last_active":"2023-10-18T11:36:47.039197+0000","last_peered":"2023-10-18T11:36:47.039197+0000","last_clean":"2023-10-18T11:36:47.039197+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:36:47.039197+0000","last_undegraded":"2023-10-18T11:36:47.039197+0000","last_fullsized":"2023-10-18T11:36:47.039197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'106","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.754258+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:36:58.754258+0000","last_peered":"2023-10-18T11:36:58.754258+0000","last_clean":"2023-10-18T11:36:58.754258+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:36:58.754258+0000","last_undegraded":"2023-10-18T11:36:58.754258+0000","last_fullsized":"2023-10-18T11:36:58.754258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'110","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.107357+0000","last_change":"2023-10-18T11:09:39.423043+0000","last_active":"2023-10-18T11:37:00.107357+0000","last_peered":"2023-10-18T11:37:00.107357+0000","last_clean":"2023-10-18T11:37:00.107357+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:37:00.107357+0000","last_undegraded":"2023-10-18T11:37:00.107357+0000","last_fullsized":"2023-10-18T11:37:00.107357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'105","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.104886+0000","last_change":"2023-10-18T11:09:39.351604+0000","last_active":"2023-10-18T11:37:07.104886+0000","last_peered":"2023-10-18T11:37:07.104886+0000","last_clean":"2023-10-18T11:37:07.104886+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:37:07.104886+0000","last_undegraded":"2023-10-18T11:37:07.104886+0000","last_fullsized":"2023-10-18T11:37:07.104886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'96","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.283402+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:37:07.283402+0000","last_peered":"2023-10-18T11:37:07.283402+0000","last_clean":"2023-10-18T11:37:07.283402+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:37:07.283402+0000","last_undegraded":"2023-10-18T11:37:07.283402+0000","last_fullsized":"2023-10-18T11:37:07.283402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'102","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.750784+0000","last_change":"2023-10-18T11:09:39.419909+0000","last_active":"2023-10-18T11:37:07.750784+0000","last_peered":"2023-10-18T11:37:07.750784+0000","last_clean":"2023-10-18T11:37:07.750784+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:37:07.750784+0000","last_undegraded":"2023-10-18T11:37:07.750784+0000","last_fullsized":"2023-10-18T11:37:07.750784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'103","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.539412+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:37:03.539412+0000","last_peered":"2023-10-18T11:37:03.539412+0000","last_clean":"2023-10-18T11:37:03.539412+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:37:03.539412+0000","last_undegraded":"2023-10-18T11:37:03.539412+0000","last_fullsized":"2023-10-18T11:37:03.539412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'103","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.783007+0000","last_change":"2023-10-18T11:09:39.349250+0000","last_active":"2023-10-18T11:36:58.783007+0000","last_peered":"2023-10-18T11:36:58.783007+0000","last_clean":"2023-10-18T11:36:58.783007+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:36:58.783007+0000","last_undegraded":"2023-10-18T11:36:58.783007+0000","last_fullsized":"2023-10-18T11:36:58.783007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'112","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.568180+0000","last_change":"2023-10-18T11:09:39.361414+0000","last_active":"2023-10-18T11:37:03.568180+0000","last_peered":"2023-10-18T11:37:03.568180+0000","last_clean":"2023-10-18T11:37:03.568180+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:37:03.568180+0000","last_undegraded":"2023-10-18T11:37:03.568180+0000","last_fullsized":"2023-10-18T11:37:03.568180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'122","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.149975+0000","last_change":"2023-10-18T11:09:39.399067+0000","last_active":"2023-10-18T11:37:05.149975+0000","last_peered":"2023-10-18T11:37:05.149975+0000","last_clean":"2023-10-18T11:37:05.149975+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:37:05.149975+0000","last_undegraded":"2023-10-18T11:37:05.149975+0000","last_fullsized":"2023-10-18T11:37:05.149975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'110","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.435315+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:37:00.435315+0000","last_peered":"2023-10-18T11:37:00.435315+0000","last_clean":"2023-10-18T11:37:00.435315+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:37:00.435315+0000","last_undegraded":"2023-10-18T11:37:00.435315+0000","last_fullsized":"2023-10-18T11:37:00.435315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:04.730798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'119","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.571978+0000","last_change":"2023-10-18T11:09:39.320727+0000","last_active":"2023-10-18T11:37:03.571978+0000","last_peered":"2023-10-18T11:37:03.571978+0000","last_clean":"2023-10-18T11:37:03.571978+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:37:03.571978+0000","last_undegraded":"2023-10-18T11:37:03.571978+0000","last_fullsized":"2023-10-18T11:37:03.571978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'113","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:47.332981+0000","last_change":"2023-10-18T11:10:10.401580+0000","last_active":"2023-10-18T11:36:47.332981+0000","last_peered":"2023-10-18T11:36:47.332981+0000","last_clean":"2023-10-18T11:36:47.332981+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:36:47.332981+0000","last_undegraded":"2023-10-18T11:36:47.332981+0000","last_fullsized":"2023-10-18T11:36:47.332981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'106","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.524718+0000","last_change":"2023-10-18T11:09:39.354336+0000","last_active":"2023-10-18T11:37:04.524718+0000","last_peered":"2023-10-18T11:37:04.524718+0000","last_clean":"2023-10-18T11:37:04.524718+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:37:04.524718+0000","last_undegraded":"2023-10-18T11:37:04.524718+0000","last_fullsized":"2023-10-18T11:37:04.524718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'105","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.245394+0000","last_change":"2023-10-18T11:09:39.401976+0000","last_active":"2023-10-18T11:37:04.245394+0000","last_peered":"2023-10-18T11:37:04.245394+0000","last_clean":"2023-10-18T11:37:04.245394+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:37:04.245394+0000","last_undegraded":"2023-10-18T11:37:04.245394+0000","last_fullsized":"2023-10-18T11:37:04.245394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'100","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.150755+0000","last_change":"2023-10-18T11:09:39.366222+0000","last_active":"2023-10-18T11:37:05.150755+0000","last_peered":"2023-10-18T11:37:05.150755+0000","last_clean":"2023-10-18T11:37:05.150755+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:37:05.150755+0000","last_undegraded":"2023-10-18T11:37:05.150755+0000","last_fullsized":"2023-10-18T11:37:05.150755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:52.729507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'131","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.667410+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:37:03.667410+0000","last_peered":"2023-10-18T11:37:03.667410+0000","last_clean":"2023-10-18T11:37:03.667410+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:37:03.667410+0000","last_undegraded":"2023-10-18T11:37:03.667410+0000","last_fullsized":"2023-10-18T11:37:03.667410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:37:38.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'100","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.882110+0000","last_change":"2023-10-18T11:09:39.400563+0000","last_active":"2023-10-18T11:36:55.882110+0000","last_peered":"2023-10-18T11:36:55.882110+0000","last_clean":"2023-10-18T11:36:55.882110+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:36:55.882110+0000","last_undegraded":"2023-10-18T11:36:55.882110+0000","last_fullsized":"2023-10-18T11:36:55.882110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:24.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'119","reported_seq":148,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.428378+0000","last_change":"2023-10-18T11:09:39.320580+0000","last_active":"2023-10-18T11:37:04.428378+0000","last_peered":"2023-10-18T11:37:04.428378+0000","last_clean":"2023-10-18T11:37:04.428378+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:37:04.428378+0000","last_undegraded":"2023-10-18T11:37:04.428378+0000","last_fullsized":"2023-10-18T11:37:04.428378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'106","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.989231+0000","last_change":"2023-10-18T11:09:39.320508+0000","last_active":"2023-10-18T11:36:55.989231+0000","last_peered":"2023-10-18T11:36:55.989231+0000","last_clean":"2023-10-18T11:36:55.989231+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:36:55.989231+0000","last_undegraded":"2023-10-18T11:36:55.989231+0000","last_fullsized":"2023-10-18T11:36:55.989231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'112","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:44.149989+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:36:44.149989+0000","last_peered":"2023-10-18T11:36:44.149989+0000","last_clean":"2023-10-18T11:36:44.149989+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:36:44.149989+0000","last_undegraded":"2023-10-18T11:36:44.149989+0000","last_fullsized":"2023-10-18T11:36:44.149989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:11.432343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'103","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.239560+0000","last_change":"2023-10-18T11:09:39.421921+0000","last_active":"2023-10-18T11:36:58.239560+0000","last_peered":"2023-10-18T11:36:58.239560+0000","last_clean":"2023-10-18T11:36:58.239560+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:36:58.239560+0000","last_undegraded":"2023-10-18T11:36:58.239560+0000","last_fullsized":"2023-10-18T11:36:58.239560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'94","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.154928+0000","last_change":"2023-10-18T11:09:39.360846+0000","last_active":"2023-10-18T11:37:00.154928+0000","last_peered":"2023-10-18T11:37:00.154928+0000","last_clean":"2023-10-18T11:37:00.154928+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:37:00.154928+0000","last_undegraded":"2023-10-18T11:37:00.154928+0000","last_fullsized":"2023-10-18T11:37:00.154928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'109","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.846187+0000","last_change":"2023-10-18T11:10:10.413563+0000","last_active":"2023-10-18T11:36:59.846187+0000","last_peered":"2023-10-18T11:36:59.846187+0000","last_clean":"2023-10-18T11:36:59.846187+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:36:59.846187+0000","last_undegraded":"2023-10-18T11:36:59.846187+0000","last_fullsized":"2023-10-18T11:36:59.846187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:43.078216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'96","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.708016+0000","last_change":"2023-10-18T11:09:39.355047+0000","last_active":"2023-10-18T11:36:59.708016+0000","last_peered":"2023-10-18T11:36:59.708016+0000","last_clean":"2023-10-18T11:36:59.708016+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:36:59.708016+0000","last_undegraded":"2023-10-18T11:36:59.708016+0000","last_fullsized":"2023-10-18T11:36:59.708016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'99","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:56.193047+0000","last_change":"2023-10-18T11:09:39.418362+0000","last_active":"2023-10-18T11:36:56.193047+0000","last_peered":"2023-10-18T11:36:56.193047+0000","last_clean":"2023-10-18T11:36:56.193047+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:36:56.193047+0000","last_undegraded":"2023-10-18T11:36:56.193047+0000","last_fullsized":"2023-10-18T11:36:56.193047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'95","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.659659+0000","last_change":"2023-10-18T11:09:39.363750+0000","last_active":"2023-10-18T11:37:00.659659+0000","last_peered":"2023-10-18T11:37:00.659659+0000","last_clean":"2023-10-18T11:37:00.659659+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:37:00.659659+0000","last_undegraded":"2023-10-18T11:37:00.659659+0000","last_fullsized":"2023-10-18T11:37:00.659659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:43.536873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'127","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.459754+0000","last_change":"2023-10-18T11:09:39.363259+0000","last_active":"2023-10-18T11:37:04.459754+0000","last_peered":"2023-10-18T11:37:04.459754+0000","last_clean":"2023-10-18T11:37:04.459754+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:37:04.459754+0000","last_undegraded":"2023-10-18T11:37:04.459754+0000","last_fullsized":"2023-10-18T11:37:04.459754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'98","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.385034+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:37:00.385034+0000","last_peered":"2023-10-18T11:37:00.385034+0000","last_clean":"2023-10-18T11:37:00.385034+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:37:00.385034+0000","last_undegraded":"2023-10-18T11:37:00.385034+0000","last_fullsized":"2023-10-18T11:37:00.385034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:34.071910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2017,"num_read_kb":484709,"num_write":10619,"num_write_kb":576779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13929,"ondisk_log_size":13929,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6924,"ondisk_log_size":6924,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":100003437,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":2171,"num_read_kb":2416,"num_write":26199,"num_write_kb":112193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159002624,"data_stored":200006214,"data_compressed":12429396,"data_compressed_allocated":19357696,"data_compressed_original":60612608,"omap_allocated":0,"internal_metadata":0},"log_size":24249,"ondisk_log_size":24249,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509791,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113704,"kb_used_data":24224,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94258136,"statfs":{"total":96636764160,"available":96520331264,"internally_reserved":0,"allocated":24805376,"data_stored":31793700,"data_compressed":2010206,"data_compressed_allocated":3112960,"data_compressed_original":10338304,"omap_allocated":1588,"internal_metadata":91617740},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.45100000000000001,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.85799999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.69699999999999995},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":19.158000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.91900000000000004,"15min":0.72999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":19.673999999999999,"15min":19.673999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.88100000000000001,"15min":0.74299999999999999},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.36099999999999999},"max":{"1min":1.01,"5min":15.692,"15min":15.692},"last":0.67300000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.224,"5min":1.27,"15min":1.9239999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71499999999999997,"15min":0.68700000000000006},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95999999999999996,"5min":5.444,"15min":5.444},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.93000000000000005,"15min":0.82099999999999995},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0660000000000001,"5min":12.368,"15min":12.368},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.67400000000000004,"15min":0.71799999999999997},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":1.353,"5min":1.3899999999999999,"15min":13.1},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.439,"5min":1.895,"15min":1.895},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47099999999999997,"5min":1.321,"15min":1.321},"last":0.375}]},{"osd":5,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53600000000000003,"5min":0.85099999999999998,"15min":1.081},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.438,"15min":0.40899999999999997},"min":{"1min":0.30099999999999999,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.505,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.42199999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.439,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":0.55100000000000005,"5min":3.4409999999999998,"15min":3.4409999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54100000000000004,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.40999999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509789,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93740,"kb_used_data":18148,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278100,"statfs":{"total":96636764160,"available":96540774400,"internally_reserved":0,"allocated":18583552,"data_stored":23213633,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.64400000000000002},"min":{"1min":0.435,"5min":0.33600000000000002,"15min":0.31},"max":{"1min":0.82399999999999995,"5min":1.0740000000000001,"15min":9.3190000000000008},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59699999999999998,"15min":0.66700000000000004},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.28899999999999998},"max":{"1min":1.046,"5min":1.1699999999999999,"15min":15.282999999999999},"last":0.61199999999999999}]},{"osd":1,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61199999999999999,"15min":0.65100000000000002},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.0880000000000001,"5min":1.202,"15min":6.6429999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97999999999999998,"5min":1.153,"15min":1.748},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.35799999999999998,"15min":0.33300000000000002},"max":{"1min":1.05,"5min":1.355,"15min":1.839},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34499999999999997},"max":{"1min":1.153,"5min":1.468,"15min":1.954},"last":0.83099999999999996}]},{"osd":3,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":1.2410000000000001,"15min":13.840999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.77400000000000002},"min":{"1min":0.45700000000000002,"5min":0.36199999999999999,"15min":0.35099999999999998},"max":{"1min":1.0109999999999999,"5min":1.1950000000000001,"15min":23.155999999999999},"last":0.93899999999999995}]},{"osd":4,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25600000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52300000000000002,"5min":0.54100000000000004,"15min":0.88},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.46800000000000003,"5min":0.53500000000000003,"15min":1.0469999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.23300000000000001},"max":{"1min":0.501,"5min":0.54300000000000004,"15min":0.56799999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56100000000000005,"5min":0.624,"15min":0.624},"last":0.39100000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.40100000000000002},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.77600000000000002},"last":0.374},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41599999999999998,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57299999999999995,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.40200000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509790,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87864,"kb_used_data":20592,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94283976,"statfs":{"total":96636764160,"available":96546791424,"internally_reserved":0,"allocated":21086208,"data_stored":26657141,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.62,"15min":0.629},"min":{"1min":0.46000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1990000000000001,"5min":1.663,"15min":1.663},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.32500000000000001},"max":{"1min":1.2290000000000001,"5min":1.3720000000000001,"15min":1.8620000000000001},"last":0.629},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.34100000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.399,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.629,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.248},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90100000000000002,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.92800000000000005}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.38300000000000001,"15min":0.373},"max":{"1min":1.1299999999999999,"5min":1.4930000000000001,"15min":1.5049999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":1.244,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.223},"max":{"1min":0.50800000000000001,"5min":0.51500000000000001,"15min":0.72699999999999998},"last":0.504},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.622},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.67400000000000004},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.68999999999999995},"last":0.55700000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509789,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144544,"kb_used_data":27288,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94227296,"statfs":{"total":96636764160,"available":96488751104,"internally_reserved":0,"allocated":27942912,"data_stored":33976532,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":1591,"internal_metadata":120060361},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3260000000000001,"15min":1.129},"min":{"1min":0.70999999999999996,"5min":0.40899999999999997,"15min":0.314},"max":{"1min":2.673,"5min":24.654,"15min":24.654},"last":0.878},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.3380000000000001,"15min":1.159},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":2.1589999999999998,"5min":18.518000000000001,"15min":18.518000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3759999999999999,"15min":1.25},"min":{"1min":0.64500000000000002,"5min":0.441,"15min":0.35399999999999998},"max":{"1min":2.7869999999999999,"5min":16.361999999999998,"15min":16.361999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.5189999999999999,"15min":1.3620000000000001},"min":{"1min":0.72299999999999998,"5min":0.56200000000000006,"15min":0.43099999999999999},"max":{"1min":1.7769999999999999,"5min":24.611000000000001,"15min":24.611000000000001},"last":1.1899999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5029999999999999,"15min":1.395},"min":{"1min":0.49099999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.7269999999999999,"5min":16.576000000000001,"15min":16.576000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.6419999999999999,"15min":1.484},"min":{"1min":0.83199999999999996,"5min":0.46500000000000002,"15min":0.45100000000000001},"max":{"1min":2.04,"5min":24.553000000000001,"15min":24.553000000000001},"last":1.0529999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.4339999999999999,"15min":1.224},"min":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.432},"max":{"1min":2.3170000000000002,"5min":18.721,"15min":18.721},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3560000000000001,"15min":1.26},"min":{"1min":0.66800000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2189999999999999,"5min":16.481000000000002,"15min":16.481000000000002},"last":0.98799999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.5589999999999999,"15min":1.377},"min":{"1min":0.73299999999999998,"5min":0.59799999999999998,"15min":0.44700000000000001},"max":{"1min":2.2519999999999998,"5min":24.786999999999999,"15min":24.786999999999999},"last":1.149},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.6080000000000001,"15min":1.355},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.49199999999999999},"max":{"1min":2.464,"5min":18.681999999999999,"15min":18.681999999999999},"last":0.93200000000000005}]},{"osd":6,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4870000000000001,"15min":1.3959999999999999},"min":{"1min":0.67800000000000005,"5min":0.56100000000000005,"15min":0.52900000000000003},"max":{"1min":2.0129999999999999,"5min":16.513999999999999,"15min":16.513999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.665,"15min":1.496},"min":{"1min":0.79300000000000004,"5min":0.65600000000000003,"15min":0.54300000000000004},"max":{"1min":2.3580000000000001,"5min":24.834,"15min":24.834},"last":1.3480000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.681,"15min":1.4670000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.298,"5min":18.800000000000001,"15min":18.800000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.607,"5min":1.6200000000000001,"15min":1.5169999999999999},"min":{"1min":0.84399999999999997,"5min":0.496,"15min":0.496},"max":{"1min":2.5510000000000002,"5min":16.544,"15min":16.544},"last":1.389}]}]},{"osd":2,"up_from":15,"seq":64424509789,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94552,"kb_used_data":13456,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94277288,"statfs":{"total":96636764160,"available":96539942912,"internally_reserved":0,"allocated":13778944,"data_stored":17047576,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.66600000000000004,"5min":0.378,"15min":0.308},"max":{"1min":2.1139999999999999,"5min":2.5830000000000002,"15min":2.9249999999999998},"last":1.528},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.1200000000000001,"15min":1.1259999999999999},"min":{"1min":0.436,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.964},"last":1.419}]},{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2410000000000001,"15min":1.214},"min":{"1min":0.628,"5min":0.45300000000000001,"15min":0.40200000000000002},"max":{"1min":2.4060000000000001,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.369,"15min":1.3},"min":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.014}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.448,"15min":1.379},"min":{"1min":0.61499999999999999,"5min":0.44,"15min":0.44},"max":{"1min":4.1459999999999999,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.5049999999999999,"15min":1.3999999999999999},"min":{"1min":0.90200000000000002,"5min":0.55400000000000005,"15min":0.53900000000000003},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.2050000000000001,"15min":1.1419999999999999},"min":{"1min":0.55600000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.3759999999999999,"5min":3.3759999999999999,"15min":3.3759999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2729999999999999,"15min":1.2170000000000001},"min":{"1min":0.63200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.4830000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.3759999999999999,"15min":1.2609999999999999},"min":{"1min":0.752,"5min":0.58399999999999996,"15min":0.46200000000000002},"max":{"1min":5.0529999999999999,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":1.345},{"interface":"front","average":{"1min":1.532,"5min":1.3640000000000001,"15min":1.27},"min":{"1min":0.65900000000000003,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.175}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.407,"15min":1.333},"min":{"1min":0.80000000000000004,"5min":0.60199999999999998,"15min":0.49399999999999999},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.4850000000000001,"15min":1.371},"min":{"1min":1.01,"5min":0.68100000000000005,"15min":0.50700000000000001},"max":{"1min":5.133,"5min":5.133,"15min":5.133},"last":1.446}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.4690000000000001,"15min":1.3879999999999999},"min":{"1min":0.72899999999999998,"5min":0.52500000000000002,"15min":0.48599999999999999},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.544,"15min":1.456},"min":{"1min":0.84899999999999998,"5min":0.629,"15min":0.55900000000000005},"max":{"1min":4.0430000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":1.2829999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509790,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153264,"kb_used_data":23592,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94218576,"statfs":{"total":96636764160,"available":96479821824,"internally_reserved":0,"allocated":24158208,"data_stored":30584192,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0920000000000001,"15min":1.101},"min":{"1min":0.63400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.716,"5min":2.5649999999999999,"15min":10.836},"last":1.393},{"interface":"front","average":{"1min":1.232,"5min":1.143,"15min":1.131},"min":{"1min":0.71899999999999997,"5min":0.46999999999999997,"15min":0.42599999999999999},"max":{"1min":2.536,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":1.357}]},{"osd":2,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2110000000000001,"15min":1.1950000000000001},"min":{"1min":0.53700000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.3900000000000001,"5min":4.0670000000000002,"15min":4.4199999999999999},"last":1.321},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3149999999999999,"15min":1.3180000000000001},"min":{"1min":0.60099999999999998,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":1.776,"5min":2.8799999999999999,"15min":10.782},"last":1.2629999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.4239999999999999},"min":{"1min":0.68000000000000005,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":2.028,"5min":4.8380000000000001,"15min":6.8150000000000004},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.3169999999999999,"15min":1.333},"min":{"1min":0.93899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.1200000000000001,"5min":3.79,"15min":3.79},"last":1.4550000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.163,"15min":1.1739999999999999},"min":{"1min":0.496,"5min":0.376,"15min":0.376},"max":{"1min":1.647,"5min":3.9670000000000001,"15min":4.3890000000000002},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.248,"15min":1.2829999999999999},"min":{"1min":0.72799999999999998,"5min":0.63300000000000001,"15min":0.60899999999999999},"max":{"1min":1.821,"5min":2.6349999999999998,"15min":6.9950000000000001},"last":1.1519999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2609999999999999,"15min":1.2390000000000001},"min":{"1min":0.624,"5min":0.58599999999999997,"15min":0.495},"max":{"1min":3.5430000000000001,"5min":3.5840000000000001,"15min":3.5840000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2929999999999999,"15min":1.3069999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52900000000000003},"max":{"1min":1.8660000000000001,"5min":3.9169999999999998,"15min":4.3419999999999996},"last":1.218}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.397,"15min":1.4099999999999999},"min":{"1min":0.77600000000000002,"5min":0.67700000000000005,"15min":0.66000000000000003},"max":{"1min":2.0249999999999999,"5min":2.7400000000000002,"15min":6.944},"last":1.639},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":0.66700000000000004,"5min":0.628,"15min":0.55300000000000005},"max":{"1min":3.3849999999999998,"5min":3.657,"15min":3.657},"last":1.5660000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.4630000000000001,"15min":1.4470000000000001},"min":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":3.27,"5min":3.722,"15min":3.722},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.444,"15min":1.45},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.0350000000000001,"5min":4.0149999999999997,"15min":4.2919999999999998},"last":1.704}]}]},{"osd":0,"up_from":15,"seq":64424509790,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106768,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94265072,"statfs":{"total":96636764160,"available":96527433728,"internally_reserved":0,"allocated":17768448,"data_stored":22730274,"data_compressed":1487303,"data_compressed_allocated":2297856,"data_compressed_original":7491584,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.97999999999999998,"15min":1.03},"min":{"1min":0.53400000000000003,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":1.365,"5min":2.0299999999999998,"15min":5.7380000000000004},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.048,"15min":1.1819999999999999},"min":{"1min":0.65700000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":20.128},"last":1.085}]},{"osd":2,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.141,"15min":1.2130000000000001},"min":{"1min":0.67600000000000005,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":2.1040000000000001,"5min":2.8039999999999998,"15min":3.2839999999999998},"last":1.012},{"interface":"front","average":{"1min":1.169,"5min":1.1890000000000001,"15min":1.278},"min":{"1min":0.76000000000000001,"5min":0.38900000000000001,"15min":0.31900000000000001},"max":{"1min":2.0640000000000001,"5min":2.4580000000000002,"15min":3.3690000000000002},"last":1.631}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.2529999999999999,"15min":1.2769999999999999},"min":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.44600000000000001},"max":{"1min":2.3570000000000002,"5min":4.0510000000000002,"15min":8.9879999999999995},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.363,"15min":1.4199999999999999},"min":{"1min":0.73799999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.2080000000000002,"5min":2.7639999999999998,"15min":5.6219999999999999},"last":1.4319999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.232,"15min":1.202},"min":{"1min":1.006,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":1.954,"5min":2.044,"15min":2.976},"last":1.752},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.147,"15min":1.159},"min":{"1min":0.754,"5min":0.53800000000000003,"15min":0.51800000000000002},"max":{"1min":2.028,"5min":2.1779999999999999,"15min":3.6219999999999999},"last":1.2829999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.75600000000000001,"5min":0.52300000000000002,"15min":0.49099999999999999},"max":{"1min":1.9990000000000001,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3089999999999999,"15min":1.288},"min":{"1min":0.79100000000000004,"5min":0.59299999999999997,"15min":0.56200000000000006},"max":{"1min":2.125,"5min":2.2349999999999999,"15min":2.8140000000000001},"last":1.5649999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.3759999999999999,"15min":1.359},"min":{"1min":0.83499999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2410000000000001,"5min":2.274,"15min":2.7669999999999999},"last":1.72},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.3620000000000001,"15min":1.3500000000000001},"min":{"1min":0.80800000000000005,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":2.0579999999999998,"5min":2.1040000000000001,"15min":3.7669999999999999},"last":1.8200000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.4450000000000001,"15min":1.4319999999999999},"min":{"1min":1.042,"5min":0.56599999999999995,"15min":0.49199999999999999},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":3.915},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.363,"15min":1.375},"min":{"1min":0.85799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.1779999999999999,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1.3839999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542493,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98596,"kb_used_data":13340,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273244,"statfs":{"total":96636764160,"available":96535801856,"internally_reserved":0,"allocated":13660160,"data_stored":16262042,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.27300000000000002},"max":{"1min":1.1459999999999999,"5min":3.387,"15min":3.387},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.40999999999999998,"5min":0.33300000000000002,"15min":0.31},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.90900000000000003}]},{"osd":1,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.25},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.377},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.53000000000000003,"5min":0.38200000000000001,"15min":0.312},"max":{"1min":1.081,"5min":1.554,"15min":1.669},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.34999999999999998},"max":{"1min":1.1850000000000001,"5min":1.2070000000000001,"15min":1.712},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94299999999999995,"5min":1.1000000000000001,"15min":1.1950000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3200000000000001,"5min":1.427,"15min":2.694},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":1.0680000000000001,"5min":1.7929999999999999,"15min":2.1459999999999999},"last":0.83099999999999996}]},{"osd":4,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.503,"5min":0.55600000000000005,"15min":0.63700000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26500000000000001},"max":{"1min":0.45900000000000002,"5min":0.57599999999999996,"15min":0.68600000000000005},"last":0.308}]},{"osd":5,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.252},"max":{"1min":0.47699999999999998,"5min":0.65700000000000003,"15min":0.85199999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39200000000000002,"15min":0.39700000000000002},"min":{"1min":0.316,"5min":0.28899999999999998,"15min":0.26300000000000001},"max":{"1min":0.49199999999999999,"5min":0.65800000000000003,"15min":0.67000000000000004},"last":0.25}]},{"osd":7,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.54200000000000004,"5min":0.63600000000000001,"15min":0.77600000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52300000000000002,"5min":0.68300000000000005,"15min":0.80000000000000004},"last":0.26700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17371136,"data_stored":22005056,"data_compressed":1454768,"data_compressed_allocated":2252800,"data_compressed_original":6918144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23826432,"data_stored":30449342,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13447168,"data_stored":16912726,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27611136,"data_stored":33841682,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20754432,"data_stored":26522291,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":23078783,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13328384,"data_stored":16127192,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24412160,"data_stored":31069142,"data_compressed":1977671,"data_compressed_allocated":3067904,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:38:04.333 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:38:04.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.583+0000 7f75fb075640 1 Processor -- start 2023-10-18T11:38:04.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.583+0000 7f75fb075640 1 -- start start 2023-10-18T11:38:04.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.585+0000 7f75fb075640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f75f415ad60 0x7f75f4157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:04.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.585+0000 7f75fb075640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f40c6820 con 0x7f75f40c57a0 2023-10-18T11:38:04.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.585+0000 7f75fb075640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f40c6b00 con 0x7f75f4150ec0 2023-10-18T11:38:04.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.585+0000 7f75fb075640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f40c3b00 con 0x7f75f415ad60 2023-10-18T11:38:04.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.585+0000 7f75f8e11640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f75f4150ec0 0x7f75f406d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:43990/0 (socket says 172.21.15.151:43990) 2023-10-18T11:38:04.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.585+0000 7f75f8e11640 1 -- 172.21.15.151:0/4126095372 learned_addr learned my addr 172.21.15.151:0/4126095372 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:04.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.585+0000 7f75f9612640 1 --2- 172.21.15.151:0/4126095372 >> v2:172.21.15.151:3300/0 conn(0x7f75f415ad60 0x7f75f4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:04.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.587+0000 7f75f37fe640 1 -- 172.21.15.151:0/4126095372 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078829430 0 0) 0x7f75f40c6b00 con 0x7f75f4150ec0 2023-10-18T11:38:04.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.588+0000 7f75f37fe640 1 -- 172.21.15.151:0/4126095372 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e0003520 con 0x7f75f4150ec0 2023-10-18T11:38:04.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.590+0000 7f75f9612640 1 -- 172.21.15.151:0/4126095372 >> v1:172.21.15.169:6789/0 conn(0x7f75f4150ec0 legacy=0x7f75f406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:04.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.590+0000 7f75f9612640 1 -- 172.21.15.151:0/4126095372 >> v1:172.21.15.151:6789/0 conn(0x7f75f40c57a0 legacy=0x7f75f415a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:04.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.590+0000 7f75f9612640 1 -- 172.21.15.151:0/4126095372 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40c1ab0 con 0x7f75f415ad60 2023-10-18T11:38:04.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.595+0000 7f75f9612640 1 --2- 172.21.15.151:0/4126095372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f415ad60 0x7f75f4157790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009dc0 tx=0x7f75ec02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07b1a764223b018 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:04.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.601+0000 7f75f37fe640 1 -- 172.21.15.151:0/4126095372 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec02cce0 con 0x7f75f415ad60 2023-10-18T11:38:04.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.601+0000 7f75f37fe640 1 -- 172.21.15.151:0/4126095372 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec02ce40 con 0x7f75f415ad60 2023-10-18T11:38:04.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.601+0000 7f75f37fe640 1 -- 172.21.15.151:0/4126095372 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec034660 con 0x7f75f415ad60 2023-10-18T11:38:04.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.602+0000 7f75fb075640 1 -- 172.21.15.151:0/4126095372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f415ad60 msgr2=0x7f75f4157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:04.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.602+0000 7f75fb075640 1 --2- 172.21.15.151:0/4126095372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f415ad60 0x7f75f4157790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009dc0 tx=0x7f75ec02bf30 comp rx=0 tx=0).stop 2023-10-18T11:38:04.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.602+0000 7f75fb075640 1 -- 172.21.15.151:0/4126095372 shutdown_connections 2023-10-18T11:38:04.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.602+0000 7f75fb075640 1 --2- 172.21.15.151:0/4126095372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f415ad60 0x7f75f4157790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:04.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.602+0000 7f75fb075640 1 -- 172.21.15.151:0/4126095372 >> 172.21.15.151:0/4126095372 conn(0x7f75f40c6f10 msgr2=0x7f75f40c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:04.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.602+0000 7f75fb075640 1 -- 172.21.15.151:0/4126095372 shutdown_connections 2023-10-18T11:38:04.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.602+0000 7f75fb075640 1 -- 172.21.15.151:0/4126095372 wait complete. 2023-10-18T11:38:04.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.604+0000 7f75fb075640 1 Processor -- start 2023-10-18T11:38:04.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.605+0000 7f75fb075640 1 -- start start 2023-10-18T11:38:04.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.606+0000 7f75fb075640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75f40c57a0 0x7f75f4151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:04.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.606+0000 7f75fb075640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75f4150ec0 0x7f75f4153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:04.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.606+0000 7f75fb075640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f415ad60 0x7f75f41ed880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:04.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.606+0000 7f75fb075640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f40c9f60 con 0x7f75f415ad60 2023-10-18T11:38:04.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.606+0000 7f75fb075640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f414dba0 con 0x7f75f40c57a0 2023-10-18T11:38:04.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.606+0000 7f75fb075640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f41523c0 con 0x7f75f4150ec0 2023-10-18T11:38:04.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.607+0000 7f75f8e11640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75f40c57a0 0x7f75f4151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:04.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.607+0000 7f75f8e11640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75f40c57a0 0x7f75f4151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:48114/0 (socket says 172.21.15.151:48114) 2023-10-18T11:38:04.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.607+0000 7f75f8e11640 1 -- 172.21.15.151:0/1673184111 learned_addr learned my addr 172.21.15.151:0/1673184111 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:04.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.609+0000 7f75f3fff640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75f4150ec0 0x7f75f4153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:04.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.612+0000 7f75f8e11640 1 -- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75f4150ec0 msgr2=0x7f75f4153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:04.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.612+0000 7f75f8e11640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75f4150ec0 0x7f75f4153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:04.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.612+0000 7f75f8e11640 1 -- 172.21.15.151:0/1673184111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f415ad60 msgr2=0x7f75f41ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:04.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.612+0000 7f75f8e11640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f415ad60 0x7f75f41ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:04.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.612+0000 7f75f8e11640 1 -- 172.21.15.151:0/1673184111 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec009a70 con 0x7f75f40c57a0 2023-10-18T11:38:04.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.616+0000 7f75f8e11640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75f40c57a0 0x7f75f4151890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75e400c500 tx=0x7f75e400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:04.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.620+0000 7f75f17fa640 1 -- 172.21.15.151:0/1673184111 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4005ce0 con 0x7f75f40c57a0 2023-10-18T11:38:04.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.620+0000 7f75f17fa640 1 -- 172.21.15.151:0/1673184111 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4005e40 con 0x7f75f40c57a0 2023-10-18T11:38:04.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.620+0000 7f75f17fa640 1 -- 172.21.15.151:0/1673184111 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4007330 con 0x7f75f40c57a0 2023-10-18T11:38:04.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.620+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f40c9cc0 con 0x7f75f40c57a0 2023-10-18T11:38:04.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.620+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f40cb380 con 0x7f75f40c57a0 2023-10-18T11:38:04.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.621+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f4152190 con 0x7f75f40c57a0 2023-10-18T11:38:04.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.641+0000 7f75f17fa640 1 -- 172.21.15.151:0/1673184111 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f75e4007490 con 0x7f75f40c57a0 2023-10-18T11:38:04.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.643+0000 7f75f17fa640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f75d406aec0 0x7f75d406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:04.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.643+0000 7f75f17fa640 1 -- 172.21.15.151:0/1673184111 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f75e4089300 con 0x7f75f40c57a0 2023-10-18T11:38:04.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.643+0000 7f75f3fff640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f75d406aec0 0x7f75d406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:04.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.644+0000 7f75f3fff640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f75d406aec0 0x7f75d406d380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f75f414a9b0 tx=0x7f75dc009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:04.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:04.886+0000 7f75f17fa640 1 -- 172.21.15.151:0/1673184111 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75e40542d0 con 0x7f75f40c57a0 2023-10-18T11:38:05.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.098+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75f40c2070 con 0x7f75d406aec0 2023-10-18T11:38:05.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.109+0000 7f75f17fa640 1 -- 172.21.15.151:0/1673184111 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370647 (secure 0 0 0) 0x7f75dc0014a0 con 0x7f75d406aec0 2023-10-18T11:38:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:38:05.118 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:38:05.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f75d406aec0 msgr2=0x7f75d406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:05.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f75d406aec0 0x7f75d406d380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f75f414a9b0 tx=0x7f75dc009040 comp rx=0 tx=0).stop 2023-10-18T11:38:05.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75f40c57a0 msgr2=0x7f75f4151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:05.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75f40c57a0 0x7f75f4151890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75e400c500 tx=0x7f75e400c9c0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 shutdown_connections 2023-10-18T11:38:05.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f415ad60 0x7f75f41ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75f4150ec0 0x7f75f4153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f75d406aec0 0x7f75d406d380 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 --2- 172.21.15.151:0/1673184111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75f40c57a0 0x7f75f4151890 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 >> 172.21.15.151:0/1673184111 conn(0x7f75f40c6f10 msgr2=0x7f75f4157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:05.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.117+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 shutdown_connections 2023-10-18T11:38:05.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.118+0000 7f75fb075640 1 -- 172.21.15.151:0/1673184111 wait complete. 2023-10-18T11:38:05.142 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":888,"stamp":"2023-10-18T11:38:04.606942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":100593805,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":4304,"num_read_kb":487225,"num_write":36977,"num_write_kb":691388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45219,"ondisk_log_size":45219,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":893032,"kb_used_data":157992,"kb_used_omap":12,"kb_used_meta":734963,"kb_avail":754081688,"statfs":{"total":773094113280,"available":772179648512,"internally_reserved":0,"allocated":161783808,"data_stored":202265090,"data_compressed":12494466,"data_compressed_allocated":19447808,"data_compressed_original":61759488,"omap_allocated":12742,"internal_metadata":752602682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":89394,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":96,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002747"},"pg_stats":[{"pgid":"2.1f","version":"31'1782","reported_seq":1816,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.435031+0000","last_change":"2023-10-18T11:09:36.796784+0000","last_active":"2023-10-18T11:37:57.435031+0000","last_peered":"2023-10-18T11:37:57.435031+0000","last_clean":"2023-10-18T11:37:57.435031+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:37:57.435031+0000","last_undegraded":"2023-10-18T11:37:57.435031+0000","last_fullsized":"2023-10-18T11:37:57.435031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1782,"log_dups_size":0,"ondisk_log_size":1782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9274710,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1779,"num_write_kb":10008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'108","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.524602+0000","last_change":"2023-10-18T11:09:39.421701+0000","last_active":"2023-10-18T11:37:04.524602+0000","last_peered":"2023-10-18T11:37:04.524602+0000","last_clean":"2023-10-18T11:37:04.524602+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:37:04.524602+0000","last_undegraded":"2023-10-18T11:37:04.524602+0000","last_fullsized":"2023-10-18T11:37:04.524602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'384","reported_seq":457,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.525040+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:37:00.525040+0000","last_peered":"2023-10-18T11:37:00.525040+0000","last_clean":"2023-10-18T11:37:00.525040+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:37:00.525040+0000","last_undegraded":"2023-10-18T11:37:00.525040+0000","last_fullsized":"2023-10-18T11:37:00.525040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":285,"num_write_kb":10314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'1437","reported_seq":1472,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:36.414409+0000","last_change":"2023-10-18T11:09:36.909894+0000","last_active":"2023-10-18T11:37:36.414409+0000","last_peered":"2023-10-18T11:37:36.414409+0000","last_clean":"2023-10-18T11:37:36.414409+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:37:36.414409+0000","last_undegraded":"2023-10-18T11:37:36.414409+0000","last_fullsized":"2023-10-18T11:37:36.414409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1437,"log_dups_size":0,"ondisk_log_size":1437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1431,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'129","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.778362+0000","last_change":"2023-10-18T11:09:39.363102+0000","last_active":"2023-10-18T11:37:04.778362+0000","last_peered":"2023-10-18T11:37:04.778362+0000","last_clean":"2023-10-18T11:37:04.778362+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:37:04.778362+0000","last_undegraded":"2023-10-18T11:37:04.778362+0000","last_fullsized":"2023-10-18T11:37:04.778362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'453","reported_seq":592,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.264450+0000","last_change":"2023-10-18T11:09:46.109981+0000","last_active":"2023-10-18T11:37:08.264450+0000","last_peered":"2023-10-18T11:37:08.264450+0000","last_clean":"2023-10-18T11:37:08.264450+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:37:08.264450+0000","last_undegraded":"2023-10-18T11:37:08.264450+0000","last_fullsized":"2023-10-18T11:37:08.264450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:26.971949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":14204,"num_write":357,"num_write_kb":21017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'815","reported_seq":847,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.512091+0000","last_change":"2023-10-18T11:09:36.896708+0000","last_active":"2023-10-18T11:37:57.512091+0000","last_peered":"2023-10-18T11:37:57.512091+0000","last_clean":"2023-10-18T11:37:57.512091+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:37:57.512091+0000","last_undegraded":"2023-10-18T11:37:57.512091+0000","last_fullsized":"2023-10-18T11:37:57.512091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3060108,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'105","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.255149+0000","last_change":"2023-10-18T11:09:39.397225+0000","last_active":"2023-10-18T11:36:58.255149+0000","last_peered":"2023-10-18T11:36:58.255149+0000","last_clean":"2023-10-18T11:36:58.255149+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:36:58.255149+0000","last_undegraded":"2023-10-18T11:36:58.255149+0000","last_fullsized":"2023-10-18T11:36:58.255149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'331","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.775789+0000","last_change":"2023-10-18T11:09:46.114798+0000","last_active":"2023-10-18T11:37:07.775789+0000","last_peered":"2023-10-18T11:37:07.775789+0000","last_clean":"2023-10-18T11:37:07.775789+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:37:07.775789+0000","last_undegraded":"2023-10-18T11:37:07.775789+0000","last_fullsized":"2023-10-18T11:37:07.775789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:57.280120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":213,"num_write_kb":9865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:34:36.253199+0000","last_change":"2023-10-18T11:09:36.795004+0000","last_active":"2023-10-18T11:34:36.253199+0000","last_peered":"2023-10-18T11:34:36.253199+0000","last_clean":"2023-10-18T11:34:36.253199+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:34:36.253199+0000","last_undegraded":"2023-10-18T11:34:36.253199+0000","last_fullsized":"2023-10-18T11:34:36.253199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'116","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.751037+0000","last_change":"2023-10-18T11:09:39.398621+0000","last_active":"2023-10-18T11:37:07.751037+0000","last_peered":"2023-10-18T11:37:07.751037+0000","last_clean":"2023-10-18T11:37:07.751037+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:37:07.751037+0000","last_undegraded":"2023-10-18T11:37:07.751037+0000","last_fullsized":"2023-10-18T11:37:07.751037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'461","reported_seq":543,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.586761+0000","last_change":"2023-10-18T11:09:46.115280+0000","last_active":"2023-10-18T11:37:03.586761+0000","last_peered":"2023-10-18T11:37:03.586761+0000","last_clean":"2023-10-18T11:37:03.586761+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:37:03.586761+0000","last_undegraded":"2023-10-18T11:37:03.586761+0000","last_fullsized":"2023-10-18T11:37:03.586761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:26.647416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":15764,"num_write":351,"num_write_kb":32860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'100","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.808165+0000","last_change":"2023-10-18T11:09:39.397253+0000","last_active":"2023-10-18T11:37:07.808165+0000","last_peered":"2023-10-18T11:37:07.808165+0000","last_clean":"2023-10-18T11:37:07.808165+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:37:07.808165+0000","last_undegraded":"2023-10-18T11:37:07.808165+0000","last_fullsized":"2023-10-18T11:37:07.808165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'767","reported_seq":800,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.393018+0000","last_change":"2023-10-18T11:09:36.893066+0000","last_active":"2023-10-18T11:37:42.393018+0000","last_peered":"2023-10-18T11:37:42.393018+0000","last_clean":"2023-10-18T11:37:42.393018+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:37:42.393018+0000","last_undegraded":"2023-10-18T11:37:42.393018+0000","last_fullsized":"2023-10-18T11:37:42.393018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:32.587464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'437","reported_seq":509,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.656541+0000","last_change":"2023-10-18T11:09:46.096113+0000","last_active":"2023-10-18T11:37:00.656541+0000","last_peered":"2023-10-18T11:37:00.656541+0000","last_clean":"2023-10-18T11:37:00.656541+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:37:00.656541+0000","last_undegraded":"2023-10-18T11:37:00.656541+0000","last_fullsized":"2023-10-18T11:37:00.656541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:09.971210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":11430,"num_write":325,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'106","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.691647+0000","last_change":"2023-10-18T11:09:39.423651+0000","last_active":"2023-10-18T11:36:59.691647+0000","last_peered":"2023-10-18T11:36:59.691647+0000","last_clean":"2023-10-18T11:36:59.691647+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:36:59.691647+0000","last_undegraded":"2023-10-18T11:36:59.691647+0000","last_fullsized":"2023-10-18T11:36:59.691647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'485","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.026143+0000","last_change":"2023-10-18T11:09:36.913611+0000","last_active":"2023-10-18T11:37:54.026143+0000","last_peered":"2023-10-18T11:37:54.026143+0000","last_clean":"2023-10-18T11:37:54.026143+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:37:54.026143+0000","last_undegraded":"2023-10-18T11:37:54.026143+0000","last_fullsized":"2023-10-18T11:37:54.026143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'427","reported_seq":518,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.167961+0000","last_change":"2023-10-18T11:09:46.114729+0000","last_active":"2023-10-18T11:37:05.167961+0000","last_peered":"2023-10-18T11:37:05.167961+0000","last_clean":"2023-10-18T11:37:05.167961+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:37:05.167961+0000","last_undegraded":"2023-10-18T11:37:05.167961+0000","last_fullsized":"2023-10-18T11:37:05.167961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:50.156790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":327,"num_write_kb":17650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'110","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.132888+0000","last_change":"2023-10-18T11:09:39.420146+0000","last_active":"2023-10-18T11:37:07.132888+0000","last_peered":"2023-10-18T11:37:07.132888+0000","last_clean":"2023-10-18T11:37:07.132888+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:37:07.132888+0000","last_undegraded":"2023-10-18T11:37:07.132888+0000","last_fullsized":"2023-10-18T11:37:07.132888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'280","reported_seq":314,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.910291+0000","last_change":"2023-10-18T11:09:36.915198+0000","last_active":"2023-10-18T11:37:42.910291+0000","last_peered":"2023-10-18T11:37:42.910291+0000","last_clean":"2023-10-18T11:37:42.910291+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:37:42.910291+0000","last_undegraded":"2023-10-18T11:37:42.910291+0000","last_fullsized":"2023-10-18T11:37:42.910291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:18.429550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'423","reported_seq":480,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:52.201304+0000","last_change":"2023-10-18T11:10:10.413988+0000","last_active":"2023-10-18T11:36:52.201304+0000","last_peered":"2023-10-18T11:36:52.201304+0000","last_clean":"2023-10-18T11:36:52.201304+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:36:52.201304+0000","last_undegraded":"2023-10-18T11:36:52.201304+0000","last_fullsized":"2023-10-18T11:36:52.201304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":324,"num_write_kb":16893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'91","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.025485+0000","last_change":"2023-10-18T11:09:39.399181+0000","last_active":"2023-10-18T11:37:00.025485+0000","last_peered":"2023-10-18T11:37:00.025485+0000","last_clean":"2023-10-18T11:37:00.025485+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:37:00.025485+0000","last_undegraded":"2023-10-18T11:37:00.025485+0000","last_fullsized":"2023-10-18T11:37:00.025485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:13.349921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.981750+0000","last_change":"2023-10-18T11:09:36.797637+0000","last_active":"2023-10-18T11:37:42.981750+0000","last_peered":"2023-10-18T11:37:42.981750+0000","last_clean":"2023-10-18T11:37:42.981750+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:37:42.981750+0000","last_undegraded":"2023-10-18T11:37:42.981750+0000","last_fullsized":"2023-10-18T11:37:42.981750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:08.109221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'432","reported_seq":615,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.552717+0000","last_change":"2023-10-18T11:09:46.109408+0000","last_active":"2023-10-18T11:37:04.552717+0000","last_peered":"2023-10-18T11:37:04.552717+0000","last_clean":"2023-10-18T11:37:04.552717+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:37:04.552717+0000","last_undegraded":"2023-10-18T11:37:04.552717+0000","last_fullsized":"2023-10-18T11:37:04.552717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":19825,"num_write":333,"num_write_kb":19445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'103","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.854148+0000","last_change":"2023-10-18T11:09:39.366234+0000","last_active":"2023-10-18T11:36:55.854148+0000","last_peered":"2023-10-18T11:36:55.854148+0000","last_clean":"2023-10-18T11:36:55.854148+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:36:55.854148+0000","last_undegraded":"2023-10-18T11:36:55.854148+0000","last_fullsized":"2023-10-18T11:36:55.854148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.152488+0000","last_change":"2023-10-18T11:09:36.896533+0000","last_active":"2023-10-18T11:37:54.152488+0000","last_peered":"2023-10-18T11:37:54.152488+0000","last_clean":"2023-10-18T11:37:54.152488+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:37:54.152488+0000","last_undegraded":"2023-10-18T11:37:54.152488+0000","last_fullsized":"2023-10-18T11:37:54.152488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'438","reported_seq":520,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.518223+0000","last_change":"2023-10-18T11:09:46.094196+0000","last_active":"2023-10-18T11:37:03.518223+0000","last_peered":"2023-10-18T11:37:03.518223+0000","last_clean":"2023-10-18T11:37:03.518223+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:37:03.518223+0000","last_undegraded":"2023-10-18T11:37:03.518223+0000","last_fullsized":"2023-10-18T11:37:03.518223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:43.456989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":16856,"num_write":335,"num_write_kb":23716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'108","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.131193+0000","last_change":"2023-10-18T11:09:39.420016+0000","last_active":"2023-10-18T11:37:07.131193+0000","last_peered":"2023-10-18T11:37:07.131193+0000","last_clean":"2023-10-18T11:37:07.131193+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:37:07.131193+0000","last_undegraded":"2023-10-18T11:37:07.131193+0000","last_fullsized":"2023-10-18T11:37:07.131193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'288","reported_seq":322,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.247981+0000","last_change":"2023-10-18T11:09:36.913659+0000","last_active":"2023-10-18T11:37:56.247981+0000","last_peered":"2023-10-18T11:37:56.247981+0000","last_clean":"2023-10-18T11:37:56.247981+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:37:56.247981+0000","last_undegraded":"2023-10-18T11:37:56.247981+0000","last_fullsized":"2023-10-18T11:37:56.247981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'450","reported_seq":535,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.819051+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:37:08.819051+0000","last_peered":"2023-10-18T11:37:08.819051+0000","last_clean":"2023-10-18T11:37:08.819051+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:37:08.819051+0000","last_undegraded":"2023-10-18T11:37:08.819051+0000","last_fullsized":"2023-10-18T11:37:08.819051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":337,"num_write_kb":25264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'104","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.551663+0000","last_change":"2023-10-18T11:09:39.243607+0000","last_active":"2023-10-18T11:37:03.551663+0000","last_peered":"2023-10-18T11:37:03.551663+0000","last_clean":"2023-10-18T11:37:03.551663+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:37:03.551663+0000","last_undegraded":"2023-10-18T11:37:03.551663+0000","last_fullsized":"2023-10-18T11:37:03.551663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'242","reported_seq":276,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:40.777847+0000","last_change":"2023-10-18T11:09:36.798396+0000","last_active":"2023-10-18T11:37:40.777847+0000","last_peered":"2023-10-18T11:37:40.777847+0000","last_clean":"2023-10-18T11:37:40.777847+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:37:40.777847+0000","last_undegraded":"2023-10-18T11:37:40.777847+0000","last_fullsized":"2023-10-18T11:37:40.777847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:04.311252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'490","reported_seq":562,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:53.863488+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:36:53.863488+0000","last_peered":"2023-10-18T11:36:53.863488+0000","last_clean":"2023-10-18T11:36:53.863488+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:36:53.863488+0000","last_undegraded":"2023-10-18T11:36:53.863488+0000","last_fullsized":"2023-10-18T11:36:53.863488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":390,"num_write_kb":31170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'136","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.283144+0000","last_change":"2023-10-18T11:09:39.417304+0000","last_active":"2023-10-18T11:37:07.283144+0000","last_peered":"2023-10-18T11:37:07.283144+0000","last_clean":"2023-10-18T11:37:07.283144+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:37:07.283144+0000","last_undegraded":"2023-10-18T11:37:07.283144+0000","last_fullsized":"2023-10-18T11:37:07.283144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'790","reported_seq":824,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:31.939729+0000","last_change":"2023-10-18T11:09:36.909623+0000","last_active":"2023-10-18T11:37:31.939729+0000","last_peered":"2023-10-18T11:37:31.939729+0000","last_clean":"2023-10-18T11:37:31.939729+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:37:31.939729+0000","last_undegraded":"2023-10-18T11:37:31.939729+0000","last_fullsized":"2023-10-18T11:37:31.939729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'468","reported_seq":527,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.789125+0000","last_change":"2023-10-18T11:09:46.100735+0000","last_active":"2023-10-18T11:36:58.789125+0000","last_peered":"2023-10-18T11:36:58.789125+0000","last_clean":"2023-10-18T11:36:58.789125+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:36:58.789125+0000","last_undegraded":"2023-10-18T11:36:58.789125+0000","last_fullsized":"2023-10-18T11:36:58.789125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":9414,"num_write":343,"num_write_kb":17104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'108","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:53.879961+0000","last_change":"2023-10-18T11:09:39.400602+0000","last_active":"2023-10-18T11:36:53.879961+0000","last_peered":"2023-10-18T11:36:53.879961+0000","last_clean":"2023-10-18T11:36:53.879961+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:36:53.879961+0000","last_undegraded":"2023-10-18T11:36:53.879961+0000","last_fullsized":"2023-10-18T11:36:53.879961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:37.020893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1648","reported_seq":1682,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.966733+0000","last_change":"2023-10-18T11:09:36.915028+0000","last_active":"2023-10-18T11:37:53.966733+0000","last_peered":"2023-10-18T11:37:53.966733+0000","last_clean":"2023-10-18T11:37:53.966733+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:37:53.966733+0000","last_undegraded":"2023-10-18T11:37:53.966733+0000","last_fullsized":"2023-10-18T11:37:53.966733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1639,"num_write_kb":9112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'412","reported_seq":497,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.555132+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:37:03.555132+0000","last_peered":"2023-10-18T11:37:03.555132+0000","last_clean":"2023-10-18T11:37:03.555132+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:37:03.555132+0000","last_undegraded":"2023-10-18T11:37:03.555132+0000","last_fullsized":"2023-10-18T11:37:03.555132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":14478,"num_write":303,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'106","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.760732+0000","last_change":"2023-10-18T11:09:39.243829+0000","last_active":"2023-10-18T11:37:07.760732+0000","last_peered":"2023-10-18T11:37:07.760732+0000","last_clean":"2023-10-18T11:37:07.760732+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:37:07.760732+0000","last_undegraded":"2023-10-18T11:37:07.760732+0000","last_fullsized":"2023-10-18T11:37:07.760732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'1264","reported_seq":1755,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:58.340539+0000","last_change":"2023-10-18T11:09:36.910270+0000","last_active":"2023-10-18T11:37:58.340539+0000","last_peered":"2023-10-18T11:37:58.340539+0000","last_clean":"2023-10-18T11:37:58.340539+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:37:58.340539+0000","last_undegraded":"2023-10-18T11:37:58.340539+0000","last_fullsized":"2023-10-18T11:37:58.340539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4329052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":492,"num_write":1258,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'421","reported_seq":527,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.303116+0000","last_change":"2023-10-18T11:09:46.114610+0000","last_active":"2023-10-18T11:37:07.303116+0000","last_peered":"2023-10-18T11:37:07.303116+0000","last_clean":"2023-10-18T11:37:07.303116+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:37:07.303116+0000","last_undegraded":"2023-10-18T11:37:07.303116+0000","last_fullsized":"2023-10-18T11:37:07.303116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":19812,"num_write":327,"num_write_kb":12739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'102","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:52.025272+0000","last_change":"2023-10-18T11:09:39.404210+0000","last_active":"2023-10-18T11:36:52.025272+0000","last_peered":"2023-10-18T11:36:52.025272+0000","last_clean":"2023-10-18T11:36:52.025272+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:36:52.025272+0000","last_undegraded":"2023-10-18T11:36:52.025272+0000","last_fullsized":"2023-10-18T11:36:52.025272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'373","reported_seq":408,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.981272+0000","last_change":"2023-10-18T11:09:36.913804+0000","last_active":"2023-10-18T11:37:42.981272+0000","last_peered":"2023-10-18T11:37:42.981272+0000","last_clean":"2023-10-18T11:37:42.981272+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:37:42.981272+0000","last_undegraded":"2023-10-18T11:37:42.981272+0000","last_fullsized":"2023-10-18T11:37:42.981272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956268,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'424","reported_seq":516,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:06.995346+0000","last_change":"2023-10-18T11:09:46.092566+0000","last_active":"2023-10-18T11:37:06.995346+0000","last_peered":"2023-10-18T11:37:06.995346+0000","last_clean":"2023-10-18T11:37:06.995346+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:37:06.995346+0000","last_undegraded":"2023-10-18T11:37:06.995346+0000","last_fullsized":"2023-10-18T11:37:06.995346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:42.848835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":329,"num_write_kb":22819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'106","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:56.609366+0000","last_change":"2023-10-18T11:09:39.422507+0000","last_active":"2023-10-18T11:36:56.609366+0000","last_peered":"2023-10-18T11:36:56.609366+0000","last_clean":"2023-10-18T11:36:56.609366+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:36:56.609366+0000","last_undegraded":"2023-10-18T11:36:56.609366+0000","last_fullsized":"2023-10-18T11:36:56.609366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'9","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.822485+0000","last_change":"2023-10-18T11:09:36.828474+0000","last_active":"2023-10-18T11:37:16.822485+0000","last_peered":"2023-10-18T11:37:16.822485+0000","last_clean":"2023-10-18T11:37:16.822485+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:37:16.822485+0000","last_undegraded":"2023-10-18T11:37:16.822485+0000","last_fullsized":"2023-10-18T11:37:16.822485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:35:21.257875+0000","last_change":"2023-10-18T11:09:19.365660+0000","last_active":"2023-10-18T11:35:21.257875+0000","last_peered":"2023-10-18T11:35:21.257875+0000","last_clean":"2023-10-18T11:35:21.257875+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:35:21.257875+0000","last_undegraded":"2023-10-18T11:35:21.257875+0000","last_fullsized":"2023-10-18T11:35:21.257875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_clean_scrub_stamp":"2023-10-18T11:09:17.711667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:34:53.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'526","reported_seq":631,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.294647+0000","last_change":"2023-10-18T11:09:46.118571+0000","last_active":"2023-10-18T11:37:07.294647+0000","last_peered":"2023-10-18T11:37:07.294647+0000","last_clean":"2023-10-18T11:37:07.294647+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:37:07.294647+0000","last_undegraded":"2023-10-18T11:37:07.294647+0000","last_fullsized":"2023-10-18T11:37:07.294647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:46.781070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":19822,"num_write":415,"num_write_kb":19524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'114","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.707662+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:36:59.707662+0000","last_peered":"2023-10-18T11:36:59.707662+0000","last_clean":"2023-10-18T11:36:59.707662+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:36:59.707662+0000","last_undegraded":"2023-10-18T11:36:59.707662+0000","last_fullsized":"2023-10-18T11:36:59.707662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'899","reported_seq":932,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:36.378659+0000","last_change":"2023-10-18T11:09:36.829100+0000","last_active":"2023-10-18T11:36:36.378659+0000","last_peered":"2023-10-18T11:36:36.378659+0000","last_clean":"2023-10-18T11:36:36.378659+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:36:36.378659+0000","last_undegraded":"2023-10-18T11:36:36.378659+0000","last_fullsized":"2023-10-18T11:36:36.378659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'411","reported_seq":522,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.809149+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:37:07.809149+0000","last_peered":"2023-10-18T11:37:07.809149+0000","last_clean":"2023-10-18T11:37:07.809149+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:37:07.809149+0000","last_undegraded":"2023-10-18T11:37:07.809149+0000","last_fullsized":"2023-10-18T11:37:07.809149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":18796,"num_write":308,"num_write_kb":13390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'100","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.585947+0000","last_change":"2023-10-18T11:09:39.419862+0000","last_active":"2023-10-18T11:37:03.585947+0000","last_peered":"2023-10-18T11:37:03.585947+0000","last_clean":"2023-10-18T11:37:03.585947+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:37:03.585947+0000","last_undegraded":"2023-10-18T11:37:03.585947+0000","last_fullsized":"2023-10-18T11:37:03.585947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'1290","reported_seq":1323,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.409200+0000","last_change":"2023-10-18T11:09:36.912905+0000","last_active":"2023-10-18T11:37:56.409200+0000","last_peered":"2023-10-18T11:37:56.409200+0000","last_clean":"2023-10-18T11:37:56.409200+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:37:56.409200+0000","last_undegraded":"2023-10-18T11:37:56.409200+0000","last_fullsized":"2023-10-18T11:37:56.409200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7520680,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'435","reported_seq":548,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.568333+0000","last_change":"2023-10-18T11:09:46.097744+0000","last_active":"2023-10-18T11:37:03.568333+0000","last_peered":"2023-10-18T11:37:03.568333+0000","last_clean":"2023-10-18T11:37:03.568333+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:37:03.568333+0000","last_undegraded":"2023-10-18T11:37:03.568333+0000","last_fullsized":"2023-10-18T11:37:03.568333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:20.073279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":340,"num_write_kb":14424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'98","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:51.638498+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:36:51.638498+0000","last_peered":"2023-10-18T11:36:51.638498+0000","last_clean":"2023-10-18T11:36:51.638498+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:36:51.638498+0000","last_undegraded":"2023-10-18T11:36:51.638498+0000","last_fullsized":"2023-10-18T11:36:51.638498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:51.220855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'7","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:36.378712+0000","last_change":"2023-10-18T11:09:36.907280+0000","last_active":"2023-10-18T11:36:36.378712+0000","last_peered":"2023-10-18T11:36:36.378712+0000","last_clean":"2023-10-18T11:36:36.378712+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:36:36.378712+0000","last_undegraded":"2023-10-18T11:36:36.378712+0000","last_fullsized":"2023-10-18T11:36:36.378712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'409","reported_seq":498,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.751846+0000","last_change":"2023-10-18T11:09:46.096894+0000","last_active":"2023-10-18T11:37:07.751846+0000","last_peered":"2023-10-18T11:37:07.751846+0000","last_clean":"2023-10-18T11:37:07.751846+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:37:07.751846+0000","last_undegraded":"2023-10-18T11:37:07.751846+0000","last_fullsized":"2023-10-18T11:37:07.751846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":17064,"num_write":295,"num_write_kb":17834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'106","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.565157+0000","last_change":"2023-10-18T11:09:39.399750+0000","last_active":"2023-10-18T11:37:04.565157+0000","last_peered":"2023-10-18T11:37:04.565157+0000","last_clean":"2023-10-18T11:37:04.565157+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:37:04.565157+0000","last_undegraded":"2023-10-18T11:37:04.565157+0000","last_fullsized":"2023-10-18T11:37:04.565157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:35.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'253","reported_seq":286,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.049497+0000","last_change":"2023-10-18T11:09:36.897906+0000","last_active":"2023-10-18T11:37:54.049497+0000","last_peered":"2023-10-18T11:37:54.049497+0000","last_clean":"2023-10-18T11:37:54.049497+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:37:54.049497+0000","last_undegraded":"2023-10-18T11:37:54.049497+0000","last_fullsized":"2023-10-18T11:37:54.049497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:41:27.304152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'390","reported_seq":458,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.563216+0000","last_change":"2023-10-18T11:09:46.109151+0000","last_active":"2023-10-18T11:37:03.563216+0000","last_peered":"2023-10-18T11:37:03.563216+0000","last_clean":"2023-10-18T11:37:03.563216+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:37:03.563216+0000","last_undegraded":"2023-10-18T11:37:03.563216+0000","last_fullsized":"2023-10-18T11:37:03.563216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:41.785820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":302,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.153530+0000","last_change":"2023-10-18T11:09:39.397483+0000","last_active":"2023-10-18T11:37:05.153530+0000","last_peered":"2023-10-18T11:37:05.153530+0000","last_clean":"2023-10-18T11:37:05.153530+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:37:05.153530+0000","last_undegraded":"2023-10-18T11:37:05.153530+0000","last_fullsized":"2023-10-18T11:37:05.153530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'1792","reported_seq":1825,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.572727+0000","last_change":"2023-10-18T11:09:36.916080+0000","last_active":"2023-10-18T11:37:57.572727+0000","last_peered":"2023-10-18T11:37:57.572727+0000","last_clean":"2023-10-18T11:37:57.572727+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:37:57.572727+0000","last_undegraded":"2023-10-18T11:37:57.572727+0000","last_fullsized":"2023-10-18T11:37:57.572727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:22.058134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":9197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'468","reported_seq":550,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:56.570360+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:36:56.570360+0000","last_peered":"2023-10-18T11:36:56.570360+0000","last_clean":"2023-10-18T11:36:56.570360+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:36:56.570360+0000","last_undegraded":"2023-10-18T11:36:56.570360+0000","last_fullsized":"2023-10-18T11:36:56.570360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":372,"num_write_kb":11119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.777715+0000","last_change":"2023-10-18T11:09:39.358262+0000","last_active":"2023-10-18T11:37:04.777715+0000","last_peered":"2023-10-18T11:37:04.777715+0000","last_clean":"2023-10-18T11:37:04.777715+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:37:04.777715+0000","last_undegraded":"2023-10-18T11:37:04.777715+0000","last_fullsized":"2023-10-18T11:37:04.777715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'909","reported_seq":942,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:40.118546+0000","last_change":"2023-10-18T11:09:36.893045+0000","last_active":"2023-10-18T11:37:40.118546+0000","last_peered":"2023-10-18T11:37:40.118546+0000","last_clean":"2023-10-18T11:37:40.118546+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:37:40.118546+0000","last_undegraded":"2023-10-18T11:37:40.118546+0000","last_fullsized":"2023-10-18T11:37:40.118546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'408","reported_seq":477,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.655594+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:37:00.655594+0000","last_peered":"2023-10-18T11:37:00.655594+0000","last_clean":"2023-10-18T11:37:00.655594+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:37:00.655594+0000","last_undegraded":"2023-10-18T11:37:00.655594+0000","last_fullsized":"2023-10-18T11:37:00.655594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:27.567970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":10922,"num_write":302,"num_write_kb":9791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'114","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.992359+0000","last_change":"2023-10-18T11:09:39.399188+0000","last_active":"2023-10-18T11:37:04.992359+0000","last_peered":"2023-10-18T11:37:04.992359+0000","last_clean":"2023-10-18T11:37:04.992359+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:37:04.992359+0000","last_undegraded":"2023-10-18T11:37:04.992359+0000","last_fullsized":"2023-10-18T11:37:04.992359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'1001","reported_seq":1034,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.671167+0000","last_change":"2023-10-18T11:09:36.905576+0000","last_active":"2023-10-18T11:37:54.671167+0000","last_peered":"2023-10-18T11:37:54.671167+0000","last_clean":"2023-10-18T11:37:54.671167+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:37:54.671167+0000","last_undegraded":"2023-10-18T11:37:54.671167+0000","last_fullsized":"2023-10-18T11:37:54.671167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1001,"log_dups_size":0,"ondisk_log_size":1001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":4702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'374","reported_seq":447,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.509846+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:37:03.509846+0000","last_peered":"2023-10-18T11:37:03.509846+0000","last_clean":"2023-10-18T11:37:03.509846+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:37:03.509846+0000","last_undegraded":"2023-10-18T11:37:03.509846+0000","last_fullsized":"2023-10-18T11:37:03.509846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:47.871773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":12454,"num_write":279,"num_write_kb":12302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'115","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.517027+0000","last_change":"2023-10-18T11:09:39.361805+0000","last_active":"2023-10-18T11:37:03.517027+0000","last_peered":"2023-10-18T11:37:03.517027+0000","last_clean":"2023-10-18T11:37:03.517027+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:37:03.517027+0000","last_undegraded":"2023-10-18T11:37:03.517027+0000","last_fullsized":"2023-10-18T11:37:03.517027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'404","reported_seq":828,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.660982+0000","last_change":"2023-10-18T11:09:36.894141+0000","last_active":"2023-10-18T11:37:54.660982+0000","last_peered":"2023-10-18T11:37:54.660982+0000","last_clean":"2023-10-18T11:37:54.660982+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:37:54.660982+0000","last_undegraded":"2023-10-18T11:37:54.660982+0000","last_fullsized":"2023-10-18T11:37:54.660982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":443,"num_write":404,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'508","reported_seq":637,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.390056+0000","last_change":"2023-10-18T11:09:46.114944+0000","last_active":"2023-10-18T11:37:04.390056+0000","last_peered":"2023-10-18T11:37:04.390056+0000","last_clean":"2023-10-18T11:37:04.390056+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:37:04.390056+0000","last_undegraded":"2023-10-18T11:37:04.390056+0000","last_fullsized":"2023-10-18T11:37:04.390056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":22458,"num_write":413,"num_write_kb":26305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'101","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.994506+0000","last_change":"2023-10-18T11:09:39.420430+0000","last_active":"2023-10-18T11:36:55.994506+0000","last_peered":"2023-10-18T11:36:55.994506+0000","last_clean":"2023-10-18T11:36:55.994506+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:36:55.994506+0000","last_undegraded":"2023-10-18T11:36:55.994506+0000","last_fullsized":"2023-10-18T11:36:55.994506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:12.994704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1124","reported_seq":1157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.963360+0000","last_change":"2023-10-18T11:09:36.904648+0000","last_active":"2023-10-18T11:37:53.963360+0000","last_peered":"2023-10-18T11:37:53.963360+0000","last_clean":"2023-10-18T11:37:53.963360+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:37:53.963360+0000","last_undegraded":"2023-10-18T11:37:53.963360+0000","last_fullsized":"2023-10-18T11:37:53.963360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'423","reported_seq":501,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.097162+0000","last_change":"2023-10-18T11:09:46.101866+0000","last_active":"2023-10-18T11:37:05.097162+0000","last_peered":"2023-10-18T11:37:05.097162+0000","last_clean":"2023-10-18T11:37:05.097162+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:37:05.097162+0000","last_undegraded":"2023-10-18T11:37:05.097162+0000","last_fullsized":"2023-10-18T11:37:05.097162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:41.150485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":12954,"num_write":319,"num_write_kb":22076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.402120+0000","last_change":"2023-10-18T11:09:39.398597+0000","last_active":"2023-10-18T11:37:00.402120+0000","last_peered":"2023-10-18T11:37:00.402120+0000","last_clean":"2023-10-18T11:37:00.402120+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:37:00.402120+0000","last_undegraded":"2023-10-18T11:37:00.402120+0000","last_fullsized":"2023-10-18T11:37:00.402120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:10.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'280","reported_seq":312,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.665451+0000","last_change":"2023-10-18T11:09:36.913285+0000","last_active":"2023-10-18T11:37:54.665451+0000","last_peered":"2023-10-18T11:37:54.665451+0000","last_clean":"2023-10-18T11:37:54.665451+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:37:54.665451+0000","last_undegraded":"2023-10-18T11:37:54.665451+0000","last_fullsized":"2023-10-18T11:37:54.665451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'511","reported_seq":600,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.825243+0000","last_change":"2023-10-18T11:09:46.094205+0000","last_active":"2023-10-18T11:37:08.825243+0000","last_peered":"2023-10-18T11:37:08.825243+0000","last_clean":"2023-10-18T11:37:08.825243+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:37:08.825243+0000","last_undegraded":"2023-10-18T11:37:08.825243+0000","last_fullsized":"2023-10-18T11:37:08.825243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:13.509608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":22028,"num_write":389,"num_write_kb":39504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'110","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.388245+0000","last_change":"2023-10-18T11:09:39.363739+0000","last_active":"2023-10-18T11:37:00.388245+0000","last_peered":"2023-10-18T11:37:00.388245+0000","last_clean":"2023-10-18T11:37:00.388245+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:37:00.388245+0000","last_undegraded":"2023-10-18T11:37:00.388245+0000","last_fullsized":"2023-10-18T11:37:00.388245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:52.069782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'400","reported_seq":822,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:31.927344+0000","last_change":"2023-10-18T11:09:36.896767+0000","last_active":"2023-10-18T11:37:31.927344+0000","last_peered":"2023-10-18T11:37:31.927344+0000","last_clean":"2023-10-18T11:37:31.927344+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:37:31.927344+0000","last_undegraded":"2023-10-18T11:37:31.927344+0000","last_fullsized":"2023-10-18T11:37:31.927344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180134,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":390,"num_read_kb":469,"num_write":396,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'442","reported_seq":537,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.774393+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:37:04.774393+0000","last_peered":"2023-10-18T11:37:04.774393+0000","last_clean":"2023-10-18T11:37:04.774393+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:37:04.774393+0000","last_undegraded":"2023-10-18T11:37:04.774393+0000","last_fullsized":"2023-10-18T11:37:04.774393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17404,"num_write":347,"num_write_kb":27808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'113","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:52.328137+0000","last_change":"2023-10-18T11:09:39.351468+0000","last_active":"2023-10-18T11:36:52.328137+0000","last_peered":"2023-10-18T11:36:52.328137+0000","last_clean":"2023-10-18T11:36:52.328137+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:36:52.328137+0000","last_undegraded":"2023-10-18T11:36:52.328137+0000","last_fullsized":"2023-10-18T11:36:52.328137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'186","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.886900+0000","last_change":"2023-10-18T11:09:36.896596+0000","last_active":"2023-10-18T11:37:42.886900+0000","last_peered":"2023-10-18T11:37:42.886900+0000","last_clean":"2023-10-18T11:37:42.886900+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:37:42.886900+0000","last_undegraded":"2023-10-18T11:37:42.886900+0000","last_fullsized":"2023-10-18T11:37:42.886900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'380","reported_seq":473,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.146546+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:37:05.146546+0000","last_peered":"2023-10-18T11:37:05.146546+0000","last_clean":"2023-10-18T11:37:05.146546+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:37:05.146546+0000","last_undegraded":"2023-10-18T11:37:05.146546+0000","last_fullsized":"2023-10-18T11:37:05.146546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":277,"num_write_kb":11173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'503","reported_seq":585,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.159115+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:37:07.159115+0000","last_peered":"2023-10-18T11:37:07.159115+0000","last_clean":"2023-10-18T11:37:07.159115+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:37:07.159115+0000","last_undegraded":"2023-10-18T11:37:07.159115+0000","last_fullsized":"2023-10-18T11:37:07.159115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:09.785576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":392,"num_write_kb":15493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'123","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.528664+0000","last_change":"2023-10-18T11:09:39.418416+0000","last_active":"2023-10-18T11:37:00.528664+0000","last_peered":"2023-10-18T11:37:00.528664+0000","last_clean":"2023-10-18T11:37:00.528664+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:37:00.528664+0000","last_undegraded":"2023-10-18T11:37:00.528664+0000","last_fullsized":"2023-10-18T11:37:00.528664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'1033","reported_seq":1065,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.964257+0000","last_change":"2023-10-18T11:09:36.893158+0000","last_active":"2023-10-18T11:37:53.964257+0000","last_peered":"2023-10-18T11:37:53.964257+0000","last_clean":"2023-10-18T11:37:53.964257+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:37:53.964257+0000","last_undegraded":"2023-10-18T11:37:53.964257+0000","last_fullsized":"2023-10-18T11:37:53.964257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119259,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":6520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'495","reported_seq":600,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.153166+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:37:05.153166+0000","last_peered":"2023-10-18T11:37:05.153166+0000","last_clean":"2023-10-18T11:37:05.153166+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:37:05.153166+0000","last_undegraded":"2023-10-18T11:37:05.153166+0000","last_fullsized":"2023-10-18T11:37:05.153166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":22638,"num_write":397,"num_write_kb":22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'126","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.264492+0000","last_change":"2023-10-18T11:09:39.421160+0000","last_active":"2023-10-18T11:37:08.264492+0000","last_peered":"2023-10-18T11:37:08.264492+0000","last_clean":"2023-10-18T11:37:08.264492+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:37:08.264492+0000","last_undegraded":"2023-10-18T11:37:08.264492+0000","last_fullsized":"2023-10-18T11:37:08.264492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'472","reported_seq":968,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.886860+0000","last_change":"2023-10-18T11:09:36.911629+0000","last_active":"2023-10-18T11:37:42.886860+0000","last_peered":"2023-10-18T11:37:42.886860+0000","last_clean":"2023-10-18T11:37:42.886860+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:37:42.886860+0000","last_undegraded":"2023-10-18T11:37:42.886860+0000","last_fullsized":"2023-10-18T11:37:42.886860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:53.929992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":464,"num_read_kb":507,"num_write":469,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'1258","reported_seq":1759,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.546699+0000","last_change":"2023-10-18T11:09:36.894351+0000","last_active":"2023-10-18T11:37:57.546699+0000","last_peered":"2023-10-18T11:37:57.546699+0000","last_clean":"2023-10-18T11:37:57.546699+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:37:57.546699+0000","last_undegraded":"2023-10-18T11:37:57.546699+0000","last_fullsized":"2023-10-18T11:37:57.546699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:11.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4346422,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":505,"num_write":1257,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'110","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.809537+0000","last_change":"2023-10-18T11:09:39.404508+0000","last_active":"2023-10-18T11:37:07.809537+0000","last_peered":"2023-10-18T11:37:07.809537+0000","last_clean":"2023-10-18T11:37:07.809537+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:37:07.809537+0000","last_undegraded":"2023-10-18T11:37:07.809537+0000","last_fullsized":"2023-10-18T11:37:07.809537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'380","reported_seq":476,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.259191+0000","last_change":"2023-10-18T11:09:46.117246+0000","last_active":"2023-10-18T11:36:58.259191+0000","last_peered":"2023-10-18T11:36:58.259191+0000","last_clean":"2023-10-18T11:36:58.259191+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:36:58.259191+0000","last_undegraded":"2023-10-18T11:36:58.259191+0000","last_fullsized":"2023-10-18T11:36:58.259191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:59.808082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":9856,"num_write":276,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2733","reported_seq":2765,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.975579+0000","last_change":"2023-10-18T11:09:36.912013+0000","last_active":"2023-10-18T11:37:42.975579+0000","last_peered":"2023-10-18T11:37:42.975579+0000","last_clean":"2023-10-18T11:37:42.975579+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:37:42.975579+0000","last_undegraded":"2023-10-18T11:37:42.975579+0000","last_fullsized":"2023-10-18T11:37:42.975579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2733,"log_dups_size":0,"ondisk_log_size":2733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:49.950001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2726,"num_write_kb":13571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'125","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.585465+0000","last_change":"2023-10-18T11:09:39.400362+0000","last_active":"2023-10-18T11:37:03.585465+0000","last_peered":"2023-10-18T11:37:03.585465+0000","last_clean":"2023-10-18T11:37:03.585465+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:37:03.585465+0000","last_undegraded":"2023-10-18T11:37:03.585465+0000","last_fullsized":"2023-10-18T11:37:03.585465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:50.136754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'415","reported_seq":490,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.751948+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:37:07.751948+0000","last_peered":"2023-10-18T11:37:07.751948+0000","last_clean":"2023-10-18T11:37:07.751948+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:37:07.751948+0000","last_undegraded":"2023-10-18T11:37:07.751948+0000","last_fullsized":"2023-10-18T11:37:07.751948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:52:09.414015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":317,"num_write_kb":9906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'130","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.106481+0000","last_change":"2023-10-18T11:09:39.359747+0000","last_active":"2023-10-18T11:37:07.106481+0000","last_peered":"2023-10-18T11:37:07.106481+0000","last_clean":"2023-10-18T11:37:07.106481+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:37:07.106481+0000","last_undegraded":"2023-10-18T11:37:07.106481+0000","last_fullsized":"2023-10-18T11:37:07.106481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'106","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.635598+0000","last_change":"2023-10-18T11:09:39.242600+0000","last_active":"2023-10-18T11:36:59.635598+0000","last_peered":"2023-10-18T11:36:59.635598+0000","last_clean":"2023-10-18T11:36:59.635598+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:36:59.635598+0000","last_undegraded":"2023-10-18T11:36:59.635598+0000","last_fullsized":"2023-10-18T11:36:59.635598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:45.076093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'122","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.788629+0000","last_change":"2023-10-18T11:10:10.416758+0000","last_active":"2023-10-18T11:36:58.788629+0000","last_peered":"2023-10-18T11:36:58.788629+0000","last_clean":"2023-10-18T11:36:58.788629+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:36:58.788629+0000","last_undegraded":"2023-10-18T11:36:58.788629+0000","last_fullsized":"2023-10-18T11:36:58.788629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"31'107","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:47.039197+0000","last_change":"2023-10-18T11:09:39.425505+0000","last_active":"2023-10-18T11:36:47.039197+0000","last_peered":"2023-10-18T11:36:47.039197+0000","last_clean":"2023-10-18T11:36:47.039197+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:36:47.039197+0000","last_undegraded":"2023-10-18T11:36:47.039197+0000","last_fullsized":"2023-10-18T11:36:47.039197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'106","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.754258+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:36:58.754258+0000","last_peered":"2023-10-18T11:36:58.754258+0000","last_clean":"2023-10-18T11:36:58.754258+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:36:58.754258+0000","last_undegraded":"2023-10-18T11:36:58.754258+0000","last_fullsized":"2023-10-18T11:36:58.754258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'110","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.107357+0000","last_change":"2023-10-18T11:09:39.423043+0000","last_active":"2023-10-18T11:37:00.107357+0000","last_peered":"2023-10-18T11:37:00.107357+0000","last_clean":"2023-10-18T11:37:00.107357+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:37:00.107357+0000","last_undegraded":"2023-10-18T11:37:00.107357+0000","last_fullsized":"2023-10-18T11:37:00.107357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'105","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.104886+0000","last_change":"2023-10-18T11:09:39.351604+0000","last_active":"2023-10-18T11:37:07.104886+0000","last_peered":"2023-10-18T11:37:07.104886+0000","last_clean":"2023-10-18T11:37:07.104886+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:37:07.104886+0000","last_undegraded":"2023-10-18T11:37:07.104886+0000","last_fullsized":"2023-10-18T11:37:07.104886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'96","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.283402+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:37:07.283402+0000","last_peered":"2023-10-18T11:37:07.283402+0000","last_clean":"2023-10-18T11:37:07.283402+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:37:07.283402+0000","last_undegraded":"2023-10-18T11:37:07.283402+0000","last_fullsized":"2023-10-18T11:37:07.283402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'102","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.750784+0000","last_change":"2023-10-18T11:09:39.419909+0000","last_active":"2023-10-18T11:37:07.750784+0000","last_peered":"2023-10-18T11:37:07.750784+0000","last_clean":"2023-10-18T11:37:07.750784+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:37:07.750784+0000","last_undegraded":"2023-10-18T11:37:07.750784+0000","last_fullsized":"2023-10-18T11:37:07.750784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'103","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.539412+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:37:03.539412+0000","last_peered":"2023-10-18T11:37:03.539412+0000","last_clean":"2023-10-18T11:37:03.539412+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:37:03.539412+0000","last_undegraded":"2023-10-18T11:37:03.539412+0000","last_fullsized":"2023-10-18T11:37:03.539412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'103","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.783007+0000","last_change":"2023-10-18T11:09:39.349250+0000","last_active":"2023-10-18T11:36:58.783007+0000","last_peered":"2023-10-18T11:36:58.783007+0000","last_clean":"2023-10-18T11:36:58.783007+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:36:58.783007+0000","last_undegraded":"2023-10-18T11:36:58.783007+0000","last_fullsized":"2023-10-18T11:36:58.783007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'112","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.568180+0000","last_change":"2023-10-18T11:09:39.361414+0000","last_active":"2023-10-18T11:37:03.568180+0000","last_peered":"2023-10-18T11:37:03.568180+0000","last_clean":"2023-10-18T11:37:03.568180+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:37:03.568180+0000","last_undegraded":"2023-10-18T11:37:03.568180+0000","last_fullsized":"2023-10-18T11:37:03.568180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'122","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.149975+0000","last_change":"2023-10-18T11:09:39.399067+0000","last_active":"2023-10-18T11:37:05.149975+0000","last_peered":"2023-10-18T11:37:05.149975+0000","last_clean":"2023-10-18T11:37:05.149975+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:37:05.149975+0000","last_undegraded":"2023-10-18T11:37:05.149975+0000","last_fullsized":"2023-10-18T11:37:05.149975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'110","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.435315+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:37:00.435315+0000","last_peered":"2023-10-18T11:37:00.435315+0000","last_clean":"2023-10-18T11:37:00.435315+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:37:00.435315+0000","last_undegraded":"2023-10-18T11:37:00.435315+0000","last_fullsized":"2023-10-18T11:37:00.435315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:04.730798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'119","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.571978+0000","last_change":"2023-10-18T11:09:39.320727+0000","last_active":"2023-10-18T11:37:03.571978+0000","last_peered":"2023-10-18T11:37:03.571978+0000","last_clean":"2023-10-18T11:37:03.571978+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:37:03.571978+0000","last_undegraded":"2023-10-18T11:37:03.571978+0000","last_fullsized":"2023-10-18T11:37:03.571978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'113","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:47.332981+0000","last_change":"2023-10-18T11:10:10.401580+0000","last_active":"2023-10-18T11:36:47.332981+0000","last_peered":"2023-10-18T11:36:47.332981+0000","last_clean":"2023-10-18T11:36:47.332981+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:36:47.332981+0000","last_undegraded":"2023-10-18T11:36:47.332981+0000","last_fullsized":"2023-10-18T11:36:47.332981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'106","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.524718+0000","last_change":"2023-10-18T11:09:39.354336+0000","last_active":"2023-10-18T11:37:04.524718+0000","last_peered":"2023-10-18T11:37:04.524718+0000","last_clean":"2023-10-18T11:37:04.524718+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:37:04.524718+0000","last_undegraded":"2023-10-18T11:37:04.524718+0000","last_fullsized":"2023-10-18T11:37:04.524718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'105","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.245394+0000","last_change":"2023-10-18T11:09:39.401976+0000","last_active":"2023-10-18T11:37:04.245394+0000","last_peered":"2023-10-18T11:37:04.245394+0000","last_clean":"2023-10-18T11:37:04.245394+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:37:04.245394+0000","last_undegraded":"2023-10-18T11:37:04.245394+0000","last_fullsized":"2023-10-18T11:37:04.245394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'100","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.150755+0000","last_change":"2023-10-18T11:09:39.366222+0000","last_active":"2023-10-18T11:37:05.150755+0000","last_peered":"2023-10-18T11:37:05.150755+0000","last_clean":"2023-10-18T11:37:05.150755+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:37:05.150755+0000","last_undegraded":"2023-10-18T11:37:05.150755+0000","last_fullsized":"2023-10-18T11:37:05.150755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:52.729507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'131","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.667410+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:37:03.667410+0000","last_peered":"2023-10-18T11:37:03.667410+0000","last_clean":"2023-10-18T11:37:03.667410+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:37:03.667410+0000","last_undegraded":"2023-10-18T11:37:03.667410+0000","last_fullsized":"2023-10-18T11:37:03.667410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:37:38.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'100","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.882110+0000","last_change":"2023-10-18T11:09:39.400563+0000","last_active":"2023-10-18T11:36:55.882110+0000","last_peered":"2023-10-18T11:36:55.882110+0000","last_clean":"2023-10-18T11:36:55.882110+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:36:55.882110+0000","last_undegraded":"2023-10-18T11:36:55.882110+0000","last_fullsized":"2023-10-18T11:36:55.882110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:24.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'119","reported_seq":148,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.428378+0000","last_change":"2023-10-18T11:09:39.320580+0000","last_active":"2023-10-18T11:37:04.428378+0000","last_peered":"2023-10-18T11:37:04.428378+0000","last_clean":"2023-10-18T11:37:04.428378+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:37:04.428378+0000","last_undegraded":"2023-10-18T11:37:04.428378+0000","last_fullsized":"2023-10-18T11:37:04.428378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'106","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.989231+0000","last_change":"2023-10-18T11:09:39.320508+0000","last_active":"2023-10-18T11:36:55.989231+0000","last_peered":"2023-10-18T11:36:55.989231+0000","last_clean":"2023-10-18T11:36:55.989231+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:36:55.989231+0000","last_undegraded":"2023-10-18T11:36:55.989231+0000","last_fullsized":"2023-10-18T11:36:55.989231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'112","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:44.149989+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:36:44.149989+0000","last_peered":"2023-10-18T11:36:44.149989+0000","last_clean":"2023-10-18T11:36:44.149989+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:36:44.149989+0000","last_undegraded":"2023-10-18T11:36:44.149989+0000","last_fullsized":"2023-10-18T11:36:44.149989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:11.432343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'103","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.239560+0000","last_change":"2023-10-18T11:09:39.421921+0000","last_active":"2023-10-18T11:36:58.239560+0000","last_peered":"2023-10-18T11:36:58.239560+0000","last_clean":"2023-10-18T11:36:58.239560+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:36:58.239560+0000","last_undegraded":"2023-10-18T11:36:58.239560+0000","last_fullsized":"2023-10-18T11:36:58.239560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'94","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.154928+0000","last_change":"2023-10-18T11:09:39.360846+0000","last_active":"2023-10-18T11:37:00.154928+0000","last_peered":"2023-10-18T11:37:00.154928+0000","last_clean":"2023-10-18T11:37:00.154928+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:37:00.154928+0000","last_undegraded":"2023-10-18T11:37:00.154928+0000","last_fullsized":"2023-10-18T11:37:00.154928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'109","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.846187+0000","last_change":"2023-10-18T11:10:10.413563+0000","last_active":"2023-10-18T11:36:59.846187+0000","last_peered":"2023-10-18T11:36:59.846187+0000","last_clean":"2023-10-18T11:36:59.846187+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:36:59.846187+0000","last_undegraded":"2023-10-18T11:36:59.846187+0000","last_fullsized":"2023-10-18T11:36:59.846187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:43.078216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'96","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.708016+0000","last_change":"2023-10-18T11:09:39.355047+0000","last_active":"2023-10-18T11:36:59.708016+0000","last_peered":"2023-10-18T11:36:59.708016+0000","last_clean":"2023-10-18T11:36:59.708016+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:36:59.708016+0000","last_undegraded":"2023-10-18T11:36:59.708016+0000","last_fullsized":"2023-10-18T11:36:59.708016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'99","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:56.193047+0000","last_change":"2023-10-18T11:09:39.418362+0000","last_active":"2023-10-18T11:36:56.193047+0000","last_peered":"2023-10-18T11:36:56.193047+0000","last_clean":"2023-10-18T11:36:56.193047+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:36:56.193047+0000","last_undegraded":"2023-10-18T11:36:56.193047+0000","last_fullsized":"2023-10-18T11:36:56.193047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'95","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.659659+0000","last_change":"2023-10-18T11:09:39.363750+0000","last_active":"2023-10-18T11:37:00.659659+0000","last_peered":"2023-10-18T11:37:00.659659+0000","last_clean":"2023-10-18T11:37:00.659659+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:37:00.659659+0000","last_undegraded":"2023-10-18T11:37:00.659659+0000","last_fullsized":"2023-10-18T11:37:00.659659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:43.536873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'127","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.459754+0000","last_change":"2023-10-18T11:09:39.363259+0000","last_active":"2023-10-18T11:37:04.459754+0000","last_peered":"2023-10-18T11:37:04.459754+0000","last_clean":"2023-10-18T11:37:04.459754+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:37:04.459754+0000","last_undegraded":"2023-10-18T11:37:04.459754+0000","last_fullsized":"2023-10-18T11:37:04.459754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'98","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.385034+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:37:00.385034+0000","last_peered":"2023-10-18T11:37:00.385034+0000","last_clean":"2023-10-18T11:37:00.385034+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:37:00.385034+0000","last_undegraded":"2023-10-18T11:37:00.385034+0000","last_fullsized":"2023-10-18T11:37:00.385034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:34.071910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2017,"num_read_kb":484709,"num_write":10619,"num_write_kb":576779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13929,"ondisk_log_size":13929,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6924,"ondisk_log_size":6924,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":100003437,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":2171,"num_read_kb":2416,"num_write":26199,"num_write_kb":112193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159002624,"data_stored":200006214,"data_compressed":12429396,"data_compressed_allocated":19357696,"data_compressed_original":60612608,"omap_allocated":0,"internal_metadata":0},"log_size":24249,"ondisk_log_size":24249,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509791,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113704,"kb_used_data":24224,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94258136,"statfs":{"total":96636764160,"available":96520331264,"internally_reserved":0,"allocated":24805376,"data_stored":31793700,"data_compressed":2010206,"data_compressed_allocated":3112960,"data_compressed_original":10338304,"omap_allocated":1588,"internal_metadata":91617740},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.45100000000000001,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.85799999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.69699999999999995},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":19.158000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.91900000000000004,"15min":0.72999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":19.673999999999999,"15min":19.673999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.88100000000000001,"15min":0.74299999999999999},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.36099999999999999},"max":{"1min":1.01,"5min":15.692,"15min":15.692},"last":0.67300000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.224,"5min":1.27,"15min":1.9239999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71499999999999997,"15min":0.68700000000000006},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95999999999999996,"5min":5.444,"15min":5.444},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.93000000000000005,"15min":0.82099999999999995},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0660000000000001,"5min":12.368,"15min":12.368},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.67400000000000004,"15min":0.71799999999999997},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":1.353,"5min":1.3899999999999999,"15min":13.1},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.439,"5min":1.895,"15min":1.895},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47099999999999997,"5min":1.321,"15min":1.321},"last":0.375}]},{"osd":5,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53600000000000003,"5min":0.85099999999999998,"15min":1.081},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.438,"15min":0.40899999999999997},"min":{"1min":0.30099999999999999,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.505,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.42199999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.439,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":0.55100000000000005,"5min":3.4409999999999998,"15min":3.4409999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54100000000000004,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.40999999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509789,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93740,"kb_used_data":18148,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278100,"statfs":{"total":96636764160,"available":96540774400,"internally_reserved":0,"allocated":18583552,"data_stored":23213633,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.64400000000000002},"min":{"1min":0.435,"5min":0.33600000000000002,"15min":0.31},"max":{"1min":0.82399999999999995,"5min":1.0740000000000001,"15min":9.3190000000000008},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59699999999999998,"15min":0.66700000000000004},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.28899999999999998},"max":{"1min":1.046,"5min":1.1699999999999999,"15min":15.282999999999999},"last":0.61199999999999999}]},{"osd":1,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61199999999999999,"15min":0.65100000000000002},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.0880000000000001,"5min":1.202,"15min":6.6429999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97999999999999998,"5min":1.153,"15min":1.748},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.35799999999999998,"15min":0.33300000000000002},"max":{"1min":1.05,"5min":1.355,"15min":1.839},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34499999999999997},"max":{"1min":1.153,"5min":1.468,"15min":1.954},"last":0.83099999999999996}]},{"osd":3,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":1.2410000000000001,"15min":13.840999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.77400000000000002},"min":{"1min":0.45700000000000002,"5min":0.36199999999999999,"15min":0.35099999999999998},"max":{"1min":1.0109999999999999,"5min":1.1950000000000001,"15min":23.155999999999999},"last":0.93899999999999995}]},{"osd":4,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25600000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52300000000000002,"5min":0.54100000000000004,"15min":0.88},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.46800000000000003,"5min":0.53500000000000003,"15min":1.0469999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.23300000000000001},"max":{"1min":0.501,"5min":0.54300000000000004,"15min":0.56799999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56100000000000005,"5min":0.624,"15min":0.624},"last":0.39100000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.40100000000000002},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.77600000000000002},"last":0.374},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41599999999999998,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57299999999999995,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.40200000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509790,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87864,"kb_used_data":20592,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94283976,"statfs":{"total":96636764160,"available":96546791424,"internally_reserved":0,"allocated":21086208,"data_stored":26657141,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.62,"15min":0.629},"min":{"1min":0.46000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1990000000000001,"5min":1.663,"15min":1.663},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.32500000000000001},"max":{"1min":1.2290000000000001,"5min":1.3720000000000001,"15min":1.8620000000000001},"last":0.629},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.34100000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.399,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.629,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.248},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90100000000000002,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.92800000000000005}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.38300000000000001,"15min":0.373},"max":{"1min":1.1299999999999999,"5min":1.4930000000000001,"15min":1.5049999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":1.244,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.223},"max":{"1min":0.50800000000000001,"5min":0.51500000000000001,"15min":0.72699999999999998},"last":0.504},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.622},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.67400000000000004},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.68999999999999995},"last":0.55700000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509789,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144544,"kb_used_data":27288,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94227296,"statfs":{"total":96636764160,"available":96488751104,"internally_reserved":0,"allocated":27942912,"data_stored":33976532,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":1591,"internal_metadata":120060361},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3260000000000001,"15min":1.129},"min":{"1min":0.70999999999999996,"5min":0.40899999999999997,"15min":0.314},"max":{"1min":2.673,"5min":24.654,"15min":24.654},"last":0.878},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.3380000000000001,"15min":1.159},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":2.1589999999999998,"5min":18.518000000000001,"15min":18.518000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3759999999999999,"15min":1.25},"min":{"1min":0.64500000000000002,"5min":0.441,"15min":0.35399999999999998},"max":{"1min":2.7869999999999999,"5min":16.361999999999998,"15min":16.361999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.5189999999999999,"15min":1.3620000000000001},"min":{"1min":0.72299999999999998,"5min":0.56200000000000006,"15min":0.43099999999999999},"max":{"1min":1.7769999999999999,"5min":24.611000000000001,"15min":24.611000000000001},"last":1.1899999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5029999999999999,"15min":1.395},"min":{"1min":0.49099999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.7269999999999999,"5min":16.576000000000001,"15min":16.576000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.6419999999999999,"15min":1.484},"min":{"1min":0.83199999999999996,"5min":0.46500000000000002,"15min":0.45100000000000001},"max":{"1min":2.04,"5min":24.553000000000001,"15min":24.553000000000001},"last":1.0529999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.4339999999999999,"15min":1.224},"min":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.432},"max":{"1min":2.3170000000000002,"5min":18.721,"15min":18.721},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3560000000000001,"15min":1.26},"min":{"1min":0.66800000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2189999999999999,"5min":16.481000000000002,"15min":16.481000000000002},"last":0.98799999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.5589999999999999,"15min":1.377},"min":{"1min":0.73299999999999998,"5min":0.59799999999999998,"15min":0.44700000000000001},"max":{"1min":2.2519999999999998,"5min":24.786999999999999,"15min":24.786999999999999},"last":1.149},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.6080000000000001,"15min":1.355},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.49199999999999999},"max":{"1min":2.464,"5min":18.681999999999999,"15min":18.681999999999999},"last":0.93200000000000005}]},{"osd":6,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4870000000000001,"15min":1.3959999999999999},"min":{"1min":0.67800000000000005,"5min":0.56100000000000005,"15min":0.52900000000000003},"max":{"1min":2.0129999999999999,"5min":16.513999999999999,"15min":16.513999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.665,"15min":1.496},"min":{"1min":0.79300000000000004,"5min":0.65600000000000003,"15min":0.54300000000000004},"max":{"1min":2.3580000000000001,"5min":24.834,"15min":24.834},"last":1.3480000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.681,"15min":1.4670000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.298,"5min":18.800000000000001,"15min":18.800000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.607,"5min":1.6200000000000001,"15min":1.5169999999999999},"min":{"1min":0.84399999999999997,"5min":0.496,"15min":0.496},"max":{"1min":2.5510000000000002,"5min":16.544,"15min":16.544},"last":1.389}]}]},{"osd":2,"up_from":15,"seq":64424509789,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94552,"kb_used_data":13456,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94277288,"statfs":{"total":96636764160,"available":96539942912,"internally_reserved":0,"allocated":13778944,"data_stored":17047576,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.66600000000000004,"5min":0.378,"15min":0.308},"max":{"1min":2.1139999999999999,"5min":2.5830000000000002,"15min":2.9249999999999998},"last":1.528},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.1200000000000001,"15min":1.1259999999999999},"min":{"1min":0.436,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.964},"last":1.419}]},{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2410000000000001,"15min":1.214},"min":{"1min":0.628,"5min":0.45300000000000001,"15min":0.40200000000000002},"max":{"1min":2.4060000000000001,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.369,"15min":1.3},"min":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.014}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.448,"15min":1.379},"min":{"1min":0.61499999999999999,"5min":0.44,"15min":0.44},"max":{"1min":4.1459999999999999,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.5049999999999999,"15min":1.3999999999999999},"min":{"1min":0.90200000000000002,"5min":0.55400000000000005,"15min":0.53900000000000003},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.2050000000000001,"15min":1.1419999999999999},"min":{"1min":0.55600000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.3759999999999999,"5min":3.3759999999999999,"15min":3.3759999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2729999999999999,"15min":1.2170000000000001},"min":{"1min":0.63200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.4830000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.3759999999999999,"15min":1.2609999999999999},"min":{"1min":0.752,"5min":0.58399999999999996,"15min":0.46200000000000002},"max":{"1min":5.0529999999999999,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":1.345},{"interface":"front","average":{"1min":1.532,"5min":1.3640000000000001,"15min":1.27},"min":{"1min":0.65900000000000003,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.175}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.407,"15min":1.333},"min":{"1min":0.80000000000000004,"5min":0.60199999999999998,"15min":0.49399999999999999},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.4850000000000001,"15min":1.371},"min":{"1min":1.01,"5min":0.68100000000000005,"15min":0.50700000000000001},"max":{"1min":5.133,"5min":5.133,"15min":5.133},"last":1.446}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.4690000000000001,"15min":1.3879999999999999},"min":{"1min":0.72899999999999998,"5min":0.52500000000000002,"15min":0.48599999999999999},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.544,"15min":1.456},"min":{"1min":0.84899999999999998,"5min":0.629,"15min":0.55900000000000005},"max":{"1min":4.0430000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":1.2829999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509790,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153264,"kb_used_data":23592,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94218576,"statfs":{"total":96636764160,"available":96479821824,"internally_reserved":0,"allocated":24158208,"data_stored":30584192,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0920000000000001,"15min":1.101},"min":{"1min":0.63400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.716,"5min":2.5649999999999999,"15min":10.836},"last":1.393},{"interface":"front","average":{"1min":1.232,"5min":1.143,"15min":1.131},"min":{"1min":0.71899999999999997,"5min":0.46999999999999997,"15min":0.42599999999999999},"max":{"1min":2.536,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":1.357}]},{"osd":2,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2110000000000001,"15min":1.1950000000000001},"min":{"1min":0.53700000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.3900000000000001,"5min":4.0670000000000002,"15min":4.4199999999999999},"last":1.321},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3149999999999999,"15min":1.3180000000000001},"min":{"1min":0.60099999999999998,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":1.776,"5min":2.8799999999999999,"15min":10.782},"last":1.2629999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.4239999999999999},"min":{"1min":0.68000000000000005,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":2.028,"5min":4.8380000000000001,"15min":6.8150000000000004},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.3169999999999999,"15min":1.333},"min":{"1min":0.93899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.1200000000000001,"5min":3.79,"15min":3.79},"last":1.4550000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.163,"15min":1.1739999999999999},"min":{"1min":0.496,"5min":0.376,"15min":0.376},"max":{"1min":1.647,"5min":3.9670000000000001,"15min":4.3890000000000002},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.248,"15min":1.2829999999999999},"min":{"1min":0.72799999999999998,"5min":0.63300000000000001,"15min":0.60899999999999999},"max":{"1min":1.821,"5min":2.6349999999999998,"15min":6.9950000000000001},"last":1.1519999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2609999999999999,"15min":1.2390000000000001},"min":{"1min":0.624,"5min":0.58599999999999997,"15min":0.495},"max":{"1min":3.5430000000000001,"5min":3.5840000000000001,"15min":3.5840000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2929999999999999,"15min":1.3069999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52900000000000003},"max":{"1min":1.8660000000000001,"5min":3.9169999999999998,"15min":4.3419999999999996},"last":1.218}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.397,"15min":1.4099999999999999},"min":{"1min":0.77600000000000002,"5min":0.67700000000000005,"15min":0.66000000000000003},"max":{"1min":2.0249999999999999,"5min":2.7400000000000002,"15min":6.944},"last":1.639},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":0.66700000000000004,"5min":0.628,"15min":0.55300000000000005},"max":{"1min":3.3849999999999998,"5min":3.657,"15min":3.657},"last":1.5660000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.4630000000000001,"15min":1.4470000000000001},"min":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":3.27,"5min":3.722,"15min":3.722},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.444,"15min":1.45},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.0350000000000001,"5min":4.0149999999999997,"15min":4.2919999999999998},"last":1.704}]}]},{"osd":0,"up_from":15,"seq":64424509790,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106768,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94265072,"statfs":{"total":96636764160,"available":96527433728,"internally_reserved":0,"allocated":17768448,"data_stored":22730274,"data_compressed":1487303,"data_compressed_allocated":2297856,"data_compressed_original":7491584,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.97999999999999998,"15min":1.03},"min":{"1min":0.53400000000000003,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":1.365,"5min":2.0299999999999998,"15min":5.7380000000000004},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.048,"15min":1.1819999999999999},"min":{"1min":0.65700000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":20.128},"last":1.085}]},{"osd":2,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.141,"15min":1.2130000000000001},"min":{"1min":0.67600000000000005,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":2.1040000000000001,"5min":2.8039999999999998,"15min":3.2839999999999998},"last":1.012},{"interface":"front","average":{"1min":1.169,"5min":1.1890000000000001,"15min":1.278},"min":{"1min":0.76000000000000001,"5min":0.38900000000000001,"15min":0.31900000000000001},"max":{"1min":2.0640000000000001,"5min":2.4580000000000002,"15min":3.3690000000000002},"last":1.631}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.2529999999999999,"15min":1.2769999999999999},"min":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.44600000000000001},"max":{"1min":2.3570000000000002,"5min":4.0510000000000002,"15min":8.9879999999999995},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.363,"15min":1.4199999999999999},"min":{"1min":0.73799999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.2080000000000002,"5min":2.7639999999999998,"15min":5.6219999999999999},"last":1.4319999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.232,"15min":1.202},"min":{"1min":1.006,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":1.954,"5min":2.044,"15min":2.976},"last":1.752},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.147,"15min":1.159},"min":{"1min":0.754,"5min":0.53800000000000003,"15min":0.51800000000000002},"max":{"1min":2.028,"5min":2.1779999999999999,"15min":3.6219999999999999},"last":1.2829999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.75600000000000001,"5min":0.52300000000000002,"15min":0.49099999999999999},"max":{"1min":1.9990000000000001,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3089999999999999,"15min":1.288},"min":{"1min":0.79100000000000004,"5min":0.59299999999999997,"15min":0.56200000000000006},"max":{"1min":2.125,"5min":2.2349999999999999,"15min":2.8140000000000001},"last":1.5649999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.3759999999999999,"15min":1.359},"min":{"1min":0.83499999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2410000000000001,"5min":2.274,"15min":2.7669999999999999},"last":1.72},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.3620000000000001,"15min":1.3500000000000001},"min":{"1min":0.80800000000000005,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":2.0579999999999998,"5min":2.1040000000000001,"15min":3.7669999999999999},"last":1.8200000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.4450000000000001,"15min":1.4319999999999999},"min":{"1min":1.042,"5min":0.56599999999999995,"15min":0.49199999999999999},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":3.915},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.363,"15min":1.375},"min":{"1min":0.85799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.1779999999999999,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1.3839999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542493,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98596,"kb_used_data":13340,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273244,"statfs":{"total":96636764160,"available":96535801856,"internally_reserved":0,"allocated":13660160,"data_stored":16262042,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.27300000000000002},"max":{"1min":1.1459999999999999,"5min":3.387,"15min":3.387},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.40999999999999998,"5min":0.33300000000000002,"15min":0.31},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.90900000000000003}]},{"osd":1,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.25},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.377},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.53000000000000003,"5min":0.38200000000000001,"15min":0.312},"max":{"1min":1.081,"5min":1.554,"15min":1.669},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.34999999999999998},"max":{"1min":1.1850000000000001,"5min":1.2070000000000001,"15min":1.712},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94299999999999995,"5min":1.1000000000000001,"15min":1.1950000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3200000000000001,"5min":1.427,"15min":2.694},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":1.0680000000000001,"5min":1.7929999999999999,"15min":2.1459999999999999},"last":0.83099999999999996}]},{"osd":4,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.503,"5min":0.55600000000000005,"15min":0.63700000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26500000000000001},"max":{"1min":0.45900000000000002,"5min":0.57599999999999996,"15min":0.68600000000000005},"last":0.308}]},{"osd":5,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.252},"max":{"1min":0.47699999999999998,"5min":0.65700000000000003,"15min":0.85199999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39200000000000002,"15min":0.39700000000000002},"min":{"1min":0.316,"5min":0.28899999999999998,"15min":0.26300000000000001},"max":{"1min":0.49199999999999999,"5min":0.65800000000000003,"15min":0.67000000000000004},"last":0.25}]},{"osd":7,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.54200000000000004,"5min":0.63600000000000001,"15min":0.77600000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52300000000000002,"5min":0.68300000000000005,"15min":0.80000000000000004},"last":0.26700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17371136,"data_stored":22005056,"data_compressed":1454768,"data_compressed_allocated":2252800,"data_compressed_original":6918144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23826432,"data_stored":30449342,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13447168,"data_stored":16912726,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27611136,"data_stored":33841682,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20754432,"data_stored":26522291,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":23078783,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13328384,"data_stored":16127192,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24412160,"data_stored":31069142,"data_compressed":1977671,"data_compressed_allocated":3067904,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:38:05.150 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-18T11:38:05.150 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:38:05.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.388+0000 7f204d500640 1 Processor -- start 2023-10-18T11:38:05.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.389+0000 7f204d500640 1 -- start start 2023-10-18T11:38:05.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.390+0000 7f204d500640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2048151190 0x7f204806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:05.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.390+0000 7f204d500640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f204806f1c0 0x7f20480c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:05.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.390+0000 7f204d500640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20480c7000 0x7f20480c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:05.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.390+0000 7f204d500640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480c7d10 con 0x7f2048151190 2023-10-18T11:38:05.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.390+0000 7f204d500640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2048151570 con 0x7f204806f1c0 2023-10-18T11:38:05.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.390+0000 7f204d500640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204806dcb0 con 0x7f20480c7000 2023-10-18T11:38:05.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.391+0000 7f203ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f204806f1c0 0x7f20480c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:05.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.391+0000 7f203ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f204806f1c0 0x7f20480c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:48126/0 (socket says 172.21.15.151:48126) 2023-10-18T11:38:05.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.391+0000 7f203ffff640 1 -- 172.21.15.151:0/999974575 learned_addr learned my addr 172.21.15.151:0/999974575 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:05.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.391+0000 7f2046ffd640 1 --2- 172.21.15.151:0/999974575 >> v2:172.21.15.151:3300/0 conn(0x7f2048151190 0x7f204806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:05.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.393+0000 7f203ffff640 1 -- 172.21.15.151:0/999974575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20480c7000 msgr2=0x7f20480c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:05.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.393+0000 7f203ffff640 1 --2- 172.21.15.151:0/999974575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20480c7000 0x7f20480c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.393+0000 7f203ffff640 1 -- 172.21.15.151:0/999974575 >> v2:172.21.15.151:3300/0 conn(0x7f2048151190 msgr2=0x7f204806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:05.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.393+0000 7f203ffff640 1 --2- 172.21.15.151:0/999974575 >> v2:172.21.15.151:3300/0 conn(0x7f2048151190 0x7f204806e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.393+0000 7f203ffff640 1 -- 172.21.15.151:0/999974575 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204806e270 con 0x7f204806f1c0 2023-10-18T11:38:05.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.396+0000 7f203ffff640 1 --2- 172.21.15.151:0/999974575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204806f1c0 0x7f20480c4370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f20480c8070 tx=0x7f203002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2953e4d46059909e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:05.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.400+0000 7f20467fc640 1 -- 172.21.15.151:0/999974575 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030030860 con 0x7f204806f1c0 2023-10-18T11:38:05.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.400+0000 7f20467fc640 1 -- 172.21.15.151:0/999974575 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20300309c0 con 0x7f204806f1c0 2023-10-18T11:38:05.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.400+0000 7f20467fc640 1 -- 172.21.15.151:0/999974575 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030030d50 con 0x7f204806f1c0 2023-10-18T11:38:05.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.401+0000 7f204d500640 1 -- 172.21.15.151:0/999974575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204806f1c0 msgr2=0x7f20480c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:05.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.401+0000 7f204d500640 1 --2- 172.21.15.151:0/999974575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204806f1c0 0x7f20480c4370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f20480c8070 tx=0x7f203002b9a0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.401+0000 7f204d500640 1 -- 172.21.15.151:0/999974575 shutdown_connections 2023-10-18T11:38:05.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.401+0000 7f204d500640 1 --2- 172.21.15.151:0/999974575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20480c7000 0x7f20480c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.401+0000 7f204d500640 1 --2- 172.21.15.151:0/999974575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204806f1c0 0x7f20480c4370 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.401+0000 7f204d500640 1 --2- 172.21.15.151:0/999974575 >> v2:172.21.15.151:3300/0 conn(0x7f2048151190 0x7f204806e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.401+0000 7f204d500640 1 -- 172.21.15.151:0/999974575 >> 172.21.15.151:0/999974575 conn(0x7f20480659d0 msgr2=0x7f2048065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:05.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.401+0000 7f204d500640 1 -- 172.21.15.151:0/999974575 shutdown_connections 2023-10-18T11:38:05.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.401+0000 7f204d500640 1 -- 172.21.15.151:0/999974575 wait complete. 2023-10-18T11:38:05.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.403+0000 7f204d500640 1 Processor -- start 2023-10-18T11:38:05.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.403+0000 7f204d500640 1 -- start start 2023-10-18T11:38:05.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.404+0000 7f204d500640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204806f1c0 0x7f20480cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:05.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.404+0000 7f204d500640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480c7000 0x7f204806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:05.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.404+0000 7f204d500640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2048151190 0x7f2048149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:05.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.404+0000 7f204d500640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204806bbb0 con 0x7f204806f1c0 2023-10-18T11:38:05.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.404+0000 7f204d500640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480ca4f0 con 0x7f20480c7000 2023-10-18T11:38:05.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.404+0000 7f204d500640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204806bdc0 con 0x7f2048151190 2023-10-18T11:38:05.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.405+0000 7f2046ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204806f1c0 0x7f20480cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:05.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.405+0000 7f203ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480c7000 0x7f204806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:05.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.405+0000 7f203ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480c7000 0x7f204806b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:48140/0 (socket says 172.21.15.151:48140) 2023-10-18T11:38:05.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.405+0000 7f203ffff640 1 -- 172.21.15.151:0/958839097 learned_addr learned my addr 172.21.15.151:0/958839097 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:05.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.407+0000 7f20477fe640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2048151190 0x7f2048149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:05.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.409+0000 7f203ffff640 1 -- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2048151190 msgr2=0x7f2048149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:05.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.409+0000 7f203ffff640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2048151190 0x7f2048149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.409+0000 7f203ffff640 1 -- 172.21.15.151:0/958839097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204806f1c0 msgr2=0x7f20480cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:05.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.409+0000 7f203ffff640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204806f1c0 0x7f20480cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.409+0000 7f203ffff640 1 -- 172.21.15.151:0/958839097 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300094d0 con 0x7f20480c7000 2023-10-18T11:38:05.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.412+0000 7f203ffff640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480c7000 0x7f204806b5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2030000c00 tx=0x7f2030004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:05.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.416+0000 7f203f7fe640 1 -- 172.21.15.151:0/958839097 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030039a90 con 0x7f20480c7000 2023-10-18T11:38:05.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.416+0000 7f203f7fe640 1 -- 172.21.15.151:0/958839097 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030039bf0 con 0x7f20480c7000 2023-10-18T11:38:05.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.416+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20481ef600 con 0x7f20480c7000 2023-10-18T11:38:05.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.416+0000 7f203f7fe640 1 -- 172.21.15.151:0/958839097 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20300433f0 con 0x7f20480c7000 2023-10-18T11:38:05.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.416+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204806aea0 con 0x7f20480c7000 2023-10-18T11:38:05.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.417+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20481ef7c0 con 0x7f20480c7000 2023-10-18T11:38:05.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.438+0000 7f203f7fe640 1 -- 172.21.15.151:0/958839097 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f203004c3b0 con 0x7f20480c7000 2023-10-18T11:38:05.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.440+0000 7f203f7fe640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f202806aec0 0x7f202806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:05.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.440+0000 7f203f7fe640 1 -- 172.21.15.151:0/958839097 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20300ac2e0 con 0x7f20480c7000 2023-10-18T11:38:05.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.440+0000 7f2046ffd640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f202806aec0 0x7f202806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:05.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.441+0000 7f2046ffd640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f202806aec0 0x7f202806d380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2038009b40 tx=0x7f2038009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:05.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.678+0000 7f203f7fe640 1 -- 172.21.15.151:0/958839097 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20300771f0 con 0x7f20480c7000 2023-10-18T11:38:05.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.883+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20480c6900 con 0x7f202806aec0 2023-10-18T11:38:05.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.896+0000 7f203f7fe640 1 -- 172.21.15.151:0/958839097 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370647 (secure 0 0 0) 0x7f2038011a60 con 0x7f202806aec0 2023-10-18T11:38:05.903 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:38:05.905 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:38:05.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.901+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f202806aec0 msgr2=0x7f202806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:05.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.901+0000 7f204d500640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f202806aec0 0x7f202806d380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2038009b40 tx=0x7f2038009190 comp rx=0 tx=0).stop 2023-10-18T11:38:05.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.901+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480c7000 msgr2=0x7f204806b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:05.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.902+0000 7f204d500640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480c7000 0x7f204806b5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2030000c00 tx=0x7f2030004730 comp rx=0 tx=0).stop 2023-10-18T11:38:05.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.902+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 shutdown_connections 2023-10-18T11:38:05.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.902+0000 7f204d500640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2048151190 0x7f2048149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.902+0000 7f204d500640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f202806aec0 0x7f202806d380 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.902+0000 7f204d500640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480c7000 0x7f204806b5a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.902+0000 7f204d500640 1 --2- 172.21.15.151:0/958839097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f204806f1c0 0x7f20480cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:05.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.902+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 >> 172.21.15.151:0/958839097 conn(0x7f20480659d0 msgr2=0x7f204814e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:05.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.902+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 shutdown_connections 2023-10-18T11:38:05.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:05.902+0000 7f204d500640 1 -- 172.21.15.151:0/958839097 wait complete. 2023-10-18T11:38:05.923 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":888,"stamp":"2023-10-18T11:38:04.606942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":100593805,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":4304,"num_read_kb":487225,"num_write":36977,"num_write_kb":691388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45219,"ondisk_log_size":45219,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":893032,"kb_used_data":157992,"kb_used_omap":12,"kb_used_meta":734963,"kb_avail":754081688,"statfs":{"total":773094113280,"available":772179648512,"internally_reserved":0,"allocated":161783808,"data_stored":202265090,"data_compressed":12494466,"data_compressed_allocated":19447808,"data_compressed_original":61759488,"omap_allocated":12742,"internal_metadata":752602682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":89394,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":96,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002747"},"pg_stats":[{"pgid":"2.1f","version":"31'1782","reported_seq":1816,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.435031+0000","last_change":"2023-10-18T11:09:36.796784+0000","last_active":"2023-10-18T11:37:57.435031+0000","last_peered":"2023-10-18T11:37:57.435031+0000","last_clean":"2023-10-18T11:37:57.435031+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:37:57.435031+0000","last_undegraded":"2023-10-18T11:37:57.435031+0000","last_fullsized":"2023-10-18T11:37:57.435031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1782,"log_dups_size":0,"ondisk_log_size":1782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9274710,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1779,"num_write_kb":10008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'108","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.524602+0000","last_change":"2023-10-18T11:09:39.421701+0000","last_active":"2023-10-18T11:37:04.524602+0000","last_peered":"2023-10-18T11:37:04.524602+0000","last_clean":"2023-10-18T11:37:04.524602+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:37:04.524602+0000","last_undegraded":"2023-10-18T11:37:04.524602+0000","last_fullsized":"2023-10-18T11:37:04.524602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'384","reported_seq":457,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.525040+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:37:00.525040+0000","last_peered":"2023-10-18T11:37:00.525040+0000","last_clean":"2023-10-18T11:37:00.525040+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:37:00.525040+0000","last_undegraded":"2023-10-18T11:37:00.525040+0000","last_fullsized":"2023-10-18T11:37:00.525040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":285,"num_write_kb":10314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'1437","reported_seq":1472,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:36.414409+0000","last_change":"2023-10-18T11:09:36.909894+0000","last_active":"2023-10-18T11:37:36.414409+0000","last_peered":"2023-10-18T11:37:36.414409+0000","last_clean":"2023-10-18T11:37:36.414409+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:37:36.414409+0000","last_undegraded":"2023-10-18T11:37:36.414409+0000","last_fullsized":"2023-10-18T11:37:36.414409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1437,"log_dups_size":0,"ondisk_log_size":1437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1431,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'129","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.778362+0000","last_change":"2023-10-18T11:09:39.363102+0000","last_active":"2023-10-18T11:37:04.778362+0000","last_peered":"2023-10-18T11:37:04.778362+0000","last_clean":"2023-10-18T11:37:04.778362+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:37:04.778362+0000","last_undegraded":"2023-10-18T11:37:04.778362+0000","last_fullsized":"2023-10-18T11:37:04.778362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'453","reported_seq":592,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.264450+0000","last_change":"2023-10-18T11:09:46.109981+0000","last_active":"2023-10-18T11:37:08.264450+0000","last_peered":"2023-10-18T11:37:08.264450+0000","last_clean":"2023-10-18T11:37:08.264450+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:37:08.264450+0000","last_undegraded":"2023-10-18T11:37:08.264450+0000","last_fullsized":"2023-10-18T11:37:08.264450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:26.971949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":14204,"num_write":357,"num_write_kb":21017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'815","reported_seq":847,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.512091+0000","last_change":"2023-10-18T11:09:36.896708+0000","last_active":"2023-10-18T11:37:57.512091+0000","last_peered":"2023-10-18T11:37:57.512091+0000","last_clean":"2023-10-18T11:37:57.512091+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:37:57.512091+0000","last_undegraded":"2023-10-18T11:37:57.512091+0000","last_fullsized":"2023-10-18T11:37:57.512091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3060108,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'105","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.255149+0000","last_change":"2023-10-18T11:09:39.397225+0000","last_active":"2023-10-18T11:36:58.255149+0000","last_peered":"2023-10-18T11:36:58.255149+0000","last_clean":"2023-10-18T11:36:58.255149+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:36:58.255149+0000","last_undegraded":"2023-10-18T11:36:58.255149+0000","last_fullsized":"2023-10-18T11:36:58.255149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'331","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.775789+0000","last_change":"2023-10-18T11:09:46.114798+0000","last_active":"2023-10-18T11:37:07.775789+0000","last_peered":"2023-10-18T11:37:07.775789+0000","last_clean":"2023-10-18T11:37:07.775789+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:37:07.775789+0000","last_undegraded":"2023-10-18T11:37:07.775789+0000","last_fullsized":"2023-10-18T11:37:07.775789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:57.280120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":213,"num_write_kb":9865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:34:36.253199+0000","last_change":"2023-10-18T11:09:36.795004+0000","last_active":"2023-10-18T11:34:36.253199+0000","last_peered":"2023-10-18T11:34:36.253199+0000","last_clean":"2023-10-18T11:34:36.253199+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:34:36.253199+0000","last_undegraded":"2023-10-18T11:34:36.253199+0000","last_fullsized":"2023-10-18T11:34:36.253199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'116","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.751037+0000","last_change":"2023-10-18T11:09:39.398621+0000","last_active":"2023-10-18T11:37:07.751037+0000","last_peered":"2023-10-18T11:37:07.751037+0000","last_clean":"2023-10-18T11:37:07.751037+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:37:07.751037+0000","last_undegraded":"2023-10-18T11:37:07.751037+0000","last_fullsized":"2023-10-18T11:37:07.751037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'461","reported_seq":543,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.586761+0000","last_change":"2023-10-18T11:09:46.115280+0000","last_active":"2023-10-18T11:37:03.586761+0000","last_peered":"2023-10-18T11:37:03.586761+0000","last_clean":"2023-10-18T11:37:03.586761+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:37:03.586761+0000","last_undegraded":"2023-10-18T11:37:03.586761+0000","last_fullsized":"2023-10-18T11:37:03.586761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:26.647416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":15764,"num_write":351,"num_write_kb":32860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'100","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.808165+0000","last_change":"2023-10-18T11:09:39.397253+0000","last_active":"2023-10-18T11:37:07.808165+0000","last_peered":"2023-10-18T11:37:07.808165+0000","last_clean":"2023-10-18T11:37:07.808165+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:37:07.808165+0000","last_undegraded":"2023-10-18T11:37:07.808165+0000","last_fullsized":"2023-10-18T11:37:07.808165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'767","reported_seq":800,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.393018+0000","last_change":"2023-10-18T11:09:36.893066+0000","last_active":"2023-10-18T11:37:42.393018+0000","last_peered":"2023-10-18T11:37:42.393018+0000","last_clean":"2023-10-18T11:37:42.393018+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:37:42.393018+0000","last_undegraded":"2023-10-18T11:37:42.393018+0000","last_fullsized":"2023-10-18T11:37:42.393018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:32.587464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'437","reported_seq":509,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.656541+0000","last_change":"2023-10-18T11:09:46.096113+0000","last_active":"2023-10-18T11:37:00.656541+0000","last_peered":"2023-10-18T11:37:00.656541+0000","last_clean":"2023-10-18T11:37:00.656541+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:37:00.656541+0000","last_undegraded":"2023-10-18T11:37:00.656541+0000","last_fullsized":"2023-10-18T11:37:00.656541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:09.971210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":11430,"num_write":325,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'106","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.691647+0000","last_change":"2023-10-18T11:09:39.423651+0000","last_active":"2023-10-18T11:36:59.691647+0000","last_peered":"2023-10-18T11:36:59.691647+0000","last_clean":"2023-10-18T11:36:59.691647+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:36:59.691647+0000","last_undegraded":"2023-10-18T11:36:59.691647+0000","last_fullsized":"2023-10-18T11:36:59.691647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'485","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.026143+0000","last_change":"2023-10-18T11:09:36.913611+0000","last_active":"2023-10-18T11:37:54.026143+0000","last_peered":"2023-10-18T11:37:54.026143+0000","last_clean":"2023-10-18T11:37:54.026143+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:37:54.026143+0000","last_undegraded":"2023-10-18T11:37:54.026143+0000","last_fullsized":"2023-10-18T11:37:54.026143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'427","reported_seq":518,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.167961+0000","last_change":"2023-10-18T11:09:46.114729+0000","last_active":"2023-10-18T11:37:05.167961+0000","last_peered":"2023-10-18T11:37:05.167961+0000","last_clean":"2023-10-18T11:37:05.167961+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:37:05.167961+0000","last_undegraded":"2023-10-18T11:37:05.167961+0000","last_fullsized":"2023-10-18T11:37:05.167961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:50.156790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":327,"num_write_kb":17650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'110","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.132888+0000","last_change":"2023-10-18T11:09:39.420146+0000","last_active":"2023-10-18T11:37:07.132888+0000","last_peered":"2023-10-18T11:37:07.132888+0000","last_clean":"2023-10-18T11:37:07.132888+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:37:07.132888+0000","last_undegraded":"2023-10-18T11:37:07.132888+0000","last_fullsized":"2023-10-18T11:37:07.132888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'280","reported_seq":314,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.910291+0000","last_change":"2023-10-18T11:09:36.915198+0000","last_active":"2023-10-18T11:37:42.910291+0000","last_peered":"2023-10-18T11:37:42.910291+0000","last_clean":"2023-10-18T11:37:42.910291+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:37:42.910291+0000","last_undegraded":"2023-10-18T11:37:42.910291+0000","last_fullsized":"2023-10-18T11:37:42.910291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:18.429550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'423","reported_seq":480,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:52.201304+0000","last_change":"2023-10-18T11:10:10.413988+0000","last_active":"2023-10-18T11:36:52.201304+0000","last_peered":"2023-10-18T11:36:52.201304+0000","last_clean":"2023-10-18T11:36:52.201304+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:36:52.201304+0000","last_undegraded":"2023-10-18T11:36:52.201304+0000","last_fullsized":"2023-10-18T11:36:52.201304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":324,"num_write_kb":16893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'91","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.025485+0000","last_change":"2023-10-18T11:09:39.399181+0000","last_active":"2023-10-18T11:37:00.025485+0000","last_peered":"2023-10-18T11:37:00.025485+0000","last_clean":"2023-10-18T11:37:00.025485+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:37:00.025485+0000","last_undegraded":"2023-10-18T11:37:00.025485+0000","last_fullsized":"2023-10-18T11:37:00.025485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:13.349921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.981750+0000","last_change":"2023-10-18T11:09:36.797637+0000","last_active":"2023-10-18T11:37:42.981750+0000","last_peered":"2023-10-18T11:37:42.981750+0000","last_clean":"2023-10-18T11:37:42.981750+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:37:42.981750+0000","last_undegraded":"2023-10-18T11:37:42.981750+0000","last_fullsized":"2023-10-18T11:37:42.981750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:08.109221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'432","reported_seq":615,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.552717+0000","last_change":"2023-10-18T11:09:46.109408+0000","last_active":"2023-10-18T11:37:04.552717+0000","last_peered":"2023-10-18T11:37:04.552717+0000","last_clean":"2023-10-18T11:37:04.552717+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:37:04.552717+0000","last_undegraded":"2023-10-18T11:37:04.552717+0000","last_fullsized":"2023-10-18T11:37:04.552717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:29.602612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":19825,"num_write":333,"num_write_kb":19445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'103","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.854148+0000","last_change":"2023-10-18T11:09:39.366234+0000","last_active":"2023-10-18T11:36:55.854148+0000","last_peered":"2023-10-18T11:36:55.854148+0000","last_clean":"2023-10-18T11:36:55.854148+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:36:55.854148+0000","last_undegraded":"2023-10-18T11:36:55.854148+0000","last_fullsized":"2023-10-18T11:36:55.854148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.152488+0000","last_change":"2023-10-18T11:09:36.896533+0000","last_active":"2023-10-18T11:37:54.152488+0000","last_peered":"2023-10-18T11:37:54.152488+0000","last_clean":"2023-10-18T11:37:54.152488+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:37:54.152488+0000","last_undegraded":"2023-10-18T11:37:54.152488+0000","last_fullsized":"2023-10-18T11:37:54.152488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'438","reported_seq":520,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.518223+0000","last_change":"2023-10-18T11:09:46.094196+0000","last_active":"2023-10-18T11:37:03.518223+0000","last_peered":"2023-10-18T11:37:03.518223+0000","last_clean":"2023-10-18T11:37:03.518223+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:37:03.518223+0000","last_undegraded":"2023-10-18T11:37:03.518223+0000","last_fullsized":"2023-10-18T11:37:03.518223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:43.456989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":16856,"num_write":335,"num_write_kb":23716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'108","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.131193+0000","last_change":"2023-10-18T11:09:39.420016+0000","last_active":"2023-10-18T11:37:07.131193+0000","last_peered":"2023-10-18T11:37:07.131193+0000","last_clean":"2023-10-18T11:37:07.131193+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:37:07.131193+0000","last_undegraded":"2023-10-18T11:37:07.131193+0000","last_fullsized":"2023-10-18T11:37:07.131193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'288","reported_seq":322,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.247981+0000","last_change":"2023-10-18T11:09:36.913659+0000","last_active":"2023-10-18T11:37:56.247981+0000","last_peered":"2023-10-18T11:37:56.247981+0000","last_clean":"2023-10-18T11:37:56.247981+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:37:56.247981+0000","last_undegraded":"2023-10-18T11:37:56.247981+0000","last_fullsized":"2023-10-18T11:37:56.247981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'450","reported_seq":535,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.819051+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:37:08.819051+0000","last_peered":"2023-10-18T11:37:08.819051+0000","last_clean":"2023-10-18T11:37:08.819051+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:37:08.819051+0000","last_undegraded":"2023-10-18T11:37:08.819051+0000","last_fullsized":"2023-10-18T11:37:08.819051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":337,"num_write_kb":25264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'104","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.551663+0000","last_change":"2023-10-18T11:09:39.243607+0000","last_active":"2023-10-18T11:37:03.551663+0000","last_peered":"2023-10-18T11:37:03.551663+0000","last_clean":"2023-10-18T11:37:03.551663+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:37:03.551663+0000","last_undegraded":"2023-10-18T11:37:03.551663+0000","last_fullsized":"2023-10-18T11:37:03.551663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'242","reported_seq":276,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:40.777847+0000","last_change":"2023-10-18T11:09:36.798396+0000","last_active":"2023-10-18T11:37:40.777847+0000","last_peered":"2023-10-18T11:37:40.777847+0000","last_clean":"2023-10-18T11:37:40.777847+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:37:40.777847+0000","last_undegraded":"2023-10-18T11:37:40.777847+0000","last_fullsized":"2023-10-18T11:37:40.777847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:04.311252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'490","reported_seq":562,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:53.863488+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:36:53.863488+0000","last_peered":"2023-10-18T11:36:53.863488+0000","last_clean":"2023-10-18T11:36:53.863488+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:36:53.863488+0000","last_undegraded":"2023-10-18T11:36:53.863488+0000","last_fullsized":"2023-10-18T11:36:53.863488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":390,"num_write_kb":31170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'136","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.283144+0000","last_change":"2023-10-18T11:09:39.417304+0000","last_active":"2023-10-18T11:37:07.283144+0000","last_peered":"2023-10-18T11:37:07.283144+0000","last_clean":"2023-10-18T11:37:07.283144+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:37:07.283144+0000","last_undegraded":"2023-10-18T11:37:07.283144+0000","last_fullsized":"2023-10-18T11:37:07.283144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'790","reported_seq":824,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:31.939729+0000","last_change":"2023-10-18T11:09:36.909623+0000","last_active":"2023-10-18T11:37:31.939729+0000","last_peered":"2023-10-18T11:37:31.939729+0000","last_clean":"2023-10-18T11:37:31.939729+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:37:31.939729+0000","last_undegraded":"2023-10-18T11:37:31.939729+0000","last_fullsized":"2023-10-18T11:37:31.939729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'468","reported_seq":527,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.789125+0000","last_change":"2023-10-18T11:09:46.100735+0000","last_active":"2023-10-18T11:36:58.789125+0000","last_peered":"2023-10-18T11:36:58.789125+0000","last_clean":"2023-10-18T11:36:58.789125+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:36:58.789125+0000","last_undegraded":"2023-10-18T11:36:58.789125+0000","last_fullsized":"2023-10-18T11:36:58.789125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":9414,"num_write":343,"num_write_kb":17104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'108","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:53.879961+0000","last_change":"2023-10-18T11:09:39.400602+0000","last_active":"2023-10-18T11:36:53.879961+0000","last_peered":"2023-10-18T11:36:53.879961+0000","last_clean":"2023-10-18T11:36:53.879961+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:36:53.879961+0000","last_undegraded":"2023-10-18T11:36:53.879961+0000","last_fullsized":"2023-10-18T11:36:53.879961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:37.020893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1648","reported_seq":1682,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.966733+0000","last_change":"2023-10-18T11:09:36.915028+0000","last_active":"2023-10-18T11:37:53.966733+0000","last_peered":"2023-10-18T11:37:53.966733+0000","last_clean":"2023-10-18T11:37:53.966733+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:37:53.966733+0000","last_undegraded":"2023-10-18T11:37:53.966733+0000","last_fullsized":"2023-10-18T11:37:53.966733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1639,"num_write_kb":9112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'412","reported_seq":497,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.555132+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:37:03.555132+0000","last_peered":"2023-10-18T11:37:03.555132+0000","last_clean":"2023-10-18T11:37:03.555132+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:37:03.555132+0000","last_undegraded":"2023-10-18T11:37:03.555132+0000","last_fullsized":"2023-10-18T11:37:03.555132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:18.510917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":14478,"num_write":303,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'106","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.760732+0000","last_change":"2023-10-18T11:09:39.243829+0000","last_active":"2023-10-18T11:37:07.760732+0000","last_peered":"2023-10-18T11:37:07.760732+0000","last_clean":"2023-10-18T11:37:07.760732+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:37:07.760732+0000","last_undegraded":"2023-10-18T11:37:07.760732+0000","last_fullsized":"2023-10-18T11:37:07.760732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'1264","reported_seq":1755,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:58.340539+0000","last_change":"2023-10-18T11:09:36.910270+0000","last_active":"2023-10-18T11:37:58.340539+0000","last_peered":"2023-10-18T11:37:58.340539+0000","last_clean":"2023-10-18T11:37:58.340539+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:37:58.340539+0000","last_undegraded":"2023-10-18T11:37:58.340539+0000","last_fullsized":"2023-10-18T11:37:58.340539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4329052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":492,"num_write":1258,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'421","reported_seq":527,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.303116+0000","last_change":"2023-10-18T11:09:46.114610+0000","last_active":"2023-10-18T11:37:07.303116+0000","last_peered":"2023-10-18T11:37:07.303116+0000","last_clean":"2023-10-18T11:37:07.303116+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:37:07.303116+0000","last_undegraded":"2023-10-18T11:37:07.303116+0000","last_fullsized":"2023-10-18T11:37:07.303116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":19812,"num_write":327,"num_write_kb":12739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'102","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:52.025272+0000","last_change":"2023-10-18T11:09:39.404210+0000","last_active":"2023-10-18T11:36:52.025272+0000","last_peered":"2023-10-18T11:36:52.025272+0000","last_clean":"2023-10-18T11:36:52.025272+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:36:52.025272+0000","last_undegraded":"2023-10-18T11:36:52.025272+0000","last_fullsized":"2023-10-18T11:36:52.025272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'373","reported_seq":408,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.981272+0000","last_change":"2023-10-18T11:09:36.913804+0000","last_active":"2023-10-18T11:37:42.981272+0000","last_peered":"2023-10-18T11:37:42.981272+0000","last_clean":"2023-10-18T11:37:42.981272+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:37:42.981272+0000","last_undegraded":"2023-10-18T11:37:42.981272+0000","last_fullsized":"2023-10-18T11:37:42.981272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956268,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'424","reported_seq":516,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:06.995346+0000","last_change":"2023-10-18T11:09:46.092566+0000","last_active":"2023-10-18T11:37:06.995346+0000","last_peered":"2023-10-18T11:37:06.995346+0000","last_clean":"2023-10-18T11:37:06.995346+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:37:06.995346+0000","last_undegraded":"2023-10-18T11:37:06.995346+0000","last_fullsized":"2023-10-18T11:37:06.995346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:42.848835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":329,"num_write_kb":22819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'106","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:56.609366+0000","last_change":"2023-10-18T11:09:39.422507+0000","last_active":"2023-10-18T11:36:56.609366+0000","last_peered":"2023-10-18T11:36:56.609366+0000","last_clean":"2023-10-18T11:36:56.609366+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:36:56.609366+0000","last_undegraded":"2023-10-18T11:36:56.609366+0000","last_fullsized":"2023-10-18T11:36:56.609366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'9","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.822485+0000","last_change":"2023-10-18T11:09:36.828474+0000","last_active":"2023-10-18T11:37:16.822485+0000","last_peered":"2023-10-18T11:37:16.822485+0000","last_clean":"2023-10-18T11:37:16.822485+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:37:16.822485+0000","last_undegraded":"2023-10-18T11:37:16.822485+0000","last_fullsized":"2023-10-18T11:37:16.822485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:35:21.257875+0000","last_change":"2023-10-18T11:09:19.365660+0000","last_active":"2023-10-18T11:35:21.257875+0000","last_peered":"2023-10-18T11:35:21.257875+0000","last_clean":"2023-10-18T11:35:21.257875+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:35:21.257875+0000","last_undegraded":"2023-10-18T11:35:21.257875+0000","last_fullsized":"2023-10-18T11:35:21.257875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_clean_scrub_stamp":"2023-10-18T11:09:17.711667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:34:53.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'526","reported_seq":631,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.294647+0000","last_change":"2023-10-18T11:09:46.118571+0000","last_active":"2023-10-18T11:37:07.294647+0000","last_peered":"2023-10-18T11:37:07.294647+0000","last_clean":"2023-10-18T11:37:07.294647+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:37:07.294647+0000","last_undegraded":"2023-10-18T11:37:07.294647+0000","last_fullsized":"2023-10-18T11:37:07.294647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:46.781070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":19822,"num_write":415,"num_write_kb":19524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'114","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.707662+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:36:59.707662+0000","last_peered":"2023-10-18T11:36:59.707662+0000","last_clean":"2023-10-18T11:36:59.707662+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:36:59.707662+0000","last_undegraded":"2023-10-18T11:36:59.707662+0000","last_fullsized":"2023-10-18T11:36:59.707662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'899","reported_seq":932,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:36.378659+0000","last_change":"2023-10-18T11:09:36.829100+0000","last_active":"2023-10-18T11:36:36.378659+0000","last_peered":"2023-10-18T11:36:36.378659+0000","last_clean":"2023-10-18T11:36:36.378659+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:36:36.378659+0000","last_undegraded":"2023-10-18T11:36:36.378659+0000","last_fullsized":"2023-10-18T11:36:36.378659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:29:11.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'411","reported_seq":522,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.809149+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:37:07.809149+0000","last_peered":"2023-10-18T11:37:07.809149+0000","last_clean":"2023-10-18T11:37:07.809149+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:37:07.809149+0000","last_undegraded":"2023-10-18T11:37:07.809149+0000","last_fullsized":"2023-10-18T11:37:07.809149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":18796,"num_write":308,"num_write_kb":13390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'100","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.585947+0000","last_change":"2023-10-18T11:09:39.419862+0000","last_active":"2023-10-18T11:37:03.585947+0000","last_peered":"2023-10-18T11:37:03.585947+0000","last_clean":"2023-10-18T11:37:03.585947+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:37:03.585947+0000","last_undegraded":"2023-10-18T11:37:03.585947+0000","last_fullsized":"2023-10-18T11:37:03.585947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'1290","reported_seq":1323,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.409200+0000","last_change":"2023-10-18T11:09:36.912905+0000","last_active":"2023-10-18T11:37:56.409200+0000","last_peered":"2023-10-18T11:37:56.409200+0000","last_clean":"2023-10-18T11:37:56.409200+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:37:56.409200+0000","last_undegraded":"2023-10-18T11:37:56.409200+0000","last_fullsized":"2023-10-18T11:37:56.409200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7520680,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'435","reported_seq":548,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.568333+0000","last_change":"2023-10-18T11:09:46.097744+0000","last_active":"2023-10-18T11:37:03.568333+0000","last_peered":"2023-10-18T11:37:03.568333+0000","last_clean":"2023-10-18T11:37:03.568333+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:37:03.568333+0000","last_undegraded":"2023-10-18T11:37:03.568333+0000","last_fullsized":"2023-10-18T11:37:03.568333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:20.073279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":340,"num_write_kb":14424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'98","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:51.638498+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:36:51.638498+0000","last_peered":"2023-10-18T11:36:51.638498+0000","last_clean":"2023-10-18T11:36:51.638498+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:36:51.638498+0000","last_undegraded":"2023-10-18T11:36:51.638498+0000","last_fullsized":"2023-10-18T11:36:51.638498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:51.220855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'7","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:36.378712+0000","last_change":"2023-10-18T11:09:36.907280+0000","last_active":"2023-10-18T11:36:36.378712+0000","last_peered":"2023-10-18T11:36:36.378712+0000","last_clean":"2023-10-18T11:36:36.378712+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:36:36.378712+0000","last_undegraded":"2023-10-18T11:36:36.378712+0000","last_fullsized":"2023-10-18T11:36:36.378712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'409","reported_seq":498,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.751846+0000","last_change":"2023-10-18T11:09:46.096894+0000","last_active":"2023-10-18T11:37:07.751846+0000","last_peered":"2023-10-18T11:37:07.751846+0000","last_clean":"2023-10-18T11:37:07.751846+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:37:07.751846+0000","last_undegraded":"2023-10-18T11:37:07.751846+0000","last_fullsized":"2023-10-18T11:37:07.751846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":17064,"num_write":295,"num_write_kb":17834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'106","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.565157+0000","last_change":"2023-10-18T11:09:39.399750+0000","last_active":"2023-10-18T11:37:04.565157+0000","last_peered":"2023-10-18T11:37:04.565157+0000","last_clean":"2023-10-18T11:37:04.565157+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:37:04.565157+0000","last_undegraded":"2023-10-18T11:37:04.565157+0000","last_fullsized":"2023-10-18T11:37:04.565157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:35.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'253","reported_seq":286,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.049497+0000","last_change":"2023-10-18T11:09:36.897906+0000","last_active":"2023-10-18T11:37:54.049497+0000","last_peered":"2023-10-18T11:37:54.049497+0000","last_clean":"2023-10-18T11:37:54.049497+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:37:54.049497+0000","last_undegraded":"2023-10-18T11:37:54.049497+0000","last_fullsized":"2023-10-18T11:37:54.049497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:41:27.304152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'390","reported_seq":458,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.563216+0000","last_change":"2023-10-18T11:09:46.109151+0000","last_active":"2023-10-18T11:37:03.563216+0000","last_peered":"2023-10-18T11:37:03.563216+0000","last_clean":"2023-10-18T11:37:03.563216+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:37:03.563216+0000","last_undegraded":"2023-10-18T11:37:03.563216+0000","last_fullsized":"2023-10-18T11:37:03.563216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:41.785820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":302,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.153530+0000","last_change":"2023-10-18T11:09:39.397483+0000","last_active":"2023-10-18T11:37:05.153530+0000","last_peered":"2023-10-18T11:37:05.153530+0000","last_clean":"2023-10-18T11:37:05.153530+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:37:05.153530+0000","last_undegraded":"2023-10-18T11:37:05.153530+0000","last_fullsized":"2023-10-18T11:37:05.153530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'1792","reported_seq":1825,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.572727+0000","last_change":"2023-10-18T11:09:36.916080+0000","last_active":"2023-10-18T11:37:57.572727+0000","last_peered":"2023-10-18T11:37:57.572727+0000","last_clean":"2023-10-18T11:37:57.572727+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:37:57.572727+0000","last_undegraded":"2023-10-18T11:37:57.572727+0000","last_fullsized":"2023-10-18T11:37:57.572727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:22.058134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":9197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'468","reported_seq":550,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:56.570360+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:36:56.570360+0000","last_peered":"2023-10-18T11:36:56.570360+0000","last_clean":"2023-10-18T11:36:56.570360+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:36:56.570360+0000","last_undegraded":"2023-10-18T11:36:56.570360+0000","last_fullsized":"2023-10-18T11:36:56.570360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:11.809373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":372,"num_write_kb":11119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.777715+0000","last_change":"2023-10-18T11:09:39.358262+0000","last_active":"2023-10-18T11:37:04.777715+0000","last_peered":"2023-10-18T11:37:04.777715+0000","last_clean":"2023-10-18T11:37:04.777715+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:37:04.777715+0000","last_undegraded":"2023-10-18T11:37:04.777715+0000","last_fullsized":"2023-10-18T11:37:04.777715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'909","reported_seq":942,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:40.118546+0000","last_change":"2023-10-18T11:09:36.893045+0000","last_active":"2023-10-18T11:37:40.118546+0000","last_peered":"2023-10-18T11:37:40.118546+0000","last_clean":"2023-10-18T11:37:40.118546+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:37:40.118546+0000","last_undegraded":"2023-10-18T11:37:40.118546+0000","last_fullsized":"2023-10-18T11:37:40.118546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'408","reported_seq":477,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.655594+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:37:00.655594+0000","last_peered":"2023-10-18T11:37:00.655594+0000","last_clean":"2023-10-18T11:37:00.655594+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:37:00.655594+0000","last_undegraded":"2023-10-18T11:37:00.655594+0000","last_fullsized":"2023-10-18T11:37:00.655594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:27.567970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":10922,"num_write":302,"num_write_kb":9791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'114","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.992359+0000","last_change":"2023-10-18T11:09:39.399188+0000","last_active":"2023-10-18T11:37:04.992359+0000","last_peered":"2023-10-18T11:37:04.992359+0000","last_clean":"2023-10-18T11:37:04.992359+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:37:04.992359+0000","last_undegraded":"2023-10-18T11:37:04.992359+0000","last_fullsized":"2023-10-18T11:37:04.992359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'1001","reported_seq":1034,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.671167+0000","last_change":"2023-10-18T11:09:36.905576+0000","last_active":"2023-10-18T11:37:54.671167+0000","last_peered":"2023-10-18T11:37:54.671167+0000","last_clean":"2023-10-18T11:37:54.671167+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:37:54.671167+0000","last_undegraded":"2023-10-18T11:37:54.671167+0000","last_fullsized":"2023-10-18T11:37:54.671167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1001,"log_dups_size":0,"ondisk_log_size":1001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:41.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":4702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'374","reported_seq":447,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.509846+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:37:03.509846+0000","last_peered":"2023-10-18T11:37:03.509846+0000","last_clean":"2023-10-18T11:37:03.509846+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:37:03.509846+0000","last_undegraded":"2023-10-18T11:37:03.509846+0000","last_fullsized":"2023-10-18T11:37:03.509846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:00:47.871773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":12454,"num_write":279,"num_write_kb":12302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'115","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.517027+0000","last_change":"2023-10-18T11:09:39.361805+0000","last_active":"2023-10-18T11:37:03.517027+0000","last_peered":"2023-10-18T11:37:03.517027+0000","last_clean":"2023-10-18T11:37:03.517027+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:37:03.517027+0000","last_undegraded":"2023-10-18T11:37:03.517027+0000","last_fullsized":"2023-10-18T11:37:03.517027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'404","reported_seq":828,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.660982+0000","last_change":"2023-10-18T11:09:36.894141+0000","last_active":"2023-10-18T11:37:54.660982+0000","last_peered":"2023-10-18T11:37:54.660982+0000","last_clean":"2023-10-18T11:37:54.660982+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:37:54.660982+0000","last_undegraded":"2023-10-18T11:37:54.660982+0000","last_fullsized":"2023-10-18T11:37:54.660982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":443,"num_write":404,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'508","reported_seq":637,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.390056+0000","last_change":"2023-10-18T11:09:46.114944+0000","last_active":"2023-10-18T11:37:04.390056+0000","last_peered":"2023-10-18T11:37:04.390056+0000","last_clean":"2023-10-18T11:37:04.390056+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:37:04.390056+0000","last_undegraded":"2023-10-18T11:37:04.390056+0000","last_fullsized":"2023-10-18T11:37:04.390056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":22458,"num_write":413,"num_write_kb":26305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'101","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.994506+0000","last_change":"2023-10-18T11:09:39.420430+0000","last_active":"2023-10-18T11:36:55.994506+0000","last_peered":"2023-10-18T11:36:55.994506+0000","last_clean":"2023-10-18T11:36:55.994506+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:36:55.994506+0000","last_undegraded":"2023-10-18T11:36:55.994506+0000","last_fullsized":"2023-10-18T11:36:55.994506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:12.994704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1124","reported_seq":1157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.963360+0000","last_change":"2023-10-18T11:09:36.904648+0000","last_active":"2023-10-18T11:37:53.963360+0000","last_peered":"2023-10-18T11:37:53.963360+0000","last_clean":"2023-10-18T11:37:53.963360+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:37:53.963360+0000","last_undegraded":"2023-10-18T11:37:53.963360+0000","last_fullsized":"2023-10-18T11:37:53.963360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'423","reported_seq":501,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.097162+0000","last_change":"2023-10-18T11:09:46.101866+0000","last_active":"2023-10-18T11:37:05.097162+0000","last_peered":"2023-10-18T11:37:05.097162+0000","last_clean":"2023-10-18T11:37:05.097162+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:37:05.097162+0000","last_undegraded":"2023-10-18T11:37:05.097162+0000","last_fullsized":"2023-10-18T11:37:05.097162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:41.150485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":12954,"num_write":319,"num_write_kb":22076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.402120+0000","last_change":"2023-10-18T11:09:39.398597+0000","last_active":"2023-10-18T11:37:00.402120+0000","last_peered":"2023-10-18T11:37:00.402120+0000","last_clean":"2023-10-18T11:37:00.402120+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:37:00.402120+0000","last_undegraded":"2023-10-18T11:37:00.402120+0000","last_fullsized":"2023-10-18T11:37:00.402120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:10.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'280","reported_seq":312,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.665451+0000","last_change":"2023-10-18T11:09:36.913285+0000","last_active":"2023-10-18T11:37:54.665451+0000","last_peered":"2023-10-18T11:37:54.665451+0000","last_clean":"2023-10-18T11:37:54.665451+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:37:54.665451+0000","last_undegraded":"2023-10-18T11:37:54.665451+0000","last_fullsized":"2023-10-18T11:37:54.665451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'511","reported_seq":600,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.825243+0000","last_change":"2023-10-18T11:09:46.094205+0000","last_active":"2023-10-18T11:37:08.825243+0000","last_peered":"2023-10-18T11:37:08.825243+0000","last_clean":"2023-10-18T11:37:08.825243+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:37:08.825243+0000","last_undegraded":"2023-10-18T11:37:08.825243+0000","last_fullsized":"2023-10-18T11:37:08.825243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:13.509608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":22028,"num_write":389,"num_write_kb":39504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'110","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.388245+0000","last_change":"2023-10-18T11:09:39.363739+0000","last_active":"2023-10-18T11:37:00.388245+0000","last_peered":"2023-10-18T11:37:00.388245+0000","last_clean":"2023-10-18T11:37:00.388245+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:37:00.388245+0000","last_undegraded":"2023-10-18T11:37:00.388245+0000","last_fullsized":"2023-10-18T11:37:00.388245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:52.069782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'400","reported_seq":822,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:31.927344+0000","last_change":"2023-10-18T11:09:36.896767+0000","last_active":"2023-10-18T11:37:31.927344+0000","last_peered":"2023-10-18T11:37:31.927344+0000","last_clean":"2023-10-18T11:37:31.927344+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:37:31.927344+0000","last_undegraded":"2023-10-18T11:37:31.927344+0000","last_fullsized":"2023-10-18T11:37:31.927344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180134,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":390,"num_read_kb":469,"num_write":396,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'442","reported_seq":537,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.774393+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:37:04.774393+0000","last_peered":"2023-10-18T11:37:04.774393+0000","last_clean":"2023-10-18T11:37:04.774393+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:37:04.774393+0000","last_undegraded":"2023-10-18T11:37:04.774393+0000","last_fullsized":"2023-10-18T11:37:04.774393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:58.299429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17404,"num_write":347,"num_write_kb":27808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'113","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:52.328137+0000","last_change":"2023-10-18T11:09:39.351468+0000","last_active":"2023-10-18T11:36:52.328137+0000","last_peered":"2023-10-18T11:36:52.328137+0000","last_clean":"2023-10-18T11:36:52.328137+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:36:52.328137+0000","last_undegraded":"2023-10-18T11:36:52.328137+0000","last_fullsized":"2023-10-18T11:36:52.328137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'186","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.886900+0000","last_change":"2023-10-18T11:09:36.896596+0000","last_active":"2023-10-18T11:37:42.886900+0000","last_peered":"2023-10-18T11:37:42.886900+0000","last_clean":"2023-10-18T11:37:42.886900+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:37:42.886900+0000","last_undegraded":"2023-10-18T11:37:42.886900+0000","last_fullsized":"2023-10-18T11:37:42.886900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'380","reported_seq":473,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.146546+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:37:05.146546+0000","last_peered":"2023-10-18T11:37:05.146546+0000","last_clean":"2023-10-18T11:37:05.146546+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:37:05.146546+0000","last_undegraded":"2023-10-18T11:37:05.146546+0000","last_fullsized":"2023-10-18T11:37:05.146546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:35:40.483539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":277,"num_write_kb":11173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'503","reported_seq":585,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.159115+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:37:07.159115+0000","last_peered":"2023-10-18T11:37:07.159115+0000","last_clean":"2023-10-18T11:37:07.159115+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:37:07.159115+0000","last_undegraded":"2023-10-18T11:37:07.159115+0000","last_fullsized":"2023-10-18T11:37:07.159115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:09.785576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":392,"num_write_kb":15493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'123","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.528664+0000","last_change":"2023-10-18T11:09:39.418416+0000","last_active":"2023-10-18T11:37:00.528664+0000","last_peered":"2023-10-18T11:37:00.528664+0000","last_clean":"2023-10-18T11:37:00.528664+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:37:00.528664+0000","last_undegraded":"2023-10-18T11:37:00.528664+0000","last_fullsized":"2023-10-18T11:37:00.528664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'1033","reported_seq":1065,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.964257+0000","last_change":"2023-10-18T11:09:36.893158+0000","last_active":"2023-10-18T11:37:53.964257+0000","last_peered":"2023-10-18T11:37:53.964257+0000","last_clean":"2023-10-18T11:37:53.964257+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:37:53.964257+0000","last_undegraded":"2023-10-18T11:37:53.964257+0000","last_fullsized":"2023-10-18T11:37:53.964257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:37:58.285162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119259,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":6520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'495","reported_seq":600,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.153166+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:37:05.153166+0000","last_peered":"2023-10-18T11:37:05.153166+0000","last_clean":"2023-10-18T11:37:05.153166+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:37:05.153166+0000","last_undegraded":"2023-10-18T11:37:05.153166+0000","last_fullsized":"2023-10-18T11:37:05.153166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":22638,"num_write":397,"num_write_kb":22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'126","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.264492+0000","last_change":"2023-10-18T11:09:39.421160+0000","last_active":"2023-10-18T11:37:08.264492+0000","last_peered":"2023-10-18T11:37:08.264492+0000","last_clean":"2023-10-18T11:37:08.264492+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:37:08.264492+0000","last_undegraded":"2023-10-18T11:37:08.264492+0000","last_fullsized":"2023-10-18T11:37:08.264492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'472","reported_seq":968,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.886860+0000","last_change":"2023-10-18T11:09:36.911629+0000","last_active":"2023-10-18T11:37:42.886860+0000","last_peered":"2023-10-18T11:37:42.886860+0000","last_clean":"2023-10-18T11:37:42.886860+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:37:42.886860+0000","last_undegraded":"2023-10-18T11:37:42.886860+0000","last_fullsized":"2023-10-18T11:37:42.886860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:53.929992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":464,"num_read_kb":507,"num_write":469,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'1258","reported_seq":1759,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.546699+0000","last_change":"2023-10-18T11:09:36.894351+0000","last_active":"2023-10-18T11:37:57.546699+0000","last_peered":"2023-10-18T11:37:57.546699+0000","last_clean":"2023-10-18T11:37:57.546699+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:37:57.546699+0000","last_undegraded":"2023-10-18T11:37:57.546699+0000","last_fullsized":"2023-10-18T11:37:57.546699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:11.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4346422,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":505,"num_write":1257,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'110","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.809537+0000","last_change":"2023-10-18T11:09:39.404508+0000","last_active":"2023-10-18T11:37:07.809537+0000","last_peered":"2023-10-18T11:37:07.809537+0000","last_clean":"2023-10-18T11:37:07.809537+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:37:07.809537+0000","last_undegraded":"2023-10-18T11:37:07.809537+0000","last_fullsized":"2023-10-18T11:37:07.809537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'380","reported_seq":476,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.259191+0000","last_change":"2023-10-18T11:09:46.117246+0000","last_active":"2023-10-18T11:36:58.259191+0000","last_peered":"2023-10-18T11:36:58.259191+0000","last_clean":"2023-10-18T11:36:58.259191+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:36:58.259191+0000","last_undegraded":"2023-10-18T11:36:58.259191+0000","last_fullsized":"2023-10-18T11:36:58.259191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:59.808082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":9856,"num_write":276,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2733","reported_seq":2765,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.975579+0000","last_change":"2023-10-18T11:09:36.912013+0000","last_active":"2023-10-18T11:37:42.975579+0000","last_peered":"2023-10-18T11:37:42.975579+0000","last_clean":"2023-10-18T11:37:42.975579+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:37:42.975579+0000","last_undegraded":"2023-10-18T11:37:42.975579+0000","last_fullsized":"2023-10-18T11:37:42.975579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2733,"log_dups_size":0,"ondisk_log_size":2733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:47:49.950001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2726,"num_write_kb":13571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'125","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.585465+0000","last_change":"2023-10-18T11:09:39.400362+0000","last_active":"2023-10-18T11:37:03.585465+0000","last_peered":"2023-10-18T11:37:03.585465+0000","last_clean":"2023-10-18T11:37:03.585465+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:37:03.585465+0000","last_undegraded":"2023-10-18T11:37:03.585465+0000","last_fullsized":"2023-10-18T11:37:03.585465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:50.136754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'415","reported_seq":490,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.751948+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:37:07.751948+0000","last_peered":"2023-10-18T11:37:07.751948+0000","last_clean":"2023-10-18T11:37:07.751948+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:37:07.751948+0000","last_undegraded":"2023-10-18T11:37:07.751948+0000","last_fullsized":"2023-10-18T11:37:07.751948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:52:09.414015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":317,"num_write_kb":9906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'130","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.106481+0000","last_change":"2023-10-18T11:09:39.359747+0000","last_active":"2023-10-18T11:37:07.106481+0000","last_peered":"2023-10-18T11:37:07.106481+0000","last_clean":"2023-10-18T11:37:07.106481+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:37:07.106481+0000","last_undegraded":"2023-10-18T11:37:07.106481+0000","last_fullsized":"2023-10-18T11:37:07.106481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'106","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.635598+0000","last_change":"2023-10-18T11:09:39.242600+0000","last_active":"2023-10-18T11:36:59.635598+0000","last_peered":"2023-10-18T11:36:59.635598+0000","last_clean":"2023-10-18T11:36:59.635598+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:36:59.635598+0000","last_undegraded":"2023-10-18T11:36:59.635598+0000","last_fullsized":"2023-10-18T11:36:59.635598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:45.076093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'122","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.788629+0000","last_change":"2023-10-18T11:10:10.416758+0000","last_active":"2023-10-18T11:36:58.788629+0000","last_peered":"2023-10-18T11:36:58.788629+0000","last_clean":"2023-10-18T11:36:58.788629+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:36:58.788629+0000","last_undegraded":"2023-10-18T11:36:58.788629+0000","last_fullsized":"2023-10-18T11:36:58.788629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"31'107","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:47.039197+0000","last_change":"2023-10-18T11:09:39.425505+0000","last_active":"2023-10-18T11:36:47.039197+0000","last_peered":"2023-10-18T11:36:47.039197+0000","last_clean":"2023-10-18T11:36:47.039197+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:36:47.039197+0000","last_undegraded":"2023-10-18T11:36:47.039197+0000","last_fullsized":"2023-10-18T11:36:47.039197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'106","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.754258+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:36:58.754258+0000","last_peered":"2023-10-18T11:36:58.754258+0000","last_clean":"2023-10-18T11:36:58.754258+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:36:58.754258+0000","last_undegraded":"2023-10-18T11:36:58.754258+0000","last_fullsized":"2023-10-18T11:36:58.754258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'110","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.107357+0000","last_change":"2023-10-18T11:09:39.423043+0000","last_active":"2023-10-18T11:37:00.107357+0000","last_peered":"2023-10-18T11:37:00.107357+0000","last_clean":"2023-10-18T11:37:00.107357+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:37:00.107357+0000","last_undegraded":"2023-10-18T11:37:00.107357+0000","last_fullsized":"2023-10-18T11:37:00.107357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'105","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.104886+0000","last_change":"2023-10-18T11:09:39.351604+0000","last_active":"2023-10-18T11:37:07.104886+0000","last_peered":"2023-10-18T11:37:07.104886+0000","last_clean":"2023-10-18T11:37:07.104886+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:37:07.104886+0000","last_undegraded":"2023-10-18T11:37:07.104886+0000","last_fullsized":"2023-10-18T11:37:07.104886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'96","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.283402+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:37:07.283402+0000","last_peered":"2023-10-18T11:37:07.283402+0000","last_clean":"2023-10-18T11:37:07.283402+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:37:07.283402+0000","last_undegraded":"2023-10-18T11:37:07.283402+0000","last_fullsized":"2023-10-18T11:37:07.283402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'102","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.750784+0000","last_change":"2023-10-18T11:09:39.419909+0000","last_active":"2023-10-18T11:37:07.750784+0000","last_peered":"2023-10-18T11:37:07.750784+0000","last_clean":"2023-10-18T11:37:07.750784+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:37:07.750784+0000","last_undegraded":"2023-10-18T11:37:07.750784+0000","last_fullsized":"2023-10-18T11:37:07.750784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'103","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.539412+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:37:03.539412+0000","last_peered":"2023-10-18T11:37:03.539412+0000","last_clean":"2023-10-18T11:37:03.539412+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:37:03.539412+0000","last_undegraded":"2023-10-18T11:37:03.539412+0000","last_fullsized":"2023-10-18T11:37:03.539412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'103","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.783007+0000","last_change":"2023-10-18T11:09:39.349250+0000","last_active":"2023-10-18T11:36:58.783007+0000","last_peered":"2023-10-18T11:36:58.783007+0000","last_clean":"2023-10-18T11:36:58.783007+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:36:58.783007+0000","last_undegraded":"2023-10-18T11:36:58.783007+0000","last_fullsized":"2023-10-18T11:36:58.783007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:06.431033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'112","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.568180+0000","last_change":"2023-10-18T11:09:39.361414+0000","last_active":"2023-10-18T11:37:03.568180+0000","last_peered":"2023-10-18T11:37:03.568180+0000","last_clean":"2023-10-18T11:37:03.568180+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:37:03.568180+0000","last_undegraded":"2023-10-18T11:37:03.568180+0000","last_fullsized":"2023-10-18T11:37:03.568180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'122","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.149975+0000","last_change":"2023-10-18T11:09:39.399067+0000","last_active":"2023-10-18T11:37:05.149975+0000","last_peered":"2023-10-18T11:37:05.149975+0000","last_clean":"2023-10-18T11:37:05.149975+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:37:05.149975+0000","last_undegraded":"2023-10-18T11:37:05.149975+0000","last_fullsized":"2023-10-18T11:37:05.149975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'110","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.435315+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:37:00.435315+0000","last_peered":"2023-10-18T11:37:00.435315+0000","last_clean":"2023-10-18T11:37:00.435315+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:37:00.435315+0000","last_undegraded":"2023-10-18T11:37:00.435315+0000","last_fullsized":"2023-10-18T11:37:00.435315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:04.730798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'119","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.571978+0000","last_change":"2023-10-18T11:09:39.320727+0000","last_active":"2023-10-18T11:37:03.571978+0000","last_peered":"2023-10-18T11:37:03.571978+0000","last_clean":"2023-10-18T11:37:03.571978+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:37:03.571978+0000","last_undegraded":"2023-10-18T11:37:03.571978+0000","last_fullsized":"2023-10-18T11:37:03.571978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:04:56.049773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'113","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:47.332981+0000","last_change":"2023-10-18T11:10:10.401580+0000","last_active":"2023-10-18T11:36:47.332981+0000","last_peered":"2023-10-18T11:36:47.332981+0000","last_clean":"2023-10-18T11:36:47.332981+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:36:47.332981+0000","last_undegraded":"2023-10-18T11:36:47.332981+0000","last_fullsized":"2023-10-18T11:36:47.332981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'106","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.524718+0000","last_change":"2023-10-18T11:09:39.354336+0000","last_active":"2023-10-18T11:37:04.524718+0000","last_peered":"2023-10-18T11:37:04.524718+0000","last_clean":"2023-10-18T11:37:04.524718+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:37:04.524718+0000","last_undegraded":"2023-10-18T11:37:04.524718+0000","last_fullsized":"2023-10-18T11:37:04.524718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'105","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.245394+0000","last_change":"2023-10-18T11:09:39.401976+0000","last_active":"2023-10-18T11:37:04.245394+0000","last_peered":"2023-10-18T11:37:04.245394+0000","last_clean":"2023-10-18T11:37:04.245394+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:37:04.245394+0000","last_undegraded":"2023-10-18T11:37:04.245394+0000","last_fullsized":"2023-10-18T11:37:04.245394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'100","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.150755+0000","last_change":"2023-10-18T11:09:39.366222+0000","last_active":"2023-10-18T11:37:05.150755+0000","last_peered":"2023-10-18T11:37:05.150755+0000","last_clean":"2023-10-18T11:37:05.150755+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:37:05.150755+0000","last_undegraded":"2023-10-18T11:37:05.150755+0000","last_fullsized":"2023-10-18T11:37:05.150755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:52.729507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'131","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.667410+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:37:03.667410+0000","last_peered":"2023-10-18T11:37:03.667410+0000","last_clean":"2023-10-18T11:37:03.667410+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:37:03.667410+0000","last_undegraded":"2023-10-18T11:37:03.667410+0000","last_fullsized":"2023-10-18T11:37:03.667410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:37:38.036634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'100","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.882110+0000","last_change":"2023-10-18T11:09:39.400563+0000","last_active":"2023-10-18T11:36:55.882110+0000","last_peered":"2023-10-18T11:36:55.882110+0000","last_clean":"2023-10-18T11:36:55.882110+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:36:55.882110+0000","last_undegraded":"2023-10-18T11:36:55.882110+0000","last_fullsized":"2023-10-18T11:36:55.882110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:46:24.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'119","reported_seq":148,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.428378+0000","last_change":"2023-10-18T11:09:39.320580+0000","last_active":"2023-10-18T11:37:04.428378+0000","last_peered":"2023-10-18T11:37:04.428378+0000","last_clean":"2023-10-18T11:37:04.428378+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:37:04.428378+0000","last_undegraded":"2023-10-18T11:37:04.428378+0000","last_fullsized":"2023-10-18T11:37:04.428378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'106","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:55.989231+0000","last_change":"2023-10-18T11:09:39.320508+0000","last_active":"2023-10-18T11:36:55.989231+0000","last_peered":"2023-10-18T11:36:55.989231+0000","last_clean":"2023-10-18T11:36:55.989231+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:36:55.989231+0000","last_undegraded":"2023-10-18T11:36:55.989231+0000","last_fullsized":"2023-10-18T11:36:55.989231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'112","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:44.149989+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:36:44.149989+0000","last_peered":"2023-10-18T11:36:44.149989+0000","last_clean":"2023-10-18T11:36:44.149989+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:36:44.149989+0000","last_undegraded":"2023-10-18T11:36:44.149989+0000","last_fullsized":"2023-10-18T11:36:44.149989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:11.432343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'103","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.239560+0000","last_change":"2023-10-18T11:09:39.421921+0000","last_active":"2023-10-18T11:36:58.239560+0000","last_peered":"2023-10-18T11:36:58.239560+0000","last_clean":"2023-10-18T11:36:58.239560+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:36:58.239560+0000","last_undegraded":"2023-10-18T11:36:58.239560+0000","last_fullsized":"2023-10-18T11:36:58.239560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:14.056451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'94","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.154928+0000","last_change":"2023-10-18T11:09:39.360846+0000","last_active":"2023-10-18T11:37:00.154928+0000","last_peered":"2023-10-18T11:37:00.154928+0000","last_clean":"2023-10-18T11:37:00.154928+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:37:00.154928+0000","last_undegraded":"2023-10-18T11:37:00.154928+0000","last_fullsized":"2023-10-18T11:37:00.154928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'109","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.846187+0000","last_change":"2023-10-18T11:10:10.413563+0000","last_active":"2023-10-18T11:36:59.846187+0000","last_peered":"2023-10-18T11:36:59.846187+0000","last_clean":"2023-10-18T11:36:59.846187+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:36:59.846187+0000","last_undegraded":"2023-10-18T11:36:59.846187+0000","last_fullsized":"2023-10-18T11:36:59.846187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:17:43.078216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'96","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:59.708016+0000","last_change":"2023-10-18T11:09:39.355047+0000","last_active":"2023-10-18T11:36:59.708016+0000","last_peered":"2023-10-18T11:36:59.708016+0000","last_clean":"2023-10-18T11:36:59.708016+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:36:59.708016+0000","last_undegraded":"2023-10-18T11:36:59.708016+0000","last_fullsized":"2023-10-18T11:36:59.708016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'99","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:56.193047+0000","last_change":"2023-10-18T11:09:39.418362+0000","last_active":"2023-10-18T11:36:56.193047+0000","last_peered":"2023-10-18T11:36:56.193047+0000","last_clean":"2023-10-18T11:36:56.193047+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:36:56.193047+0000","last_undegraded":"2023-10-18T11:36:56.193047+0000","last_fullsized":"2023-10-18T11:36:56.193047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:28:50.201545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'95","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.659659+0000","last_change":"2023-10-18T11:09:39.363750+0000","last_active":"2023-10-18T11:37:00.659659+0000","last_peered":"2023-10-18T11:37:00.659659+0000","last_clean":"2023-10-18T11:37:00.659659+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:37:00.659659+0000","last_undegraded":"2023-10-18T11:37:00.659659+0000","last_fullsized":"2023-10-18T11:37:00.659659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:03:43.536873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'127","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.459754+0000","last_change":"2023-10-18T11:09:39.363259+0000","last_active":"2023-10-18T11:37:04.459754+0000","last_peered":"2023-10-18T11:37:04.459754+0000","last_clean":"2023-10-18T11:37:04.459754+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:37:04.459754+0000","last_undegraded":"2023-10-18T11:37:04.459754+0000","last_fullsized":"2023-10-18T11:37:04.459754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:19.568841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'98","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:00.385034+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:37:00.385034+0000","last_peered":"2023-10-18T11:37:00.385034+0000","last_clean":"2023-10-18T11:37:00.385034+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:37:00.385034+0000","last_undegraded":"2023-10-18T11:37:00.385034+0000","last_fullsized":"2023-10-18T11:37:00.385034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:34.071910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2017,"num_read_kb":484709,"num_write":10619,"num_write_kb":576779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13929,"ondisk_log_size":13929,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6924,"ondisk_log_size":6924,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":100003437,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":2171,"num_read_kb":2416,"num_write":26199,"num_write_kb":112193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159002624,"data_stored":200006214,"data_compressed":12429396,"data_compressed_allocated":19357696,"data_compressed_original":60612608,"omap_allocated":0,"internal_metadata":0},"log_size":24249,"ondisk_log_size":24249,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509791,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113704,"kb_used_data":24224,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94258136,"statfs":{"total":96636764160,"available":96520331264,"internally_reserved":0,"allocated":24805376,"data_stored":31793700,"data_compressed":2010206,"data_compressed_allocated":3112960,"data_compressed_original":10338304,"omap_allocated":1588,"internal_metadata":91617740},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.45100000000000001,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.85799999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.69699999999999995},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":19.158000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.91900000000000004,"15min":0.72999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":19.673999999999999,"15min":19.673999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.88100000000000001,"15min":0.74299999999999999},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.36099999999999999},"max":{"1min":1.01,"5min":15.692,"15min":15.692},"last":0.67300000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.224,"5min":1.27,"15min":1.9239999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71499999999999997,"15min":0.68700000000000006},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95999999999999996,"5min":5.444,"15min":5.444},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.93000000000000005,"15min":0.82099999999999995},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0660000000000001,"5min":12.368,"15min":12.368},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.67400000000000004,"15min":0.71799999999999997},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":1.353,"5min":1.3899999999999999,"15min":13.1},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.439,"5min":1.895,"15min":1.895},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47099999999999997,"5min":1.321,"15min":1.321},"last":0.375}]},{"osd":5,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53600000000000003,"5min":0.85099999999999998,"15min":1.081},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.438,"15min":0.40899999999999997},"min":{"1min":0.30099999999999999,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.505,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.42199999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.439,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":0.55100000000000005,"5min":3.4409999999999998,"15min":3.4409999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54100000000000004,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.40999999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509789,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93740,"kb_used_data":18148,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278100,"statfs":{"total":96636764160,"available":96540774400,"internally_reserved":0,"allocated":18583552,"data_stored":23213633,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.64400000000000002},"min":{"1min":0.435,"5min":0.33600000000000002,"15min":0.31},"max":{"1min":0.82399999999999995,"5min":1.0740000000000001,"15min":9.3190000000000008},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59699999999999998,"15min":0.66700000000000004},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.28899999999999998},"max":{"1min":1.046,"5min":1.1699999999999999,"15min":15.282999999999999},"last":0.61199999999999999}]},{"osd":1,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61199999999999999,"15min":0.65100000000000002},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.0880000000000001,"5min":1.202,"15min":6.6429999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97999999999999998,"5min":1.153,"15min":1.748},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.35799999999999998,"15min":0.33300000000000002},"max":{"1min":1.05,"5min":1.355,"15min":1.839},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34499999999999997},"max":{"1min":1.153,"5min":1.468,"15min":1.954},"last":0.83099999999999996}]},{"osd":3,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":1.2410000000000001,"15min":13.840999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.77400000000000002},"min":{"1min":0.45700000000000002,"5min":0.36199999999999999,"15min":0.35099999999999998},"max":{"1min":1.0109999999999999,"5min":1.1950000000000001,"15min":23.155999999999999},"last":0.93899999999999995}]},{"osd":4,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25600000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52300000000000002,"5min":0.54100000000000004,"15min":0.88},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.46800000000000003,"5min":0.53500000000000003,"15min":1.0469999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.23300000000000001},"max":{"1min":0.501,"5min":0.54300000000000004,"15min":0.56799999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56100000000000005,"5min":0.624,"15min":0.624},"last":0.39100000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.40100000000000002},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.77600000000000002},"last":0.374},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41599999999999998,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57299999999999995,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.40200000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509790,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87864,"kb_used_data":20592,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94283976,"statfs":{"total":96636764160,"available":96546791424,"internally_reserved":0,"allocated":21086208,"data_stored":26657141,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.62,"15min":0.629},"min":{"1min":0.46000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1990000000000001,"5min":1.663,"15min":1.663},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.38600000000000001,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.32500000000000001},"max":{"1min":1.2290000000000001,"5min":1.3720000000000001,"15min":1.8620000000000001},"last":0.629},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.34100000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.399,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.629,"15min":0.63},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.248},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90100000000000002,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.92800000000000005}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.38300000000000001,"15min":0.373},"max":{"1min":1.1299999999999999,"5min":1.4930000000000001,"15min":1.5049999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":1.244,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.223},"max":{"1min":0.50800000000000001,"5min":0.51500000000000001,"15min":0.72699999999999998},"last":0.504},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.248,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.622},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.39900000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.67400000000000004},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.41799999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.68999999999999995},"last":0.55700000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509789,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144544,"kb_used_data":27288,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94227296,"statfs":{"total":96636764160,"available":96488751104,"internally_reserved":0,"allocated":27942912,"data_stored":33976532,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":1591,"internal_metadata":120060361},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3260000000000001,"15min":1.129},"min":{"1min":0.70999999999999996,"5min":0.40899999999999997,"15min":0.314},"max":{"1min":2.673,"5min":24.654,"15min":24.654},"last":0.878},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.3380000000000001,"15min":1.159},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":2.1589999999999998,"5min":18.518000000000001,"15min":18.518000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3759999999999999,"15min":1.25},"min":{"1min":0.64500000000000002,"5min":0.441,"15min":0.35399999999999998},"max":{"1min":2.7869999999999999,"5min":16.361999999999998,"15min":16.361999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.5189999999999999,"15min":1.3620000000000001},"min":{"1min":0.72299999999999998,"5min":0.56200000000000006,"15min":0.43099999999999999},"max":{"1min":1.7769999999999999,"5min":24.611000000000001,"15min":24.611000000000001},"last":1.1899999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5029999999999999,"15min":1.395},"min":{"1min":0.49099999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.7269999999999999,"5min":16.576000000000001,"15min":16.576000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.6419999999999999,"15min":1.484},"min":{"1min":0.83199999999999996,"5min":0.46500000000000002,"15min":0.45100000000000001},"max":{"1min":2.04,"5min":24.553000000000001,"15min":24.553000000000001},"last":1.0529999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.4339999999999999,"15min":1.224},"min":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.432},"max":{"1min":2.3170000000000002,"5min":18.721,"15min":18.721},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3560000000000001,"15min":1.26},"min":{"1min":0.66800000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2189999999999999,"5min":16.481000000000002,"15min":16.481000000000002},"last":0.98799999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.5589999999999999,"15min":1.377},"min":{"1min":0.73299999999999998,"5min":0.59799999999999998,"15min":0.44700000000000001},"max":{"1min":2.2519999999999998,"5min":24.786999999999999,"15min":24.786999999999999},"last":1.149},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.6080000000000001,"15min":1.355},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.49199999999999999},"max":{"1min":2.464,"5min":18.681999999999999,"15min":18.681999999999999},"last":0.93200000000000005}]},{"osd":6,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4870000000000001,"15min":1.3959999999999999},"min":{"1min":0.67800000000000005,"5min":0.56100000000000005,"15min":0.52900000000000003},"max":{"1min":2.0129999999999999,"5min":16.513999999999999,"15min":16.513999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.665,"15min":1.496},"min":{"1min":0.79300000000000004,"5min":0.65600000000000003,"15min":0.54300000000000004},"max":{"1min":2.3580000000000001,"5min":24.834,"15min":24.834},"last":1.3480000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.681,"15min":1.4670000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.298,"5min":18.800000000000001,"15min":18.800000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.607,"5min":1.6200000000000001,"15min":1.5169999999999999},"min":{"1min":0.84399999999999997,"5min":0.496,"15min":0.496},"max":{"1min":2.5510000000000002,"5min":16.544,"15min":16.544},"last":1.389}]}]},{"osd":2,"up_from":15,"seq":64424509789,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94552,"kb_used_data":13456,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94277288,"statfs":{"total":96636764160,"available":96539942912,"internally_reserved":0,"allocated":13778944,"data_stored":17047576,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.66600000000000004,"5min":0.378,"15min":0.308},"max":{"1min":2.1139999999999999,"5min":2.5830000000000002,"15min":2.9249999999999998},"last":1.528},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.1200000000000001,"15min":1.1259999999999999},"min":{"1min":0.436,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.964},"last":1.419}]},{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2410000000000001,"15min":1.214},"min":{"1min":0.628,"5min":0.45300000000000001,"15min":0.40200000000000002},"max":{"1min":2.4060000000000001,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.369,"15min":1.3},"min":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.014}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.448,"15min":1.379},"min":{"1min":0.61499999999999999,"5min":0.44,"15min":0.44},"max":{"1min":4.1459999999999999,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.5049999999999999,"15min":1.3999999999999999},"min":{"1min":0.90200000000000002,"5min":0.55400000000000005,"15min":0.53900000000000003},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.2050000000000001,"15min":1.1419999999999999},"min":{"1min":0.55600000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.3759999999999999,"5min":3.3759999999999999,"15min":3.3759999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2729999999999999,"15min":1.2170000000000001},"min":{"1min":0.63200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.4830000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.3759999999999999,"15min":1.2609999999999999},"min":{"1min":0.752,"5min":0.58399999999999996,"15min":0.46200000000000002},"max":{"1min":5.0529999999999999,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":1.345},{"interface":"front","average":{"1min":1.532,"5min":1.3640000000000001,"15min":1.27},"min":{"1min":0.65900000000000003,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.175}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.407,"15min":1.333},"min":{"1min":0.80000000000000004,"5min":0.60199999999999998,"15min":0.49399999999999999},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.4850000000000001,"15min":1.371},"min":{"1min":1.01,"5min":0.68100000000000005,"15min":0.50700000000000001},"max":{"1min":5.133,"5min":5.133,"15min":5.133},"last":1.446}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.4690000000000001,"15min":1.3879999999999999},"min":{"1min":0.72899999999999998,"5min":0.52500000000000002,"15min":0.48599999999999999},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.544,"15min":1.456},"min":{"1min":0.84899999999999998,"5min":0.629,"15min":0.55900000000000005},"max":{"1min":4.0430000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":1.2829999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509790,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153264,"kb_used_data":23592,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94218576,"statfs":{"total":96636764160,"available":96479821824,"internally_reserved":0,"allocated":24158208,"data_stored":30584192,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0920000000000001,"15min":1.101},"min":{"1min":0.63400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.716,"5min":2.5649999999999999,"15min":10.836},"last":1.393},{"interface":"front","average":{"1min":1.232,"5min":1.143,"15min":1.131},"min":{"1min":0.71899999999999997,"5min":0.46999999999999997,"15min":0.42599999999999999},"max":{"1min":2.536,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":1.357}]},{"osd":2,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2110000000000001,"15min":1.1950000000000001},"min":{"1min":0.53700000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.3900000000000001,"5min":4.0670000000000002,"15min":4.4199999999999999},"last":1.321},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3149999999999999,"15min":1.3180000000000001},"min":{"1min":0.60099999999999998,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":1.776,"5min":2.8799999999999999,"15min":10.782},"last":1.2629999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.4239999999999999},"min":{"1min":0.68000000000000005,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":2.028,"5min":4.8380000000000001,"15min":6.8150000000000004},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.3169999999999999,"15min":1.333},"min":{"1min":0.93899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":3.1200000000000001,"5min":3.79,"15min":3.79},"last":1.4550000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.163,"15min":1.1739999999999999},"min":{"1min":0.496,"5min":0.376,"15min":0.376},"max":{"1min":1.647,"5min":3.9670000000000001,"15min":4.3890000000000002},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.248,"15min":1.2829999999999999},"min":{"1min":0.72799999999999998,"5min":0.63300000000000001,"15min":0.60899999999999999},"max":{"1min":1.821,"5min":2.6349999999999998,"15min":6.9950000000000001},"last":1.1519999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2609999999999999,"15min":1.2390000000000001},"min":{"1min":0.624,"5min":0.58599999999999997,"15min":0.495},"max":{"1min":3.5430000000000001,"5min":3.5840000000000001,"15min":3.5840000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2929999999999999,"15min":1.3069999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52900000000000003},"max":{"1min":1.8660000000000001,"5min":3.9169999999999998,"15min":4.3419999999999996},"last":1.218}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.397,"15min":1.4099999999999999},"min":{"1min":0.77600000000000002,"5min":0.67700000000000005,"15min":0.66000000000000003},"max":{"1min":2.0249999999999999,"5min":2.7400000000000002,"15min":6.944},"last":1.639},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.375,"15min":1.3620000000000001},"min":{"1min":0.66700000000000004,"5min":0.628,"15min":0.55300000000000005},"max":{"1min":3.3849999999999998,"5min":3.657,"15min":3.657},"last":1.5660000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.4630000000000001,"15min":1.4470000000000001},"min":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":3.27,"5min":3.722,"15min":3.722},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.444,"15min":1.45},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.0350000000000001,"5min":4.0149999999999997,"15min":4.2919999999999998},"last":1.704}]}]},{"osd":0,"up_from":15,"seq":64424509790,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106768,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94265072,"statfs":{"total":96636764160,"available":96527433728,"internally_reserved":0,"allocated":17768448,"data_stored":22730274,"data_compressed":1487303,"data_compressed_allocated":2297856,"data_compressed_original":7491584,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.97999999999999998,"15min":1.03},"min":{"1min":0.53400000000000003,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":1.365,"5min":2.0299999999999998,"15min":5.7380000000000004},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.048,"15min":1.1819999999999999},"min":{"1min":0.65700000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":20.128},"last":1.085}]},{"osd":2,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.141,"15min":1.2130000000000001},"min":{"1min":0.67600000000000005,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":2.1040000000000001,"5min":2.8039999999999998,"15min":3.2839999999999998},"last":1.012},{"interface":"front","average":{"1min":1.169,"5min":1.1890000000000001,"15min":1.278},"min":{"1min":0.76000000000000001,"5min":0.38900000000000001,"15min":0.31900000000000001},"max":{"1min":2.0640000000000001,"5min":2.4580000000000002,"15min":3.3690000000000002},"last":1.631}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.2529999999999999,"15min":1.2769999999999999},"min":{"1min":0.48299999999999998,"5min":0.47699999999999998,"15min":0.44600000000000001},"max":{"1min":2.3570000000000002,"5min":4.0510000000000002,"15min":8.9879999999999995},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.363,"15min":1.4199999999999999},"min":{"1min":0.73799999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.2080000000000002,"5min":2.7639999999999998,"15min":5.6219999999999999},"last":1.4319999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.232,"15min":1.202},"min":{"1min":1.006,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":1.954,"5min":2.044,"15min":2.976},"last":1.752},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.147,"15min":1.159},"min":{"1min":0.754,"5min":0.53800000000000003,"15min":0.51800000000000002},"max":{"1min":2.028,"5min":2.1779999999999999,"15min":3.6219999999999999},"last":1.2829999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.75600000000000001,"5min":0.52300000000000002,"15min":0.49099999999999999},"max":{"1min":1.9990000000000001,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.3089999999999999,"15min":1.288},"min":{"1min":0.79100000000000004,"5min":0.59299999999999997,"15min":0.56200000000000006},"max":{"1min":2.125,"5min":2.2349999999999999,"15min":2.8140000000000001},"last":1.5649999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.3759999999999999,"15min":1.359},"min":{"1min":0.83499999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2410000000000001,"5min":2.274,"15min":2.7669999999999999},"last":1.72},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.3620000000000001,"15min":1.3500000000000001},"min":{"1min":0.80800000000000005,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":2.0579999999999998,"5min":2.1040000000000001,"15min":3.7669999999999999},"last":1.8200000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.4450000000000001,"15min":1.4319999999999999},"min":{"1min":1.042,"5min":0.56599999999999995,"15min":0.49199999999999999},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":3.915},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.363,"15min":1.375},"min":{"1min":0.85799999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.1779999999999999,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1.3839999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542493,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98596,"kb_used_data":13340,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273244,"statfs":{"total":96636764160,"available":96535801856,"internally_reserved":0,"allocated":13660160,"data_stored":16262042,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.27300000000000002},"max":{"1min":1.1459999999999999,"5min":3.387,"15min":3.387},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.40999999999999998,"5min":0.33300000000000002,"15min":0.31},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.90900000000000003}]},{"osd":1,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.25},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.377},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.53000000000000003,"5min":0.38200000000000001,"15min":0.312},"max":{"1min":1.081,"5min":1.554,"15min":1.669},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.34999999999999998},"max":{"1min":1.1850000000000001,"5min":1.2070000000000001,"15min":1.712},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94299999999999995,"5min":1.1000000000000001,"15min":1.1950000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3200000000000001,"5min":1.427,"15min":2.694},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":1.0680000000000001,"5min":1.7929999999999999,"15min":2.1459999999999999},"last":0.83099999999999996}]},{"osd":4,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.503,"5min":0.55600000000000005,"15min":0.63700000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26500000000000001},"max":{"1min":0.45900000000000002,"5min":0.57599999999999996,"15min":0.68600000000000005},"last":0.308}]},{"osd":5,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.252},"max":{"1min":0.47699999999999998,"5min":0.65700000000000003,"15min":0.85199999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39200000000000002,"15min":0.39700000000000002},"min":{"1min":0.316,"5min":0.28899999999999998,"15min":0.26300000000000001},"max":{"1min":0.49199999999999999,"5min":0.65800000000000003,"15min":0.67000000000000004},"last":0.25}]},{"osd":7,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.54200000000000004,"5min":0.63600000000000001,"15min":0.77600000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52300000000000002,"5min":0.68300000000000005,"15min":0.80000000000000004},"last":0.26700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17371136,"data_stored":22005056,"data_compressed":1454768,"data_compressed_allocated":2252800,"data_compressed_original":6918144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23826432,"data_stored":30449342,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13447168,"data_stored":16912726,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27611136,"data_stored":33841682,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20754432,"data_stored":26522291,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":23078783,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13328384,"data_stored":16127192,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24412160,"data_stored":31069142,"data_compressed":1977671,"data_compressed_allocated":3067904,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:38:05.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:38:06.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.180+0000 7f7e9726f640 1 Processor -- start 2023-10-18T11:38:06.183 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.180+0000 7f7e9726f640 1 -- start start 2023-10-18T11:38:06.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.182+0000 7f7e9726f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e9006f6d0 0x7f7e90161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:06.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.182+0000 7f7e9726f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9006e970 con 0x7f7e9014ff40 2023-10-18T11:38:06.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.182+0000 7f7e9726f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e90155e00 con 0x7f7e900c5f20 2023-10-18T11:38:06.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.182+0000 7f7e9726f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9006f280 con 0x7f7e9006f6d0 2023-10-18T11:38:06.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.182+0000 7f7e9480a640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f7e900c5f20 0x7f7e90156290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:43992/0 (socket says 172.21.15.151:43992) 2023-10-18T11:38:06.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.182+0000 7f7e9480a640 1 -- 172.21.15.151:0/2659088471 learned_addr learned my addr 172.21.15.151:0/2659088471 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:06.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.183+0000 7f7e9580c640 1 --2- 172.21.15.151:0/2659088471 >> v2:172.21.15.151:3300/0 conn(0x7f7e9006f6d0 0x7f7e90161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:06.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.185+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783136377 0 0) 0x7f7e90155e00 con 0x7f7e900c5f20 2023-10-18T11:38:06.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.185+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e7c005730 con 0x7f7e900c5f20 2023-10-18T11:38:06.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2654989320 0 0) 0x7f7e7c005730 con 0x7f7e900c5f20 2023-10-18T11:38:06.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 >> v2:172.21.15.151:3300/0 conn(0x7f7e9006f6d0 msgr2=0x7f7e90161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:06.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 --2- 172.21.15.151:0/2659088471 >> v2:172.21.15.151:3300/0 conn(0x7f7e9006f6d0 0x7f7e90161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 >> v1:172.21.15.151:6789/0 conn(0x7f7e9014ff40 legacy=0x7f7e900c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:06.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e900c2a40 con 0x7f7e900c5f20 2023-10-18T11:38:06.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f7e80001670 con 0x7f7e900c5f20 2023-10-18T11:38:06.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 >> v1:172.21.15.169:6789/0 conn(0x7f7e900c5f20 legacy=0x7f7e90156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:06.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c005bd0 0x7f7e7c005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:06.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0069d0 0x7f7e7c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:06.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c007390 0x7f7e7c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:06.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9006f280 con 0x7f7e7c005bd0 2023-10-18T11:38:06.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c00e270 con 0x7f7e7c007390 2023-10-18T11:38:06.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.188+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c00e430 con 0x7f7e7c0069d0 2023-10-18T11:38:06.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.189+0000 7f7e9480a640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0069d0 0x7f7e7c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:06.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.190+0000 7f7e9580c640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c007390 0x7f7e7c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:06.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.192+0000 7f7e9480a640 1 -- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c007390 msgr2=0x7f7e7c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:06.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.192+0000 7f7e9480a640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c007390 0x7f7e7c00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.192+0000 7f7e9480a640 1 -- 172.21.15.151:0/2659088471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c005bd0 msgr2=0x7f7e7c005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:06.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.192+0000 7f7e9480a640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c005bd0 0x7f7e7c005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.192+0000 7f7e9480a640 1 -- 172.21.15.151:0/2659088471 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c005730 con 0x7f7e7c0069d0 2023-10-18T11:38:06.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.192+0000 7f7e9580c640 1 -- 172.21.15.151:0/2659088471 reap_dead start 2023-10-18T11:38:06.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.194+0000 7f7e9480a640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0069d0 0x7f7e7c006e50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e80007fb0 tx=0x7f7e7c007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4cabd02415654fc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:06.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.198+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80005ad0 con 0x7f7e7c0069d0 2023-10-18T11:38:06.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.198+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80005c30 con 0x7f7e7c0069d0 2023-10-18T11:38:06.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.198+0000 7f7e87fff640 1 -- 172.21.15.151:0/2659088471 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80007070 con 0x7f7e7c0069d0 2023-10-18T11:38:06.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.199+0000 7f7e9726f640 1 -- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0069d0 msgr2=0x7f7e7c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:06.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.199+0000 7f7e9726f640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0069d0 0x7f7e7c006e50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e80007fb0 tx=0x7f7e7c007a00 comp rx=0 tx=0).stop 2023-10-18T11:38:06.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.199+0000 7f7e9726f640 1 -- 172.21.15.151:0/2659088471 shutdown_connections 2023-10-18T11:38:06.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.199+0000 7f7e9726f640 1 --2- 172.21.15.151:0/2659088471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0069d0 0x7f7e7c006e50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.199+0000 7f7e9726f640 1 -- 172.21.15.151:0/2659088471 >> 172.21.15.151:0/2659088471 conn(0x7f7e9006aea0 msgr2=0x7f7e9006b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:06.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.199+0000 7f7e9726f640 1 -- 172.21.15.151:0/2659088471 shutdown_connections 2023-10-18T11:38:06.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.199+0000 7f7e9726f640 1 -- 172.21.15.151:0/2659088471 wait complete. 2023-10-18T11:38:06.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.203+0000 7f7e9726f640 1 Processor -- start 2023-10-18T11:38:06.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.203+0000 7f7e9726f640 1 -- start start 2023-10-18T11:38:06.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.204+0000 7f7e9726f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c0069d0 0x7f7e90152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:06.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.204+0000 7f7e9726f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e90155a20 0x7f7e90152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:06.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.204+0000 7f7e9726f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e90154be0 0x7f7e90155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:06.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.204+0000 7f7e9726f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90142c00 con 0x7f7e90155a20 2023-10-18T11:38:06.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.204+0000 7f7e9726f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901516a0 con 0x7f7e7c0069d0 2023-10-18T11:38:06.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.204+0000 7f7e9726f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901420a0 con 0x7f7e90154be0 2023-10-18T11:38:06.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.205+0000 7f7e9580c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e90154be0 0x7f7e90155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.205+0000 7f7e9500b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c0069d0 0x7f7e90152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.205+0000 7f7e9500b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c0069d0 0x7f7e90152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:48162/0 (socket says 172.21.15.151:48162) 2023-10-18T11:38:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.205+0000 7f7e9580c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e90154be0 0x7f7e90155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:45268/0 (socket says 172.21.15.151:45268) 2023-10-18T11:38:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.205+0000 7f7e9480a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e90155a20 0x7f7e90152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.205+0000 7f7e9500b640 1 -- 172.21.15.151:0/1686565180 learned_addr learned my addr 172.21.15.151:0/1686565180 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.208+0000 7f7e9580c640 1 -- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c0069d0 msgr2=0x7f7e90152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.208+0000 7f7e9580c640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c0069d0 0x7f7e90152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.208+0000 7f7e9580c640 1 -- 172.21.15.151:0/1686565180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e90155a20 msgr2=0x7f7e90152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.208+0000 7f7e9580c640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e90155a20 0x7f7e90152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.208+0000 7f7e9580c640 1 -- 172.21.15.151:0/1686565180 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90150d90 con 0x7f7e90154be0 2023-10-18T11:38:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.211+0000 7f7e9580c640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e90154be0 0x7f7e90155090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e900cc640 tx=0x7f7e8800f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.215+0000 7f7e85ffb640 1 -- 172.21.15.151:0/1686565180 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8800e040 con 0x7f7e90154be0 2023-10-18T11:38:06.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.215+0000 7f7e85ffb640 1 -- 172.21.15.151:0/1686565180 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8800f040 con 0x7f7e90154be0 2023-10-18T11:38:06.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.215+0000 7f7e85ffb640 1 -- 172.21.15.151:0/1686565180 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88015430 con 0x7f7e90154be0 2023-10-18T11:38:06.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.215+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e901555d0 con 0x7f7e90154be0 2023-10-18T11:38:06.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.215+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e901513e0 con 0x7f7e90154be0 2023-10-18T11:38:06.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.216+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e900c3370 con 0x7f7e90154be0 2023-10-18T11:38:06.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.234+0000 7f7e85ffb640 1 -- 172.21.15.151:0/1686565180 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e88015590 con 0x7f7e90154be0 2023-10-18T11:38:06.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.235+0000 7f7e85ffb640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7e7406ae80 0x7f7e7406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.236+0000 7f7e9500b640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7e7406ae80 0x7f7e7406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.237+0000 7f7e9500b640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7e7406ae80 0x7f7e7406d340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c001850 tx=0x7f7e8c009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.237+0000 7f7e85ffb640 1 -- 172.21.15.151:0/1686565180 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e880593e0 con 0x7f7e90154be0 2023-10-18T11:38:06.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.469+0000 7f7e85ffb640 1 -- 172.21.15.151:0/1686565180 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e88055720 con 0x7f7e90154be0 2023-10-18T11:38:06.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.663+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e9006f4b0 con 0x7f7e90154be0 2023-10-18T11:38:06.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.701+0000 7f7e85ffb640 1 -- 172.21.15.151:0/1686565180 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f7e88058d40 con 0x7f7e90154be0 2023-10-18T11:38:06.704 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:38:06.704 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:38:06.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.703+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7e7406ae80 msgr2=0x7f7e7406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:06.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.703+0000 7f7e9726f640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7e7406ae80 0x7f7e7406d340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c001850 tx=0x7f7e8c009040 comp rx=0 tx=0).stop 2023-10-18T11:38:06.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.703+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e90154be0 msgr2=0x7f7e90155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:06.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.703+0000 7f7e9726f640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e90154be0 0x7f7e90155090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e900cc640 tx=0x7f7e8800f580 comp rx=0 tx=0).stop 2023-10-18T11:38:06.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.704+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 shutdown_connections 2023-10-18T11:38:06.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.704+0000 7f7e9726f640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e90154be0 0x7f7e90155090 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.704+0000 7f7e9726f640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e90155a20 0x7f7e90152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.704+0000 7f7e9726f640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7e7406ae80 0x7f7e7406d340 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.704+0000 7f7e9726f640 1 --2- 172.21.15.151:0/1686565180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c0069d0 0x7f7e90152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.704+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 >> 172.21.15.151:0/1686565180 conn(0x7f7e9006aea0 msgr2=0x7f7e900c82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.704+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 shutdown_connections 2023-10-18T11:38:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:06.704+0000 7f7e9726f640 1 -- 172.21.15.151:0/1686565180 wait complete. 2023-10-18T11:38:07.731 INFO:tasks.ceph:Scrubbing osd.0 2023-10-18T11:38:07.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-18T11:38:07.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.963+0000 7f1ffb6bb640 1 Processor -- start 2023-10-18T11:38:07.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.963+0000 7f1ffb6bb640 1 -- start start 2023-10-18T11:38:07.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.965+0000 7f1ffb6bb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1ff41510a0 0x7f1ff40c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:07.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.965+0000 7f1ffb6bb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1ff40c4e60 0x7f1ff40c5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:07.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.965+0000 7f1ffb6bb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff406d430 con 0x7f1ff4157770 2023-10-18T11:38:07.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.965+0000 7f1ffb6bb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff40c57b0 con 0x7f1ff41510a0 2023-10-18T11:38:07.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.965+0000 7f1ffb6bb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff4151480 con 0x7f1ff40c4e60 2023-10-18T11:38:07.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.966+0000 7f1ff9457640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1ff41510a0 0x7f1ff40c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:07.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.966+0000 7f1ff9c58640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1ff40c4e60 0x7f1ff40c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:07.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.966+0000 7f1ff9457640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1ff41510a0 0x7f1ff40c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40690/0 (socket says 172.21.15.151:40690) 2023-10-18T11:38:07.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.966+0000 7f1ff9457640 1 -- 172.21.15.151:0/560238872 learned_addr learned my addr 172.21.15.151:0/560238872 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:07.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.969+0000 7f1ff9457640 1 -- 172.21.15.151:0/560238872 >> v2:172.21.15.169:3300/0 conn(0x7f1ff40c4e60 msgr2=0x7f1ff40c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:07.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.969+0000 7f1ff9457640 1 --2- 172.21.15.151:0/560238872 >> v2:172.21.15.169:3300/0 conn(0x7f1ff40c4e60 0x7f1ff40c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:07.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.969+0000 7f1ff9457640 1 -- 172.21.15.151:0/560238872 >> v1:172.21.15.169:6789/0 conn(0x7f1ff4157770 legacy=0x7f1ff406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:07.972 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.969+0000 7f1ff9457640 1 -- 172.21.15.151:0/560238872 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff40c27d0 con 0x7f1ff41510a0 2023-10-18T11:38:07.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.986+0000 7f1ff9457640 1 --2- 172.21.15.151:0/560238872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ff41510a0 0x7f1ff40c2180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40c4ac0 tx=0x7f1ff002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ae49ee7638bc08 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.998+0000 7f1febfff640 1 -- 172.21.15.151:0/560238872 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff002f850 con 0x7f1ff41510a0 2023-10-18T11:38:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.998+0000 7f1febfff640 1 -- 172.21.15.151:0/560238872 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff002f9b0 con 0x7f1ff41510a0 2023-10-18T11:38:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.998+0000 7f1febfff640 1 -- 172.21.15.151:0/560238872 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff002fd40 con 0x7f1ff41510a0 2023-10-18T11:38:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.999+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/560238872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ff41510a0 msgr2=0x7f1ff40c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.999+0000 7f1ffb6bb640 1 --2- 172.21.15.151:0/560238872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ff41510a0 0x7f1ff40c2180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40c4ac0 tx=0x7f1ff002ba30 comp rx=0 tx=0).stop 2023-10-18T11:38:08.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.999+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/560238872 shutdown_connections 2023-10-18T11:38:08.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.999+0000 7f1ffb6bb640 1 --2- 172.21.15.151:0/560238872 >> v2:172.21.15.169:3300/0 conn(0x7f1ff40c4e60 0x7f1ff40c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.999+0000 7f1ffb6bb640 1 --2- 172.21.15.151:0/560238872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ff41510a0 0x7f1ff40c2180 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.999+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/560238872 >> 172.21.15.151:0/560238872 conn(0x7f1ff4069f70 msgr2=0x7f1ff406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.999+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/560238872 shutdown_connections 2023-10-18T11:38:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:07.999+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/560238872 wait complete. 2023-10-18T11:38:08.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.003+0000 7f1ffb6bb640 1 Processor -- start 2023-10-18T11:38:08.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.003+0000 7f1ffb6bb640 1 -- start start 2023-10-18T11:38:08.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.005+0000 7f1ffb6bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff40c4e60 0x7f1ff4159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.005+0000 7f1ffb6bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff41510a0 0x7f1ff4155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.005+0000 7f1ffb6bb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ff4157770 0x7f1ff41538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.005+0000 7f1ffb6bb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4152d40 con 0x7f1ff4157770 2023-10-18T11:38:08.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.005+0000 7f1ffb6bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4154570 con 0x7f1ff41510a0 2023-10-18T11:38:08.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.005+0000 7f1ffb6bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff41f2db0 con 0x7f1ff40c4e60 2023-10-18T11:38:08.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.006+0000 7f1ff9c58640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ff4157770 0x7f1ff41538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.006+0000 7f1ff9457640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff40c4e60 0x7f1ff4159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.006+0000 7f1ff8c56640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff41510a0 0x7f1ff4155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.006+0000 7f1ff9457640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff40c4e60 0x7f1ff4159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41734/0 (socket says 172.21.15.151:41734) 2023-10-18T11:38:08.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.006+0000 7f1ff9457640 1 -- 172.21.15.151:0/3496396860 learned_addr learned my addr 172.21.15.151:0/3496396860 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:08.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.010+0000 7f1ff8c56640 1 -- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff40c4e60 msgr2=0x7f1ff4159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.010+0000 7f1ff8c56640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff40c4e60 0x7f1ff4159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.010+0000 7f1ff8c56640 1 -- 172.21.15.151:0/3496396860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ff4157770 msgr2=0x7f1ff41538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.010+0000 7f1ff8c56640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ff4157770 0x7f1ff41538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.010+0000 7f1ff8c56640 1 -- 172.21.15.151:0/3496396860 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00094d0 con 0x7f1ff41510a0 2023-10-18T11:38:08.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.012+0000 7f1ff8c56640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff41510a0 0x7f1ff4155b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400c340 tx=0x7f1fe400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:08.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.014+0000 7f1fe9ffb640 1 -- 172.21.15.151:0/3496396860 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40052d0 con 0x7f1ff41510a0 2023-10-18T11:38:08.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.015+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff4154290 con 0x7f1ff41510a0 2023-10-18T11:38:08.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.015+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff41f22d0 con 0x7f1ff41510a0 2023-10-18T11:38:08.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.016+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ff40c2d70 con 0x7f1ff41510a0 2023-10-18T11:38:08.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.036+0000 7f1fe9ffb640 1 -- 172.21.15.151:0/3496396860 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe4005430 con 0x7f1ff41510a0 2023-10-18T11:38:08.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.036+0000 7f1fe9ffb640 1 -- 172.21.15.151:0/3496396860 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4007220 con 0x7f1ff41510a0 2023-10-18T11:38:08.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.038+0000 7f1fe9ffb640 1 -- 172.21.15.151:0/3496396860 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1fe4007440 con 0x7f1ff41510a0 2023-10-18T11:38:08.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.039+0000 7f1fe9ffb640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1fd806ae70 0x7f1fd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.040+0000 7f1ff9457640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1fd806ae70 0x7f1fd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.040+0000 7f1fe9ffb640 1 -- 172.21.15.151:0/3496396860 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1fe4057f10 con 0x7f1ff41510a0 2023-10-18T11:38:08.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.040+0000 7f1fe9ffb640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1fd80746d0 0x7f1fd8076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.040+0000 7f1fe9ffb640 1 -- 172.21.15.151:0/3496396860 --> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fd8077240 con 0x7f1fd80746d0 2023-10-18T11:38:08.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.040+0000 7f1fe9ffb640 1 -- 172.21.15.151:0/3496396860 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fe4054250 con 0x7f1ff41510a0 2023-10-18T11:38:08.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.041+0000 7f1ff9457640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1fd806ae70 0x7f1fd806d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ff002ba70 tx=0x7f1ff0008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:08.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.041+0000 7f1ff9c58640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1fd80746d0 0x7f1fd8076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.042+0000 7f1ff9c58640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1fd80746d0 0x7f1fd8076b70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:08.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.043+0000 7f1fe9ffb640 1 -- 172.21.15.151:0/3496396860 <== osd.0 v2:172.21.15.151:6824/4132618362 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1fd8077240 con 0x7f1fd80746d0 2023-10-18T11:38:08.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.060+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 --> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1ff40c2a90 con 0x7f1fd80746d0 2023-10-18T11:38:08.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.061+0000 7f1fe9ffb640 1 -- 172.21.15.151:0/3496396860 <== osd.0 v2:172.21.15.151:6824/4132618362 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1fec00f040 con 0x7f1fd80746d0 2023-10-18T11:38:08.064 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:38:08.064 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T11:38:08.064 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:38:08.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.061+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1fd80746d0 msgr2=0x7f1fd8076b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.061+0000 7f1ffb6bb640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.151:6824/4132618362,v1:172.21.15.151:6825/4132618362] conn(0x7f1fd80746d0 0x7f1fd8076b70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.061+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1fd806ae70 msgr2=0x7f1fd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.062+0000 7f1ffb6bb640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f1fd806ae70 0x7f1fd806d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ff002ba70 tx=0x7f1ff0008030 comp rx=0 tx=0).stop 2023-10-18T11:38:08.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.062+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff41510a0 msgr2=0x7f1ff4155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.062+0000 7f1ffb6bb640 1 --2- 172.21.15.151:0/3496396860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff41510a0 0x7f1ff4155b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400c340 tx=0x7f1fe400c800 comp rx=0 tx=0).stop 2023-10-18T11:38:08.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.062+0000 7f1ff9c58640 1 -- 172.21.15.151:0/3496396860 reap_dead start 2023-10-18T11:38:08.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.062+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 shutdown_connections 2023-10-18T11:38:08.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.062+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 >> 172.21.15.151:0/3496396860 conn(0x7f1ff4069f70 msgr2=0x7f1ff406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:08.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.062+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 shutdown_connections 2023-10-18T11:38:08.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.062+0000 7f1ffb6bb640 1 -- 172.21.15.151:0/3496396860 wait complete. 2023-10-18T11:38:08.083 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-18T11:38:08.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.301+0000 7f697ee39640 1 Processor -- start 2023-10-18T11:38:08.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.301+0000 7f697ee39640 1 -- start start 2023-10-18T11:38:08.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.302+0000 7f697ee39640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69781510a0 0x7f69780c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.302+0000 7f697ee39640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f69780c4e60 0x7f69780c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.302+0000 7f697ee39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697806d430 con 0x7f6978157770 2023-10-18T11:38:08.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.302+0000 7f697ee39640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6978151480 con 0x7f69780c4e60 2023-10-18T11:38:08.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.302+0000 7f697ee39640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780c27d0 con 0x7f69781510a0 2023-10-18T11:38:08.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.303+0000 7f697cbd5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69781510a0 0x7f69780c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.303+0000 7f697cbd5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69781510a0 0x7f69780c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41744/0 (socket says 172.21.15.151:41744) 2023-10-18T11:38:08.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.303+0000 7f697cbd5640 1 -- 172.21.15.151:0/3599247068 learned_addr learned my addr 172.21.15.151:0/3599247068 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:08.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.305+0000 7f697cbd5640 1 -- 172.21.15.151:0/3599247068 >> v2:172.21.15.151:3300/0 conn(0x7f69780c4e60 msgr2=0x7f69780c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:08.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.305+0000 7f697cbd5640 1 --2- 172.21.15.151:0/3599247068 >> v2:172.21.15.151:3300/0 conn(0x7f69780c4e60 0x7f69780c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.305+0000 7f697cbd5640 1 -- 172.21.15.151:0/3599247068 >> v1:172.21.15.151:6789/0 conn(0x7f6978157770 legacy=0x7f697806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:08.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.305+0000 7f697cbd5640 1 -- 172.21.15.151:0/3599247068 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780c2a90 con 0x7f69781510a0 2023-10-18T11:38:08.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.310+0000 7f697cbd5640 1 --2- 172.21.15.151:0/3599247068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69781510a0 0x7f69780c2180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f696c009870 tx=0x7f696c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52745eb8e21d67a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:08.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.375+0000 7f69777fe640 1 -- 172.21.15.151:0/3599247068 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c030840 con 0x7f69781510a0 2023-10-18T11:38:08.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.375+0000 7f69777fe640 1 -- 172.21.15.151:0/3599247068 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c0309a0 con 0x7f69781510a0 2023-10-18T11:38:08.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.375+0000 7f69777fe640 1 -- 172.21.15.151:0/3599247068 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c030d30 con 0x7f69781510a0 2023-10-18T11:38:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.376+0000 7f697ee39640 1 -- 172.21.15.151:0/3599247068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69781510a0 msgr2=0x7f69780c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.376+0000 7f697ee39640 1 --2- 172.21.15.151:0/3599247068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69781510a0 0x7f69780c2180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f696c009870 tx=0x7f696c02b980 comp rx=0 tx=0).stop 2023-10-18T11:38:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.376+0000 7f697ee39640 1 -- 172.21.15.151:0/3599247068 shutdown_connections 2023-10-18T11:38:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.376+0000 7f697ee39640 1 --2- 172.21.15.151:0/3599247068 >> v2:172.21.15.151:3300/0 conn(0x7f69780c4e60 0x7f69780c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.376+0000 7f697ee39640 1 --2- 172.21.15.151:0/3599247068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69781510a0 0x7f69780c2180 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.376+0000 7f697ee39640 1 -- 172.21.15.151:0/3599247068 >> 172.21.15.151:0/3599247068 conn(0x7f6978069f70 msgr2=0x7f697806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:08.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.376+0000 7f697ee39640 1 -- 172.21.15.151:0/3599247068 shutdown_connections 2023-10-18T11:38:08.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.377+0000 7f697ee39640 1 -- 172.21.15.151:0/3599247068 wait complete. 2023-10-18T11:38:08.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.380+0000 7f697ee39640 1 Processor -- start 2023-10-18T11:38:08.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.381+0000 7f697ee39640 1 -- start start 2023-10-18T11:38:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.383+0000 7f697ee39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780c4e60 0x7f6978070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.383+0000 7f697ee39640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69781510a0 0x7f6978146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.383+0000 7f697ee39640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6978157770 0x7f69781465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.383+0000 7f697ee39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697814f740 con 0x7f69780c4e60 2023-10-18T11:38:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.383+0000 7f697ee39640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69781e12b0 con 0x7f69781510a0 2023-10-18T11:38:08.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.383+0000 7f697ee39640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697814f1c0 con 0x7f6978157770 2023-10-18T11:38:08.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.384+0000 7f697cbd5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780c4e60 0x7f6978070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.384+0000 7f697cbd5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780c4e60 0x7f6978070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40704/0 (socket says 172.21.15.151:40704) 2023-10-18T11:38:08.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.384+0000 7f697cbd5640 1 -- 172.21.15.151:0/304059720 learned_addr learned my addr 172.21.15.151:0/304059720 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:08.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.385+0000 7f6977fff640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69781510a0 0x7f6978146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.386+0000 7f697d3d6640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6978157770 0x7f69781465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.389+0000 7f6977fff640 1 -- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6978157770 msgr2=0x7f69781465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.389+0000 7f6977fff640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6978157770 0x7f69781465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.389+0000 7f6977fff640 1 -- 172.21.15.151:0/304059720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780c4e60 msgr2=0x7f6978070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.389+0000 7f6977fff640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780c4e60 0x7f6978070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.389+0000 7f6977fff640 1 -- 172.21.15.151:0/304059720 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0094d0 con 0x7f69781510a0 2023-10-18T11:38:08.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.391+0000 7f6977fff640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69781510a0 0x7f6978146060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f696400b3e0 tx=0x7f696400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:08.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.395+0000 7f69757fa640 1 -- 172.21.15.151:0/304059720 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964011830 con 0x7f69781510a0 2023-10-18T11:38:08.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.395+0000 7f69757fa640 1 -- 172.21.15.151:0/304059720 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964011990 con 0x7f69781510a0 2023-10-18T11:38:08.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.395+0000 7f69757fa640 1 -- 172.21.15.151:0/304059720 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964011d40 con 0x7f69781510a0 2023-10-18T11:38:08.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.395+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697814f460 con 0x7f69781510a0 2023-10-18T11:38:08.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.395+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6978150760 con 0x7f69781510a0 2023-10-18T11:38:08.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.397+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6978150920 con 0x7f69781510a0 2023-10-18T11:38:08.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.417+0000 7f69757fa640 1 -- 172.21.15.151:0/304059720 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f696401a400 con 0x7f69781510a0 2023-10-18T11:38:08.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.418+0000 7f69757fa640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f695c06aec0 0x7f695c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:08.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.418+0000 7f69757fa640 1 -- 172.21.15.151:0/304059720 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6964055110 con 0x7f69781510a0 2023-10-18T11:38:08.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.419+0000 7f697cbd5640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f695c06aec0 0x7f695c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:08.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.419+0000 7f697cbd5640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f695c06aec0 0x7f695c06d380 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f696c02b9c0 tx=0x7f696c008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:08.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.660+0000 7f69757fa640 1 -- 172.21.15.151:0/304059720 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6964054d40 con 0x7f69781510a0 2023-10-18T11:38:08.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.869+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f69780c3050 con 0x7f695c06aec0 2023-10-18T11:38:08.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.870+0000 7f69757fa640 1 -- 172.21.15.151:0/304059720 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f696c030c90 con 0x7f695c06aec0 2023-10-18T11:38:08.872 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 0 to deep-scrub 2023-10-18T11:38:08.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.872+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f695c06aec0 msgr2=0x7f695c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.872+0000 7f697ee39640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f695c06aec0 0x7f695c06d380 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f696c02b9c0 tx=0x7f696c008030 comp rx=0 tx=0).stop 2023-10-18T11:38:08.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69781510a0 msgr2=0x7f6978146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:08.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69781510a0 0x7f6978146060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f696400b3e0 tx=0x7f696400b8a0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 shutdown_connections 2023-10-18T11:38:08.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6978157770 0x7f69781465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f695c06aec0 0x7f695c06d380 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69781510a0 0x7f6978146060 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 --2- 172.21.15.151:0/304059720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780c4e60 0x7f6978070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:08.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 >> 172.21.15.151:0/304059720 conn(0x7f6978069f70 msgr2=0x7f69781e5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:08.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 shutdown_connections 2023-10-18T11:38:08.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:08.873+0000 7f697ee39640 1 -- 172.21.15.151:0/304059720 wait complete. 2023-10-18T11:38:08.896 INFO:tasks.ceph:Scrubbing osd.1 2023-10-18T11:38:08.896 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-18T11:38:09.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.115+0000 7f3dbe125640 1 Processor -- start 2023-10-18T11:38:09.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.115+0000 7f3dbe125640 1 -- start start 2023-10-18T11:38:09.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.117+0000 7f3dbe125640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 0x7f3db806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.117+0000 7f3dbe125640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db806d0c0 con 0x7f3db8157720 2023-10-18T11:38:09.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.117+0000 7f3dbe125640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db80c7810 con 0x7f3db80c51b0 2023-10-18T11:38:09.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.117+0000 7f3dbe125640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db806d6f0 con 0x7f3db80701b0 2023-10-18T11:38:09.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.118+0000 7f3db6ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 0x7f3db806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.118+0000 7f3db77fe640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f3db8157720 0x7f3db815d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:43534/0 (socket says 172.21.15.151:43534) 2023-10-18T11:38:09.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.118+0000 7f3db77fe640 1 -- 172.21.15.151:0/144872899 learned_addr learned my addr 172.21.15.151:0/144872899 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:09.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.118+0000 7f3db7fff640 1 --1- 172.21.15.151:0/144872899 >> v1:172.21.15.169:6789/0 conn(0x7f3db80c51b0 0x7f3db80c6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47240/0 (socket says 172.21.15.151:47240) 2023-10-18T11:38:09.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.121+0000 7f3db67fc640 1 -- 172.21.15.151:0/144872899 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646452513 0 0) 0x7f3db806d0c0 con 0x7f3db8157720 2023-10-18T11:38:09.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.121+0000 7f3db67fc640 1 -- 172.21.15.151:0/144872899 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da0003520 con 0x7f3db8157720 2023-10-18T11:38:09.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.121+0000 7f3db6ffd640 1 -- 172.21.15.151:0/144872899 >> v1:172.21.15.169:6789/0 conn(0x7f3db80c51b0 legacy=0x7f3db80c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.121+0000 7f3db6ffd640 1 -- 172.21.15.151:0/144872899 >> v1:172.21.15.151:6789/0 conn(0x7f3db8157720 legacy=0x7f3db815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.121+0000 7f3db6ffd640 1 -- 172.21.15.151:0/144872899 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db815dd30 con 0x7f3db80701b0 2023-10-18T11:38:09.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.123+0000 7f3db6ffd640 1 --2- 172.21.15.151:0/144872899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 0x7f3db806db10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0097d0 tx=0x7f3dac02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32f721e1b1c6e742 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:09.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.127+0000 7f3db67fc640 1 -- 172.21.15.151:0/144872899 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac031770 con 0x7f3db80701b0 2023-10-18T11:38:09.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.127+0000 7f3db67fc640 1 -- 172.21.15.151:0/144872899 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac0318d0 con 0x7f3db80701b0 2023-10-18T11:38:09.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.127+0000 7f3db67fc640 1 -- 172.21.15.151:0/144872899 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac031c60 con 0x7f3db80701b0 2023-10-18T11:38:09.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.128+0000 7f3dbe125640 1 -- 172.21.15.151:0/144872899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 msgr2=0x7f3db806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.128+0000 7f3dbe125640 1 --2- 172.21.15.151:0/144872899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 0x7f3db806db10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0097d0 tx=0x7f3dac02b810 comp rx=0 tx=0).stop 2023-10-18T11:38:09.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.128+0000 7f3dbe125640 1 -- 172.21.15.151:0/144872899 shutdown_connections 2023-10-18T11:38:09.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.128+0000 7f3dbe125640 1 --2- 172.21.15.151:0/144872899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 0x7f3db806db10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.128+0000 7f3dbe125640 1 -- 172.21.15.151:0/144872899 >> 172.21.15.151:0/144872899 conn(0x7f3db8069f70 msgr2=0x7f3db806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:09.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.128+0000 7f3dbe125640 1 -- 172.21.15.151:0/144872899 shutdown_connections 2023-10-18T11:38:09.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.129+0000 7f3dbe125640 1 -- 172.21.15.151:0/144872899 wait complete. 2023-10-18T11:38:09.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.131+0000 7f3dbe125640 1 Processor -- start 2023-10-18T11:38:09.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.131+0000 7f3dbe125640 1 -- start start 2023-10-18T11:38:09.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.133+0000 7f3dbe125640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 0x7f3db81f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.133+0000 7f3dbe125640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c51b0 0x7f3db81601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.133+0000 7f3dbe125640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3db8157720 0x7f3db8149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.133+0000 7f3dbe125640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db814f7c0 con 0x7f3db80c51b0 2023-10-18T11:38:09.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.133+0000 7f3dbe125640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8160ea0 con 0x7f3db8157720 2023-10-18T11:38:09.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.133+0000 7f3dbe125640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db814eaa0 con 0x7f3db80701b0 2023-10-18T11:38:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.133+0000 7f3db6ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c51b0 0x7f3db81601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.134+0000 7f3db7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3db8157720 0x7f3db8149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.134+0000 7f3db77fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 0x7f3db81f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.134+0000 7f3db6ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c51b0 0x7f3db81601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40710/0 (socket says 172.21.15.151:40710) 2023-10-18T11:38:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.134+0000 7f3db6ffd640 1 -- 172.21.15.151:0/1510441911 learned_addr learned my addr 172.21.15.151:0/1510441911 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.137+0000 7f3db77fe640 1 -- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3db8157720 msgr2=0x7f3db8149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.138+0000 7f3db77fe640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3db8157720 0x7f3db8149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.138+0000 7f3db77fe640 1 -- 172.21.15.151:0/1510441911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c51b0 msgr2=0x7f3db81601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.138+0000 7f3db77fe640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c51b0 0x7f3db81601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.138+0000 7f3db77fe640 1 -- 172.21.15.151:0/1510441911 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac009400 con 0x7f3db80701b0 2023-10-18T11:38:09.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.140+0000 7f3db77fe640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 0x7f3db81f55f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c430 tx=0x7f3da800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:09.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.143+0000 7f3d9ffff640 1 -- 172.21.15.151:0/1510441911 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8005ce0 con 0x7f3db80701b0 2023-10-18T11:38:09.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.143+0000 7f3d9ffff640 1 -- 172.21.15.151:0/1510441911 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da8005e40 con 0x7f3db80701b0 2023-10-18T11:38:09.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.143+0000 7f3d9ffff640 1 -- 172.21.15.151:0/1510441911 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da80072d0 con 0x7f3db80701b0 2023-10-18T11:38:09.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.144+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db81f5b30 con 0x7f3db80701b0 2023-10-18T11:38:09.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.144+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db814e7c0 con 0x7f3db80701b0 2023-10-18T11:38:09.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.145+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3db815e010 con 0x7f3db80701b0 2023-10-18T11:38:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.164+0000 7f3d9ffff640 1 -- 172.21.15.151:0/1510441911 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3da8007430 con 0x7f3db80701b0 2023-10-18T11:38:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.165+0000 7f3d9ffff640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3da406aec0 0x7f3da406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.165+0000 7f3db6ffd640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3da406aec0 0x7f3da406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.166+0000 7f3db6ffd640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3da406aec0 0x7f3da406d380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3dac000c00 tx=0x7f3dac03d040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:09.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.168+0000 7f3d9ffff640 1 -- 172.21.15.151:0/1510441911 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3da80581d0 con 0x7f3db80701b0 2023-10-18T11:38:09.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.168+0000 7f3d9ffff640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f3da4074720 0x7f3da4076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.168+0000 7f3d9ffff640 1 -- 172.21.15.151:0/1510441911 --> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3da4077290 con 0x7f3da4074720 2023-10-18T11:38:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.168+0000 7f3d9ffff640 1 -- 172.21.15.151:0/1510441911 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3da801deb0 con 0x7f3db80701b0 2023-10-18T11:38:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.168+0000 7f3db7fff640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f3da4074720 0x7f3da4076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.169+0000 7f3db7fff640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f3da4074720 0x7f3da4076bc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.170+0000 7f3d9ffff640 1 -- 172.21.15.151:0/1510441911 <== osd.1 v2:172.21.15.151:6800/3389651909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3da4077290 con 0x7f3da4074720 2023-10-18T11:38:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.189+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 --> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3db815e2f0 con 0x7f3da4074720 2023-10-18T11:38:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.189+0000 7f3d9ffff640 1 -- 172.21.15.151:0/1510441911 <== osd.1 v2:172.21.15.151:6800/3389651909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3db0004de0 con 0x7f3da4074720 2023-10-18T11:38:09.192 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:38:09.192 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T11:38:09.192 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:38:09.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f3da4074720 msgr2=0x7f3da4076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.151:6800/3389651909,v1:172.21.15.151:6801/3389651909] conn(0x7f3da4074720 0x7f3da4076bc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3da406aec0 msgr2=0x7f3da406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f3da406aec0 0x7f3da406d380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3dac000c00 tx=0x7f3dac03d040 comp rx=0 tx=0).stop 2023-10-18T11:38:09.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 msgr2=0x7f3db81f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 --2- 172.21.15.151:0/1510441911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3db80701b0 0x7f3db81f55f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c430 tx=0x7f3da800c8f0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3db7fff640 1 -- 172.21.15.151:0/1510441911 reap_dead start 2023-10-18T11:38:09.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 shutdown_connections 2023-10-18T11:38:09.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 >> 172.21.15.151:0/1510441911 conn(0x7f3db8069f70 msgr2=0x7f3db806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:09.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 shutdown_connections 2023-10-18T11:38:09.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.190+0000 7f3dbe125640 1 -- 172.21.15.151:0/1510441911 wait complete. 2023-10-18T11:38:09.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-18T11:38:09.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.434+0000 7fe21210f640 1 Processor -- start 2023-10-18T11:38:09.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.435+0000 7fe21210f640 1 -- start start 2023-10-18T11:38:09.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.436+0000 7fe21210f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe20c0c2180 0x7fe20c06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.436+0000 7fe21210f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe20c06de00 0x7fe20c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.436+0000 7fe21210f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c06d430 con 0x7fe20c1510a0 2023-10-18T11:38:09.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.436+0000 7fe21210f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c0c25d0 con 0x7fe20c0c2180 2023-10-18T11:38:09.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.436+0000 7fe21210f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c151480 con 0x7fe20c06de00 2023-10-18T11:38:09.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.437+0000 7fe20bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe20c06de00 0x7fe20c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.437+0000 7fe20bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe20c06de00 0x7fe20c0c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58886/0 (socket says 172.21.15.151:58886) 2023-10-18T11:38:09.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.437+0000 7fe20bfff640 1 -- 172.21.15.151:0/527074898 learned_addr learned my addr 172.21.15.151:0/527074898 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:09.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.439+0000 7fe20bfff640 1 -- 172.21.15.151:0/527074898 >> v2:172.21.15.151:3300/0 conn(0x7fe20c0c2180 msgr2=0x7fe20c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:09.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.439+0000 7fe20bfff640 1 --2- 172.21.15.151:0/527074898 >> v2:172.21.15.151:3300/0 conn(0x7fe20c0c2180 0x7fe20c06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.439+0000 7fe20bfff640 1 -- 172.21.15.151:0/527074898 >> v1:172.21.15.151:6789/0 conn(0x7fe20c1510a0 legacy=0x7fe20c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:09.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.439+0000 7fe20bfff640 1 -- 172.21.15.151:0/527074898 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0c27d0 con 0x7fe20c06de00 2023-10-18T11:38:09.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.441+0000 7fe20bfff640 1 --2- 172.21.15.151:0/527074898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c06de00 0x7fe20c0c4e60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0c4ac0 tx=0x7fe20402bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2cba97ee69dc04d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:09.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.445+0000 7fe20affd640 1 -- 172.21.15.151:0/527074898 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20402cb10 con 0x7fe20c06de00 2023-10-18T11:38:09.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.445+0000 7fe20affd640 1 -- 172.21.15.151:0/527074898 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20402cc70 con 0x7fe20c06de00 2023-10-18T11:38:09.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.445+0000 7fe20affd640 1 -- 172.21.15.151:0/527074898 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040343f0 con 0x7fe20c06de00 2023-10-18T11:38:09.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.446+0000 7fe21210f640 1 -- 172.21.15.151:0/527074898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c06de00 msgr2=0x7fe20c0c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.446+0000 7fe21210f640 1 --2- 172.21.15.151:0/527074898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c06de00 0x7fe20c0c4e60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0c4ac0 tx=0x7fe20402bf70 comp rx=0 tx=0).stop 2023-10-18T11:38:09.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.446+0000 7fe21210f640 1 -- 172.21.15.151:0/527074898 shutdown_connections 2023-10-18T11:38:09.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.446+0000 7fe21210f640 1 --2- 172.21.15.151:0/527074898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c06de00 0x7fe20c0c4e60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.446+0000 7fe21210f640 1 --2- 172.21.15.151:0/527074898 >> v2:172.21.15.151:3300/0 conn(0x7fe20c0c2180 0x7fe20c06d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.446+0000 7fe21210f640 1 -- 172.21.15.151:0/527074898 >> 172.21.15.151:0/527074898 conn(0x7fe20c069f70 msgr2=0x7fe20c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:09.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.446+0000 7fe21210f640 1 -- 172.21.15.151:0/527074898 shutdown_connections 2023-10-18T11:38:09.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.446+0000 7fe21210f640 1 -- 172.21.15.151:0/527074898 wait complete. 2023-10-18T11:38:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.448+0000 7fe21210f640 1 Processor -- start 2023-10-18T11:38:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.448+0000 7fe21210f640 1 -- start start 2023-10-18T11:38:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.449+0000 7fe21210f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20c06de00 0x7fe20c1465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.450+0000 7fe21210f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe20c0c2180 0x7fe20c1edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.450+0000 7fe21210f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c1510a0 0x7fe20c1ee110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.450+0000 7fe21210f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c148440 con 0x7fe20c06de00 2023-10-18T11:38:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.450+0000 7fe21210f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c148720 con 0x7fe20c1510a0 2023-10-18T11:38:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.450+0000 7fe21210f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c148a00 con 0x7fe20c0c2180 2023-10-18T11:38:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.450+0000 7fe20bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c1510a0 0x7fe20c1ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.450+0000 7fe202ffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe20c0c2180 0x7fe20c1edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.451+0000 7fe20bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c1510a0 0x7fe20c1ee110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58894/0 (socket says 172.21.15.151:58894) 2023-10-18T11:38:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.451+0000 7fe20bfff640 1 -- 172.21.15.151:0/4271535037 learned_addr learned my addr 172.21.15.151:0/4271535037 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:09.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.454+0000 7fe20bfff640 1 -- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe20c0c2180 msgr2=0x7fe20c1edbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.454+0000 7fe20bfff640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe20c0c2180 0x7fe20c1edbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.454+0000 7fe20bfff640 1 -- 172.21.15.151:0/4271535037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20c06de00 msgr2=0x7fe20c1465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.454+0000 7fe20bfff640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20c06de00 0x7fe20c1465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.454+0000 7fe20bfff640 1 -- 172.21.15.151:0/4271535037 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009b30 con 0x7fe20c1510a0 2023-10-18T11:38:09.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.456+0000 7fe20bfff640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c1510a0 0x7fe20c1ee110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe204036040 tx=0x7fe204004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:09.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.460+0000 7fe208ff9640 1 -- 172.21.15.151:0/4271535037 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204009510 con 0x7fe20c1510a0 2023-10-18T11:38:09.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.460+0000 7fe208ff9640 1 -- 172.21.15.151:0/4271535037 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20403e450 con 0x7fe20c1510a0 2023-10-18T11:38:09.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.460+0000 7fe208ff9640 1 -- 172.21.15.151:0/4271535037 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20403e7e0 con 0x7fe20c1510a0 2023-10-18T11:38:09.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.460+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c148ce0 con 0x7fe20c1510a0 2023-10-18T11:38:09.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.460+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c1492a0 con 0x7fe20c1510a0 2023-10-18T11:38:09.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.461+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c1ed8f0 con 0x7fe20c1510a0 2023-10-18T11:38:09.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.716+0000 7fe208ff9640 1 -- 172.21.15.151:0/4271535037 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe20403e940 con 0x7fe20c1510a0 2023-10-18T11:38:09.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.719+0000 7fe208ff9640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe1ec06aec0 0x7fe1ec06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:09.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.719+0000 7fe208ff9640 1 -- 172.21.15.151:0/4271535037 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe2040aca70 con 0x7fe20c1510a0 2023-10-18T11:38:09.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.719+0000 7fe20b7fe640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe1ec06aec0 0x7fe1ec06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:09.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.720+0000 7fe20b7fe640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe1ec06aec0 0x7fe1ec06d380 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009650 tx=0x7fe1fc006ba0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:09.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.728+0000 7fe208ff9640 1 -- 172.21.15.151:0/4271535037 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2040778d0 con 0x7fe20c1510a0 2023-10-18T11:38:09.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.930+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe20c0c2d70 con 0x7fe1ec06aec0 2023-10-18T11:38:09.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.931+0000 7fe208ff9640 1 -- 172.21.15.151:0/4271535037 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe1fc013430 con 0x7fe1ec06aec0 2023-10-18T11:38:09.934 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 1 to deep-scrub 2023-10-18T11:38:09.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.934+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe1ec06aec0 msgr2=0x7fe1ec06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.934+0000 7fe21210f640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe1ec06aec0 0x7fe1ec06d380 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009650 tx=0x7fe1fc006ba0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.934+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c1510a0 msgr2=0x7fe20c1ee110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.934+0000 7fe21210f640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c1510a0 0x7fe20c1ee110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe204036040 tx=0x7fe204004a40 comp rx=0 tx=0).stop 2023-10-18T11:38:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.935+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 shutdown_connections 2023-10-18T11:38:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.935+0000 7fe21210f640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fe1ec06aec0 0x7fe1ec06d380 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.935+0000 7fe21210f640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe20c1510a0 0x7fe20c1ee110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.935+0000 7fe21210f640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe20c0c2180 0x7fe20c1edbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.935+0000 7fe21210f640 1 --2- 172.21.15.151:0/4271535037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20c06de00 0x7fe20c1465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:09.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.935+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 >> 172.21.15.151:0/4271535037 conn(0x7fe20c069f70 msgr2=0x7fe20c14e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:09.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.935+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 shutdown_connections 2023-10-18T11:38:09.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:09.935+0000 7fe21210f640 1 -- 172.21.15.151:0/4271535037 wait complete. 2023-10-18T11:38:09.956 INFO:tasks.ceph:Scrubbing osd.2 2023-10-18T11:38:09.957 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-18T11:38:10.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.170+0000 7f2227d39640 1 Processor -- start 2023-10-18T11:38:10.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.170+0000 7f2227d39640 1 -- start start 2023-10-18T11:38:10.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.172+0000 7f2227d39640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f22200c2180 0x7f222006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.172+0000 7f2227d39640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 0x7f22200c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.172+0000 7f2227d39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222006d430 con 0x7f22201510a0 2023-10-18T11:38:10.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.172+0000 7f2227d39640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22200c25d0 con 0x7f22200c2180 2023-10-18T11:38:10.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.172+0000 7f2227d39640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2220151480 con 0x7f222006de00 2023-10-18T11:38:10.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.173+0000 7f22262d6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 0x7f22200c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.173+0000 7f22252d4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f22200c2180 0x7f222006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.173+0000 7f22252d4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f22200c2180 0x7f222006d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58902/0 (socket says 172.21.15.151:58902) 2023-10-18T11:38:10.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.173+0000 7f2225ad5640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f22201510a0 0x7f2220157770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:43554/0 (socket says 172.21.15.151:43554) 2023-10-18T11:38:10.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.173+0000 7f22252d4640 1 -- 172.21.15.151:0/3335449817 learned_addr learned my addr 172.21.15.151:0/3335449817 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:10.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.175+0000 7f22252d4640 1 -- 172.21.15.151:0/3335449817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 msgr2=0x7f22200c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:10.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.176+0000 7f22252d4640 1 --2- 172.21.15.151:0/3335449817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 0x7f22200c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.176+0000 7f22252d4640 1 -- 172.21.15.151:0/3335449817 >> v1:172.21.15.151:6789/0 conn(0x7f22201510a0 legacy=0x7f2220157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.176+0000 7f22252d4640 1 -- 172.21.15.151:0/3335449817 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200c27d0 con 0x7f22200c2180 2023-10-18T11:38:10.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.178+0000 7f22252d4640 1 --2- 172.21.15.151:0/3335449817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22200c2180 0x7f222006d8c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2210009870 tx=0x7f221002ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38e9a86a84b9ebf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:10.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.182+0000 7f2224ad3640 1 -- 172.21.15.151:0/3335449817 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221002f830 con 0x7f22200c2180 2023-10-18T11:38:10.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.182+0000 7f2224ad3640 1 -- 172.21.15.151:0/3335449817 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221002f990 con 0x7f22200c2180 2023-10-18T11:38:10.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.182+0000 7f2224ad3640 1 -- 172.21.15.151:0/3335449817 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221002fd20 con 0x7f22200c2180 2023-10-18T11:38:10.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.183+0000 7f2227d39640 1 -- 172.21.15.151:0/3335449817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22200c2180 msgr2=0x7f222006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.183+0000 7f2227d39640 1 --2- 172.21.15.151:0/3335449817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22200c2180 0x7f222006d8c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2210009870 tx=0x7f221002ba10 comp rx=0 tx=0).stop 2023-10-18T11:38:10.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.183+0000 7f2227d39640 1 -- 172.21.15.151:0/3335449817 shutdown_connections 2023-10-18T11:38:10.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.183+0000 7f2227d39640 1 --2- 172.21.15.151:0/3335449817 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 0x7f22200c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.183+0000 7f2227d39640 1 --2- 172.21.15.151:0/3335449817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22200c2180 0x7f222006d8c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.183+0000 7f2227d39640 1 -- 172.21.15.151:0/3335449817 >> 172.21.15.151:0/3335449817 conn(0x7f2220069f70 msgr2=0x7f222006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:10.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.183+0000 7f2227d39640 1 -- 172.21.15.151:0/3335449817 shutdown_connections 2023-10-18T11:38:10.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.183+0000 7f2227d39640 1 -- 172.21.15.151:0/3335449817 wait complete. 2023-10-18T11:38:10.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.185+0000 7f2227d39640 1 Processor -- start 2023-10-18T11:38:10.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.185+0000 7f2227d39640 1 -- start start 2023-10-18T11:38:10.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.186+0000 7f2227d39640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 0x7f22201ec5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.186+0000 7f2227d39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22200c2180 0x7f222014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.186+0000 7f2227d39640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22201510a0 0x7f22200c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.186+0000 7f2227d39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22201ed5b0 con 0x7f22200c2180 2023-10-18T11:38:10.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.186+0000 7f2227d39640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22201ecb30 con 0x7f22201510a0 2023-10-18T11:38:10.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.186+0000 7f2227d39640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c8960 con 0x7f222006de00 2023-10-18T11:38:10.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.187+0000 7f22262d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22201510a0 0x7f22200c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.187+0000 7f2225ad5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 0x7f22201ec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.187+0000 7f22252d4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22200c2180 0x7f222014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.187+0000 7f22262d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22201510a0 0x7f22200c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58912/0 (socket says 172.21.15.151:58912) 2023-10-18T11:38:10.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.187+0000 7f2225ad5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 0x7f22201ec5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41822/0 (socket says 172.21.15.151:41822) 2023-10-18T11:38:10.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.187+0000 7f22262d6640 1 -- 172.21.15.151:0/2948137822 learned_addr learned my addr 172.21.15.151:0/2948137822 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:10.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.190+0000 7f2225ad5640 1 -- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22201510a0 msgr2=0x7f22200c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.190+0000 7f2225ad5640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22201510a0 0x7f22200c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.191+0000 7f2225ad5640 1 -- 172.21.15.151:0/2948137822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22200c2180 msgr2=0x7f222014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.191+0000 7f2225ad5640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22200c2180 0x7f222014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.191+0000 7f2225ad5640 1 -- 172.21.15.151:0/2948137822 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22100094d0 con 0x7f222006de00 2023-10-18T11:38:10.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.193+0000 7f2225ad5640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 0x7f22201ec5f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f221c00c700 tx=0x7f221c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:10.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.195+0000 7f22167fc640 1 -- 172.21.15.151:0/2948137822 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c00ce10 con 0x7f222006de00 2023-10-18T11:38:10.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.195+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22200ca850 con 0x7f222006de00 2023-10-18T11:38:10.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.195+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22201ecff0 con 0x7f222006de00 2023-10-18T11:38:10.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.196+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22200c2d70 con 0x7f222006de00 2023-10-18T11:38:10.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.197+0000 7f22167fc640 1 -- 172.21.15.151:0/2948137822 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c00a640 con 0x7f222006de00 2023-10-18T11:38:10.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.197+0000 7f22167fc640 1 -- 172.21.15.151:0/2948137822 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c001800 con 0x7f222006de00 2023-10-18T11:38:10.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.218+0000 7f22167fc640 1 -- 172.21.15.151:0/2948137822 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f221c00a9f0 con 0x7f222006de00 2023-10-18T11:38:10.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.220+0000 7f22167fc640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f220406aea0 0x7f220406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.220+0000 7f22252d4640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f220406aea0 0x7f220406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.221+0000 7f22252d4640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f220406aea0 0x7f220406d360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f2210008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.222+0000 7f22167fc640 1 -- 172.21.15.151:0/2948137822 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f221c007a10 con 0x7f222006de00 2023-10-18T11:38:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.223+0000 7f22167fc640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f2204074680 0x7f2204076b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.223+0000 7f22167fc640 1 -- 172.21.15.151:0/2948137822 --> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22040771f0 con 0x7f2204074680 2023-10-18T11:38:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.223+0000 7f22167fc640 1 -- 172.21.15.151:0/2948137822 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f221c054970 con 0x7f222006de00 2023-10-18T11:38:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.223+0000 7f22262d6640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f2204074680 0x7f2204076b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.224+0000 7f22262d6640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f2204074680 0x7f2204076b20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.225+0000 7f22167fc640 1 -- 172.21.15.151:0/2948137822 <== osd.2 v2:172.21.15.151:6808/2359515345 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f22040771f0 con 0x7f2204074680 2023-10-18T11:38:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.241+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 --> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22200c2a90 con 0x7f2204074680 2023-10-18T11:38:10.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.242+0000 7f22167fc640 1 -- 172.21.15.151:0/2948137822 <== osd.2 v2:172.21.15.151:6808/2359515345 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2218009c50 con 0x7f2204074680 2023-10-18T11:38:10.244 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:38:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T11:38:10.245 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:38:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.242+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f2204074680 msgr2=0x7f2204076b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.242+0000 7f2227d39640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.151:6808/2359515345,v1:172.21.15.151:6809/2359515345] conn(0x7f2204074680 0x7f2204076b20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.242+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f220406aea0 msgr2=0x7f220406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.243+0000 7f2227d39640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f220406aea0 0x7f220406d360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f2210008030 comp rx=0 tx=0).stop 2023-10-18T11:38:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.243+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 msgr2=0x7f22201ec5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.243+0000 7f2227d39640 1 --2- 172.21.15.151:0/2948137822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f222006de00 0x7f22201ec5f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f221c00c700 tx=0x7f221c00cbc0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.243+0000 7f22262d6640 1 -- 172.21.15.151:0/2948137822 reap_dead start 2023-10-18T11:38:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.243+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 shutdown_connections 2023-10-18T11:38:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.243+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 >> 172.21.15.151:0/2948137822 conn(0x7f2220069f70 msgr2=0x7f22200c1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:10.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.243+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 shutdown_connections 2023-10-18T11:38:10.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.243+0000 7f2227d39640 1 -- 172.21.15.151:0/2948137822 wait complete. 2023-10-18T11:38:10.263 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-18T11:38:10.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.479+0000 7f2e6ac61640 1 Processor -- start 2023-10-18T11:38:10.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.479+0000 7f2e6ac61640 1 -- start start 2023-10-18T11:38:10.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.481+0000 7f2e6ac61640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2e640cbe20 0x7f2e6415d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.481+0000 7f2e6ac61640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.481+0000 7f2e6ac61640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e64153870 con 0x7f2e640c9650 2023-10-18T11:38:10.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.481+0000 7f2e6ac61640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e640cc200 con 0x7f2e640cbe20 2023-10-18T11:38:10.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.481+0000 7f2e6ac61640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e640b1e30 con 0x7f2e640b1340 2023-10-18T11:38:10.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.482+0000 7f2e63fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.482+0000 7f2e689fd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2e640cbe20 0x7f2e6415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.482+0000 7f2e691fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f2e640c9650 0x7f2e6406acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47250/0 (socket says 172.21.15.151:47250) 2023-10-18T11:38:10.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.482+0000 7f2e691fe640 1 -- 172.21.15.151:0/2470652076 learned_addr learned my addr 172.21.15.151:0/2470652076 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:10.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.485+0000 7f2e63fff640 1 -- 172.21.15.151:0/2470652076 >> v2:172.21.15.169:3300/0 conn(0x7f2e640cbe20 msgr2=0x7f2e6415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:10.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.485+0000 7f2e63fff640 1 --2- 172.21.15.151:0/2470652076 >> v2:172.21.15.169:3300/0 conn(0x7f2e640cbe20 0x7f2e6415d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.485+0000 7f2e63fff640 1 -- 172.21.15.151:0/2470652076 >> v1:172.21.15.169:6789/0 conn(0x7f2e640c9650 legacy=0x7f2e6406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.485+0000 7f2e63fff640 1 -- 172.21.15.151:0/2470652076 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e641590d0 con 0x7f2e640b1340 2023-10-18T11:38:10.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.487+0000 7f2e63fff640 1 --2- 172.21.15.151:0/2470652076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640cac40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2e500097a0 tx=0x7f2e5002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e209a08c44036b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:10.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.542+0000 7f2e637fe640 1 -- 172.21.15.151:0/2470652076 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50030800 con 0x7f2e640b1340 2023-10-18T11:38:10.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.542+0000 7f2e637fe640 1 -- 172.21.15.151:0/2470652076 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e50030960 con 0x7f2e640b1340 2023-10-18T11:38:10.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.542+0000 7f2e637fe640 1 -- 172.21.15.151:0/2470652076 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50030cf0 con 0x7f2e640b1340 2023-10-18T11:38:10.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.543+0000 7f2e6ac61640 1 -- 172.21.15.151:0/2470652076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 msgr2=0x7f2e640cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.543+0000 7f2e6ac61640 1 --2- 172.21.15.151:0/2470652076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640cac40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2e500097a0 tx=0x7f2e5002b940 comp rx=0 tx=0).stop 2023-10-18T11:38:10.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.543+0000 7f2e6ac61640 1 -- 172.21.15.151:0/2470652076 shutdown_connections 2023-10-18T11:38:10.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.543+0000 7f2e6ac61640 1 --2- 172.21.15.151:0/2470652076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640cac40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.543+0000 7f2e6ac61640 1 --2- 172.21.15.151:0/2470652076 >> v2:172.21.15.169:3300/0 conn(0x7f2e640cbe20 0x7f2e6415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.543+0000 7f2e6ac61640 1 -- 172.21.15.151:0/2470652076 >> 172.21.15.151:0/2470652076 conn(0x7f2e640659d0 msgr2=0x7f2e64065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:10.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.544+0000 7f2e6ac61640 1 -- 172.21.15.151:0/2470652076 shutdown_connections 2023-10-18T11:38:10.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.544+0000 7f2e6ac61640 1 -- 172.21.15.151:0/2470652076 wait complete. 2023-10-18T11:38:10.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.547+0000 7f2e6ac61640 1 Processor -- start 2023-10-18T11:38:10.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.547+0000 7f2e6ac61640 1 -- start start 2023-10-18T11:38:10.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.549+0000 7f2e6ac61640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.549+0000 7f2e6ac61640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e640c9650 0x7f2e640c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.549+0000 7f2e6ac61640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e640cbe20 0x7f2e641efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.549+0000 7f2e6ac61640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e640c32b0 con 0x7f2e640c9650 2023-10-18T11:38:10.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.549+0000 7f2e6ac61640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64155000 con 0x7f2e640cbe20 2023-10-18T11:38:10.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.549+0000 7f2e6ac61640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64152110 con 0x7f2e640b1340 2023-10-18T11:38:10.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.549+0000 7f2e689fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.550+0000 7f2e691fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e640cbe20 0x7f2e641efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.550+0000 7f2e689fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640c2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41848/0 (socket says 172.21.15.151:41848) 2023-10-18T11:38:10.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.550+0000 7f2e689fd640 1 -- 172.21.15.151:0/1253546106 learned_addr learned my addr 172.21.15.151:0/1253546106 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:10.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.553+0000 7f2e691fe640 1 -- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 msgr2=0x7f2e640c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.553+0000 7f2e691fe640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.553+0000 7f2e691fe640 1 -- 172.21.15.151:0/1253546106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e640c9650 msgr2=0x7f2e640c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:10.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.553+0000 7f2e691fe640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e640c9650 0x7f2e640c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:10.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.553+0000 7f2e691fe640 1 -- 172.21.15.151:0/1253546106 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e50009400 con 0x7f2e640cbe20 2023-10-18T11:38:10.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.556+0000 7f2e691fe640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e640cbe20 0x7f2e641efcd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00caa0 tx=0x7f2e5c00cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:10.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.559+0000 7f2e617fa640 1 -- 172.21.15.151:0/1253546106 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00ac00 con 0x7f2e640cbe20 2023-10-18T11:38:10.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.560+0000 7f2e617fa640 1 -- 172.21.15.151:0/1253546106 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c00ad60 con 0x7f2e640cbe20 2023-10-18T11:38:10.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.560+0000 7f2e617fa640 1 -- 172.21.15.151:0/1253546106 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c012600 con 0x7f2e640cbe20 2023-10-18T11:38:10.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.560+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e641523f0 con 0x7f2e640cbe20 2023-10-18T11:38:10.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.560+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e641529b0 con 0x7f2e640cbe20 2023-10-18T11:38:10.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.561+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6404e160 con 0x7f2e640cbe20 2023-10-18T11:38:10.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.581+0000 7f2e617fa640 1 -- 172.21.15.151:0/1253546106 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2e5c007070 con 0x7f2e640cbe20 2023-10-18T11:38:10.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.582+0000 7f2e617fa640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2e4806aef0 0x7f2e4806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:10.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.582+0000 7f2e689fd640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2e4806aef0 0x7f2e4806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:10.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.582+0000 7f2e617fa640 1 -- 172.21.15.151:0/1253546106 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2e5c058740 con 0x7f2e640cbe20 2023-10-18T11:38:10.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.583+0000 7f2e689fd640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2e4806aef0 0x7f2e4806d3b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009b60 tx=0x7f2e58009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:10.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:10.824+0000 7f2e617fa640 1 -- 172.21.15.151:0/1253546106 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e5c054a80 con 0x7f2e640cbe20 2023-10-18T11:38:11.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.028+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e640ca8c0 con 0x7f2e4806aef0 2023-10-18T11:38:11.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.029+0000 7f2e617fa640 1 -- 172.21.15.151:0/1253546106 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2e58011ac0 con 0x7f2e4806aef0 2023-10-18T11:38:11.032 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 2 to deep-scrub 2023-10-18T11:38:11.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2e4806aef0 msgr2=0x7f2e4806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2e4806aef0 0x7f2e4806d3b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009b60 tx=0x7f2e58009190 comp rx=0 tx=0).stop 2023-10-18T11:38:11.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e640cbe20 msgr2=0x7f2e641efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e640cbe20 0x7f2e641efcd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00caa0 tx=0x7f2e5c00cf60 comp rx=0 tx=0).stop 2023-10-18T11:38:11.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 shutdown_connections 2023-10-18T11:38:11.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f2e4806aef0 0x7f2e4806d3b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e640cbe20 0x7f2e641efcd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e640c9650 0x7f2e640c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 --2- 172.21.15.151:0/1253546106 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e640b1340 0x7f2e640c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 >> 172.21.15.151:0/1253546106 conn(0x7f2e640659d0 msgr2=0x7f2e640cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:11.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 shutdown_connections 2023-10-18T11:38:11.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.032+0000 7f2e6ac61640 1 -- 172.21.15.151:0/1253546106 wait complete. 2023-10-18T11:38:11.054 INFO:tasks.ceph:Scrubbing osd.3 2023-10-18T11:38:11.055 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-18T11:38:11.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.278+0000 7f59eb183640 1 Processor -- start 2023-10-18T11:38:11.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.278+0000 7f59eb183640 1 -- start start 2023-10-18T11:38:11.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.280+0000 7f59eb183640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f59e4157720 0x7f59e406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.280+0000 7f59eb183640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e40701b0 0x7f59e415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.280+0000 7f59eb183640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e406d0c0 con 0x7f59e40c51b0 2023-10-18T11:38:11.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.280+0000 7f59eb183640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e406d6f0 con 0x7f59e4157720 2023-10-18T11:38:11.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.280+0000 7f59eb183640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e406e050 con 0x7f59e40701b0 2023-10-18T11:38:11.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.281+0000 7f59e9720640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f59e40c51b0 0x7f59e40c6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:43558/0 (socket says 172.21.15.151:43558) 2023-10-18T11:38:11.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.281+0000 7f59e9720640 1 -- 172.21.15.151:0/3141078732 learned_addr learned my addr 172.21.15.151:0/3141078732 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:11.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.281+0000 7f59e8f1f640 1 --2- 172.21.15.151:0/3141078732 >> v2:172.21.15.169:3300/0 conn(0x7f59e4157720 0x7f59e406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.281+0000 7f59e3fff640 1 --2- 172.21.15.151:0/3141078732 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e40701b0 0x7f59e415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.284+0000 7f59e8f1f640 1 -- 172.21.15.151:0/3141078732 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e40701b0 msgr2=0x7f59e415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:11.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.284+0000 7f59e8f1f640 1 --2- 172.21.15.151:0/3141078732 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e40701b0 0x7f59e415d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.284+0000 7f59e8f1f640 1 -- 172.21.15.151:0/3141078732 >> v1:172.21.15.151:6789/0 conn(0x7f59e40c51b0 legacy=0x7f59e40c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.284+0000 7f59e8f1f640 1 -- 172.21.15.151:0/3141078732 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e40c7810 con 0x7f59e4157720 2023-10-18T11:38:11.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.284+0000 7f59e37fe640 1 -- 172.21.15.151:0/3141078732 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451384398 0 0) 0x7f59e406d0c0 con 0x7f59e40c51b0 2023-10-18T11:38:11.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.286+0000 7f59e8f1f640 1 --2- 172.21.15.151:0/3141078732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59e4157720 0x7f59e406db10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097a0 tx=0x7f59d802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=813904ff080c3ece server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:11.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.290+0000 7f59e37fe640 1 -- 172.21.15.151:0/3141078732 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8031780 con 0x7f59e4157720 2023-10-18T11:38:11.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.290+0000 7f59e37fe640 1 -- 172.21.15.151:0/3141078732 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d80318e0 con 0x7f59e4157720 2023-10-18T11:38:11.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.290+0000 7f59e37fe640 1 -- 172.21.15.151:0/3141078732 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8031c70 con 0x7f59e4157720 2023-10-18T11:38:11.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.291+0000 7f59eb183640 1 -- 172.21.15.151:0/3141078732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59e4157720 msgr2=0x7f59e406db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.291+0000 7f59eb183640 1 --2- 172.21.15.151:0/3141078732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59e4157720 0x7f59e406db10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097a0 tx=0x7f59d802b820 comp rx=0 tx=0).stop 2023-10-18T11:38:11.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.291+0000 7f59eb183640 1 -- 172.21.15.151:0/3141078732 shutdown_connections 2023-10-18T11:38:11.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.291+0000 7f59eb183640 1 --2- 172.21.15.151:0/3141078732 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e40701b0 0x7f59e415d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.291+0000 7f59eb183640 1 --2- 172.21.15.151:0/3141078732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59e4157720 0x7f59e406db10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.291+0000 7f59eb183640 1 -- 172.21.15.151:0/3141078732 >> 172.21.15.151:0/3141078732 conn(0x7f59e4069f70 msgr2=0x7f59e406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:11.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.291+0000 7f59eb183640 1 -- 172.21.15.151:0/3141078732 shutdown_connections 2023-10-18T11:38:11.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.291+0000 7f59eb183640 1 -- 172.21.15.151:0/3141078732 wait complete. 2023-10-18T11:38:11.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.293+0000 7f59eb183640 1 Processor -- start 2023-10-18T11:38:11.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.293+0000 7f59eb183640 1 -- start start 2023-10-18T11:38:11.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.294+0000 7f59eb183640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59e40701b0 0x7f59e41f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.294+0000 7f59eb183640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59e40c51b0 0x7f59e4150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.294+0000 7f59eb183640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e4157720 0x7f59e40c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.294+0000 7f59eb183640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e4159ab0 con 0x7f59e40c51b0 2023-10-18T11:38:11.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.294+0000 7f59eb183640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40c82c0 con 0x7f59e40701b0 2023-10-18T11:38:11.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.294+0000 7f59eb183640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40c8560 con 0x7f59e4157720 2023-10-18T11:38:11.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.295+0000 7f59e3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59e40c51b0 0x7f59e4150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.295+0000 7f59e8f1f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59e40701b0 0x7f59e41f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.295+0000 7f59e9720640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e4157720 0x7f59e40c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.295+0000 7f59e3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59e40c51b0 0x7f59e4150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40748/0 (socket says 172.21.15.151:40748) 2023-10-18T11:38:11.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.295+0000 7f59e3fff640 1 -- 172.21.15.151:0/1590760276 learned_addr learned my addr 172.21.15.151:0/1590760276 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:11.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.298+0000 7f59e9720640 1 -- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59e40701b0 msgr2=0x7f59e41f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.298+0000 7f59e9720640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59e40701b0 0x7f59e41f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.298+0000 7f59e9720640 1 -- 172.21.15.151:0/1590760276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59e40c51b0 msgr2=0x7f59e4150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.298+0000 7f59e9720640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59e40c51b0 0x7f59e4150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.299+0000 7f59e9720640 1 -- 172.21.15.151:0/1590760276 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d8009400 con 0x7f59e4157720 2023-10-18T11:38:11.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.301+0000 7f59e9720640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e4157720 0x7f59e40c9da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f59dc001560 tx=0x7f59dc00cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:11.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.303+0000 7f59e17fa640 1 -- 172.21.15.151:0/1590760276 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00ce30 con 0x7f59e4157720 2023-10-18T11:38:11.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.304+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e40c8840 con 0x7f59e4157720 2023-10-18T11:38:11.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.304+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e40c8e00 con 0x7f59e4157720 2023-10-18T11:38:11.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.305+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59e415e010 con 0x7f59e4157720 2023-10-18T11:38:11.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.324+0000 7f59e17fa640 1 -- 172.21.15.151:0/1590760276 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc00a640 con 0x7f59e4157720 2023-10-18T11:38:11.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.324+0000 7f59e17fa640 1 -- 172.21.15.151:0/1590760276 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc001800 con 0x7f59e4157720 2023-10-18T11:38:11.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.327+0000 7f59e17fa640 1 -- 172.21.15.151:0/1590760276 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f59dc00aa70 con 0x7f59e4157720 2023-10-18T11:38:11.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.328+0000 7f59e17fa640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59c806ae70 0x7f59c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.328+0000 7f59e17fa640 1 -- 172.21.15.151:0/1590760276 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f59dc0583a0 con 0x7f59e4157720 2023-10-18T11:38:11.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.329+0000 7f59e8f1f640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59c806ae70 0x7f59c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.329+0000 7f59e17fa640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f59c80746d0 0x7f59c8076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.329+0000 7f59e17fa640 1 -- 172.21.15.151:0/1590760276 --> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59c8077240 con 0x7f59c80746d0 2023-10-18T11:38:11.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.329+0000 7f59e17fa640 1 -- 172.21.15.151:0/1590760276 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59dc013e70 con 0x7f59e4157720 2023-10-18T11:38:11.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.329+0000 7f59e3fff640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f59c80746d0 0x7f59c8076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.330+0000 7f59e8f1f640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59c806ae70 0x7f59c806d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59d8036000 tx=0x7f59d803d040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:11.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.330+0000 7f59e3fff640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f59c80746d0 0x7f59c8076b70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:11.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.332+0000 7f59e17fa640 1 -- 172.21.15.151:0/1590760276 <== osd.3 v2:172.21.15.151:6816/2813876037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f59c8077240 con 0x7f59c80746d0 2023-10-18T11:38:11.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.346+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 --> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f59e415dd30 con 0x7f59c80746d0 2023-10-18T11:38:11.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.347+0000 7f59e17fa640 1 -- 172.21.15.151:0/1590760276 <== osd.3 v2:172.21.15.151:6816/2813876037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f59d00097b0 con 0x7f59c80746d0 2023-10-18T11:38:11.350 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:38:11.350 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T11:38:11.350 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:38:11.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f59c80746d0 msgr2=0x7f59c8076b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59eb183640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.151:6816/2813876037,v1:172.21.15.151:6817/2813876037] conn(0x7f59c80746d0 0x7f59c8076b70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59c806ae70 msgr2=0x7f59c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59eb183640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59c806ae70 0x7f59c806d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59d8036000 tx=0x7f59d803d040 comp rx=0 tx=0).stop 2023-10-18T11:38:11.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e4157720 msgr2=0x7f59e40c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59eb183640 1 --2- 172.21.15.151:0/1590760276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59e4157720 0x7f59e40c9da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f59dc001560 tx=0x7f59dc00cbe0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59e9720640 1 -- 172.21.15.151:0/1590760276 reap_dead start 2023-10-18T11:38:11.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 shutdown_connections 2023-10-18T11:38:11.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 >> 172.21.15.151:0/1590760276 conn(0x7f59e4069f70 msgr2=0x7f59e40c4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:11.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.348+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 shutdown_connections 2023-10-18T11:38:11.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.349+0000 7f59eb183640 1 -- 172.21.15.151:0/1590760276 wait complete. 2023-10-18T11:38:11.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-18T11:38:11.512 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:38:11.521 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:38:11.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.580+0000 7f5f8f18a640 1 Processor -- start 2023-10-18T11:38:11.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.580+0000 7f5f8f18a640 1 -- start start 2023-10-18T11:38:11.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.582+0000 7f5f8f18a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f8815d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.582+0000 7f5f8f18a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5f880c9650 0x7f5f880c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.582+0000 7f5f8f18a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f88153870 con 0x7f5f880b1340 2023-10-18T11:38:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.582+0000 7f5f8f18a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f880cc200 con 0x7f5f880c9650 2023-10-18T11:38:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.582+0000 7f5f8f18a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880b1e30 con 0x7f5f880cbe20 2023-10-18T11:38:11.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.583+0000 7f5f8cf26640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f8815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.583+0000 7f5f87fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f5f880b1340 0x7f5f880cac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47262/0 (socket says 172.21.15.151:47262) 2023-10-18T11:38:11.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.583+0000 7f5f87fff640 1 -- 172.21.15.151:0/4121033928 learned_addr learned my addr 172.21.15.151:0/4121033928 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:11.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.585+0000 7f5f8cf26640 1 -- 172.21.15.151:0/4121033928 >> v2:172.21.15.151:3300/0 conn(0x7f5f880c9650 msgr2=0x7f5f880c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:11.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.585+0000 7f5f8cf26640 1 --2- 172.21.15.151:0/4121033928 >> v2:172.21.15.151:3300/0 conn(0x7f5f880c9650 0x7f5f880c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.585+0000 7f5f8cf26640 1 -- 172.21.15.151:0/4121033928 >> v1:172.21.15.169:6789/0 conn(0x7f5f880b1340 legacy=0x7f5f880cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.586+0000 7f5f8cf26640 1 -- 172.21.15.151:0/4121033928 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f881590d0 con 0x7f5f880cbe20 2023-10-18T11:38:11.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.588+0000 7f5f8cf26640 1 --2- 172.21.15.151:0/4121033928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f8815d170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0097a0 tx=0x7f5f7c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54809d7b3dc5157a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:11.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.591+0000 7f5f877fe640 1 -- 172.21.15.151:0/4121033928 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c030800 con 0x7f5f880cbe20 2023-10-18T11:38:11.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.591+0000 7f5f877fe640 1 -- 172.21.15.151:0/4121033928 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c030960 con 0x7f5f880cbe20 2023-10-18T11:38:11.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.591+0000 7f5f877fe640 1 -- 172.21.15.151:0/4121033928 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c030cf0 con 0x7f5f880cbe20 2023-10-18T11:38:11.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.592+0000 7f5f8f18a640 1 -- 172.21.15.151:0/4121033928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 msgr2=0x7f5f8815d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.592+0000 7f5f8f18a640 1 --2- 172.21.15.151:0/4121033928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f8815d170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0097a0 tx=0x7f5f7c02b940 comp rx=0 tx=0).stop 2023-10-18T11:38:11.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.592+0000 7f5f8f18a640 1 -- 172.21.15.151:0/4121033928 shutdown_connections 2023-10-18T11:38:11.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.592+0000 7f5f8f18a640 1 --2- 172.21.15.151:0/4121033928 >> v2:172.21.15.151:3300/0 conn(0x7f5f880c9650 0x7f5f880c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.592+0000 7f5f8f18a640 1 --2- 172.21.15.151:0/4121033928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f8815d170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.592+0000 7f5f8f18a640 1 -- 172.21.15.151:0/4121033928 >> 172.21.15.151:0/4121033928 conn(0x7f5f880659d0 msgr2=0x7f5f88065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:11.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.592+0000 7f5f8f18a640 1 -- 172.21.15.151:0/4121033928 shutdown_connections 2023-10-18T11:38:11.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.592+0000 7f5f8f18a640 1 -- 172.21.15.151:0/4121033928 wait complete. 2023-10-18T11:38:11.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.594+0000 7f5f8f18a640 1 Processor -- start 2023-10-18T11:38:11.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.594+0000 7f5f8f18a640 1 -- start start 2023-10-18T11:38:11.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.595+0000 7f5f8f18a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f880b1340 0x7f5f880ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.595+0000 7f5f8f18a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f880c9650 0x7f5f880c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.595+0000 7f5f8f18a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f881f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.595+0000 7f5f8f18a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880cf390 con 0x7f5f880c9650 2023-10-18T11:38:11.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.595+0000 7f5f8f18a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f881e2cc0 con 0x7f5f880b1340 2023-10-18T11:38:11.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.595+0000 7f5f8f18a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880ceb50 con 0x7f5f880cbe20 2023-10-18T11:38:11.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.596+0000 7f5f8cf26640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f880b1340 0x7f5f880ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.596+0000 7f5f8d727640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f881f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.596+0000 7f5f8d727640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f881f01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41884/0 (socket says 172.21.15.151:41884) 2023-10-18T11:38:11.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.596+0000 7f5f8d727640 1 -- 172.21.15.151:0/519563635 learned_addr learned my addr 172.21.15.151:0/519563635 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:11.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.600+0000 7f5f8d727640 1 -- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f880b1340 msgr2=0x7f5f880ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.600+0000 7f5f8d727640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f880b1340 0x7f5f880ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.600+0000 7f5f8d727640 1 -- 172.21.15.151:0/519563635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f880c9650 msgr2=0x7f5f880c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:11.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.600+0000 7f5f8d727640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f880c9650 0x7f5f880c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:11.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.600+0000 7f5f8d727640 1 -- 172.21.15.151:0/519563635 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c009400 con 0x7f5f880cbe20 2023-10-18T11:38:11.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.600+0000 7f5f8cf26640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f880b1340 0x7f5f880ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:38:11.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.603+0000 7f5f8d727640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f881f01a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000b9a0 tx=0x7f5f8000be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:11.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.612+0000 7f5f857fa640 1 -- 172.21.15.151:0/519563635 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000cb40 con 0x7f5f880cbe20 2023-10-18T11:38:11.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.612+0000 7f5f857fa640 1 -- 172.21.15.151:0/519563635 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8000ccc0 con 0x7f5f880cbe20 2023-10-18T11:38:11.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.612+0000 7f5f857fa640 1 -- 172.21.15.151:0/519563635 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80014680 con 0x7f5f880cbe20 2023-10-18T11:38:11.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.612+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f880ce780 con 0x7f5f880cbe20 2023-10-18T11:38:11.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.612+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f880cf0b0 con 0x7f5f880cbe20 2023-10-18T11:38:11.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.614+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8804e160 con 0x7f5f880cbe20 2023-10-18T11:38:11.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.868+0000 7f5f857fa640 1 -- 172.21.15.151:0/519563635 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f8001d3b0 con 0x7f5f880cbe20 2023-10-18T11:38:11.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.869+0000 7f5f857fa640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5f6c06aec0 0x7f5f6c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:11.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.870+0000 7f5f8cf26640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5f6c06aec0 0x7f5f6c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:11.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.871+0000 7f5f8cf26640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5f6c06aec0 0x7f5f6c06d380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c036000 tx=0x7f5f7c008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:11.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.874+0000 7f5f857fa640 1 -- 172.21.15.151:0/519563635 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f8000ce30 con 0x7f5f880cbe20 2023-10-18T11:38:11.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:11.885+0000 7f5f857fa640 1 -- 172.21.15.151:0/519563635 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f80054b50 con 0x7f5f880cbe20 2023-10-18T11:38:12.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.112+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f880ca8c0 con 0x7f5f6c06aec0 2023-10-18T11:38:12.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.113+0000 7f5f857fa640 1 -- 172.21.15.151:0/519563635 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5f7c040040 con 0x7f5f6c06aec0 2023-10-18T11:38:12.116 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 3 to deep-scrub 2023-10-18T11:38:12.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.116+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5f6c06aec0 msgr2=0x7f5f6c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.116+0000 7f5f8f18a640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5f6c06aec0 0x7f5f6c06d380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c036000 tx=0x7f5f7c008030 comp rx=0 tx=0).stop 2023-10-18T11:38:12.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.116+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 msgr2=0x7f5f881f01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.116+0000 7f5f8f18a640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f881f01a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000b9a0 tx=0x7f5f8000be60 comp rx=0 tx=0).stop 2023-10-18T11:38:12.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.117+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 shutdown_connections 2023-10-18T11:38:12.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.117+0000 7f5f8f18a640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f880cbe20 0x7f5f881f01a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.117+0000 7f5f8f18a640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f880c9650 0x7f5f880c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.117+0000 7f5f8f18a640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f5f6c06aec0 0x7f5f6c06d380 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.117+0000 7f5f8f18a640 1 --2- 172.21.15.151:0/519563635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f880b1340 0x7f5f880ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.117+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 >> 172.21.15.151:0/519563635 conn(0x7f5f880659d0 msgr2=0x7f5f880b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:12.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.117+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 shutdown_connections 2023-10-18T11:38:12.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.117+0000 7f5f8f18a640 1 -- 172.21.15.151:0/519563635 wait complete. 2023-10-18T11:38:12.137 INFO:tasks.ceph:Scrubbing osd.4 2023-10-18T11:38:12.137 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-18T11:38:12.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.339+0000 7f59c5e1a640 1 Processor -- start 2023-10-18T11:38:12.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.339+0000 7f59c5e1a640 1 -- start start 2023-10-18T11:38:12.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.341+0000 7f59c5e1a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f59c00c4e60 0x7f59c00c5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.341+0000 7f59c5e1a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c006d430 con 0x7f59c00c2180 2023-10-18T11:38:12.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.341+0000 7f59c5e1a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c0151480 con 0x7f59c01510a0 2023-10-18T11:38:12.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.341+0000 7f59c5e1a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c00c57b0 con 0x7f59c00c4e60 2023-10-18T11:38:12.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.342+0000 7f59bf7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f59c01510a0 0x7f59c0157770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47266/0 (socket says 172.21.15.151:47266) 2023-10-18T11:38:12.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.342+0000 7f59bf7fe640 1 -- 172.21.15.151:0/2003525122 learned_addr learned my addr 172.21.15.151:0/2003525122 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:12.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.342+0000 7f59bffff640 1 --2- 172.21.15.151:0/2003525122 >> v2:172.21.15.151:3300/0 conn(0x7f59c00c4e60 0x7f59c00c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.344+0000 7f59be7fc640 1 -- 172.21.15.151:0/2003525122 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704834089 0 0) 0x7f59c0151480 con 0x7f59c01510a0 2023-10-18T11:38:12.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.344+0000 7f59be7fc640 1 -- 172.21.15.151:0/2003525122 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ac003520 con 0x7f59c01510a0 2023-10-18T11:38:12.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.346+0000 7f59bffff640 1 -- 172.21.15.151:0/2003525122 >> v1:172.21.15.169:6789/0 conn(0x7f59c01510a0 legacy=0x7f59c0157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.346+0000 7f59bffff640 1 -- 172.21.15.151:0/2003525122 >> v1:172.21.15.151:6789/0 conn(0x7f59c00c2180 legacy=0x7f59c006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.346+0000 7f59bffff640 1 -- 172.21.15.151:0/2003525122 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00c27d0 con 0x7f59c00c4e60 2023-10-18T11:38:12.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.350+0000 7f59bffff640 1 --2- 172.21.15.151:0/2003525122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59c00c4e60 0x7f59c00c5270 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59b80097a0 tx=0x7f59b802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19acecad69198ea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:12.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.355+0000 7f59be7fc640 1 -- 172.21.15.151:0/2003525122 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b802f810 con 0x7f59c00c4e60 2023-10-18T11:38:12.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.355+0000 7f59be7fc640 1 -- 172.21.15.151:0/2003525122 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b802f970 con 0x7f59c00c4e60 2023-10-18T11:38:12.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.355+0000 7f59be7fc640 1 -- 172.21.15.151:0/2003525122 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b802fd00 con 0x7f59c00c4e60 2023-10-18T11:38:12.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.355+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2003525122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59c00c4e60 msgr2=0x7f59c00c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.355+0000 7f59c5e1a640 1 --2- 172.21.15.151:0/2003525122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59c00c4e60 0x7f59c00c5270 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59b80097a0 tx=0x7f59b802b9f0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.356+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2003525122 shutdown_connections 2023-10-18T11:38:12.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.356+0000 7f59c5e1a640 1 --2- 172.21.15.151:0/2003525122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59c00c4e60 0x7f59c00c5270 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.356+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2003525122 >> 172.21.15.151:0/2003525122 conn(0x7f59c0069f70 msgr2=0x7f59c006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:12.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.356+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2003525122 shutdown_connections 2023-10-18T11:38:12.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.356+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2003525122 wait complete. 2023-10-18T11:38:12.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.359+0000 7f59c5e1a640 1 Processor -- start 2023-10-18T11:38:12.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.359+0000 7f59c5e1a640 1 -- start start 2023-10-18T11:38:12.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.360+0000 7f59c5e1a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c2180 0x7f59c01469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.360+0000 7f59c5e1a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c00c4e60 0x7f59c014d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.360+0000 7f59c5e1a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59c01510a0 0x7f59c014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.360+0000 7f59c5e1a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c00bd350 con 0x7f59c01510a0 2023-10-18T11:38:12.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.360+0000 7f59c5e1a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c00bdd50 con 0x7f59c00c4e60 2023-10-18T11:38:12.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.360+0000 7f59c5e1a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c00bd7d0 con 0x7f59c00c2180 2023-10-18T11:38:12.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.361+0000 7f59beffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c00c4e60 0x7f59c014d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.361+0000 7f59bffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59c01510a0 0x7f59c014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.361+0000 7f59bf7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c2180 0x7f59c01469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.362+0000 7f59beffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c00c4e60 0x7f59c014d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58966/0 (socket says 172.21.15.151:58966) 2023-10-18T11:38:12.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.362+0000 7f59beffd640 1 -- 172.21.15.151:0/2148715062 learned_addr learned my addr 172.21.15.151:0/2148715062 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:12.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.365+0000 7f59beffd640 1 -- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c2180 msgr2=0x7f59c01469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.365+0000 7f59beffd640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c2180 0x7f59c01469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.365+0000 7f59beffd640 1 -- 172.21.15.151:0/2148715062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59c01510a0 msgr2=0x7f59c014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.365+0000 7f59beffd640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59c01510a0 0x7f59c014dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.365+0000 7f59beffd640 1 -- 172.21.15.151:0/2148715062 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b8009400 con 0x7f59c00c4e60 2023-10-18T11:38:12.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.367+0000 7f59beffd640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c00c4e60 0x7f59c014d590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f59a800c480 tx=0x7f59a800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:12.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.370+0000 7f59b7fff640 1 -- 172.21.15.151:0/2148715062 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80052d0 con 0x7f59c00c4e60 2023-10-18T11:38:12.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.371+0000 7f59b7fff640 1 -- 172.21.15.151:0/2148715062 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a8005430 con 0x7f59c00c4e60 2023-10-18T11:38:12.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.371+0000 7f59b7fff640 1 -- 172.21.15.151:0/2148715062 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8012870 con 0x7f59c00c4e60 2023-10-18T11:38:12.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.371+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c00bda70 con 0x7f59c00c4e60 2023-10-18T11:38:12.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.371+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c00bcd00 con 0x7f59c00c4e60 2023-10-18T11:38:12.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.372+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59c00c2d70 con 0x7f59c00c4e60 2023-10-18T11:38:12.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.391+0000 7f59b7fff640 1 -- 172.21.15.151:0/2148715062 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f59a80129d0 con 0x7f59c00c4e60 2023-10-18T11:38:12.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.392+0000 7f59b7fff640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59a006aec0 0x7f59a006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.392+0000 7f59bf7fe640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59a006aec0 0x7f59a006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.393+0000 7f59bf7fe640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59a006aec0 0x7f59a006d380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f59b0001560 tx=0x7f59b00019f0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:12.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.394+0000 7f59b7fff640 1 -- 172.21.15.151:0/2148715062 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f59a8058890 con 0x7f59c00c4e60 2023-10-18T11:38:12.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.394+0000 7f59b7fff640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f59a0074720 0x7f59a0076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.394+0000 7f59b7fff640 1 -- 172.21.15.151:0/2148715062 --> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59a0077290 con 0x7f59a0074720 2023-10-18T11:38:12.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.394+0000 7f59bffff640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f59a0074720 0x7f59a0076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.395+0000 7f59b7fff640 1 -- 172.21.15.151:0/2148715062 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59a8054bd0 con 0x7f59c00c4e60 2023-10-18T11:38:12.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.395+0000 7f59bffff640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f59a0074720 0x7f59a0076bc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:12.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.396+0000 7f59b7fff640 1 -- 172.21.15.151:0/2148715062 <== osd.4 v2:172.21.15.169:6800/2104783334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f59a0077290 con 0x7f59a0074720 2023-10-18T11:38:12.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.411+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 --> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f59c00c2a90 con 0x7f59a0074720 2023-10-18T11:38:12.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.412+0000 7f59b7fff640 1 -- 172.21.15.151:0/2148715062 <== osd.4 v2:172.21.15.169:6800/2104783334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f59b802fae0 con 0x7f59a0074720 2023-10-18T11:38:12.414 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:38:12.415 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T11:38:12.415 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:38:12.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f59a0074720 msgr2=0x7f59a0076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59c5e1a640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6800/2104783334,v1:172.21.15.169:6801/2104783334] conn(0x7f59a0074720 0x7f59a0076bc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59a006aec0 msgr2=0x7f59a006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59c5e1a640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f59a006aec0 0x7f59a006d380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f59b0001560 tx=0x7f59b00019f0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c00c4e60 msgr2=0x7f59c014d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59c5e1a640 1 --2- 172.21.15.151:0/2148715062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59c00c4e60 0x7f59c014d590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f59a800c480 tx=0x7f59a800c940 comp rx=0 tx=0).stop 2023-10-18T11:38:12.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59bffff640 1 -- 172.21.15.151:0/2148715062 reap_dead start 2023-10-18T11:38:12.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 shutdown_connections 2023-10-18T11:38:12.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 >> 172.21.15.151:0/2148715062 conn(0x7f59c0069f70 msgr2=0x7f59c014f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:12.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.413+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 shutdown_connections 2023-10-18T11:38:12.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.414+0000 7f59c5e1a640 1 -- 172.21.15.151:0/2148715062 wait complete. 2023-10-18T11:38:12.435 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-18T11:38:12.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.647+0000 7fac370c9640 1 Processor -- start 2023-10-18T11:38:12.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.647+0000 7fac370c9640 1 -- start start 2023-10-18T11:38:12.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.648+0000 7fac370c9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac301510a0 0x7fac300c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.648+0000 7fac370c9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac300c4e60 0x7fac300c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.648+0000 7fac370c9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3006d430 con 0x7fac30157770 2023-10-18T11:38:12.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.649+0000 7fac370c9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac30151480 con 0x7fac301510a0 2023-10-18T11:38:12.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.649+0000 7fac370c9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac300c27d0 con 0x7fac300c4e60 2023-10-18T11:38:12.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.649+0000 7fac35666640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac300c4e60 0x7fac300c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.649+0000 7fac2ffff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fac30157770 0x7fac3006d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47268/0 (socket says 172.21.15.151:47268) 2023-10-18T11:38:12.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.649+0000 7fac2ffff640 1 -- 172.21.15.151:0/849590988 learned_addr learned my addr 172.21.15.151:0/849590988 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:12.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.652+0000 7fac2f7fe640 1 -- 172.21.15.151:0/849590988 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041164162 0 0) 0x7fac3006d430 con 0x7fac30157770 2023-10-18T11:38:12.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.652+0000 7fac2f7fe640 1 -- 172.21.15.151:0/849590988 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac20003520 con 0x7fac30157770 2023-10-18T11:38:12.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.652+0000 7fac35666640 1 -- 172.21.15.151:0/849590988 >> v2:172.21.15.151:3300/0 conn(0x7fac301510a0 msgr2=0x7fac300c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:12.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.652+0000 7fac35666640 1 --2- 172.21.15.151:0/849590988 >> v2:172.21.15.151:3300/0 conn(0x7fac301510a0 0x7fac300c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.652+0000 7fac35666640 1 -- 172.21.15.151:0/849590988 >> v1:172.21.15.169:6789/0 conn(0x7fac30157770 legacy=0x7fac3006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.652+0000 7fac35666640 1 -- 172.21.15.151:0/849590988 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300c2a90 con 0x7fac300c4e60 2023-10-18T11:38:12.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.655+0000 7fac35666640 1 --2- 172.21.15.151:0/849590988 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac300c4e60 0x7fac300c5290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac280097a0 tx=0x7fac2802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8d4f6c4e7d8eeba server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:12.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.659+0000 7fac2f7fe640 1 -- 172.21.15.151:0/849590988 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28030800 con 0x7fac300c4e60 2023-10-18T11:38:12.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.659+0000 7fac2f7fe640 1 -- 172.21.15.151:0/849590988 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac28030960 con 0x7fac300c4e60 2023-10-18T11:38:12.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.659+0000 7fac2f7fe640 1 -- 172.21.15.151:0/849590988 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28030cf0 con 0x7fac300c4e60 2023-10-18T11:38:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.660+0000 7fac370c9640 1 -- 172.21.15.151:0/849590988 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac300c4e60 msgr2=0x7fac300c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.660+0000 7fac370c9640 1 --2- 172.21.15.151:0/849590988 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac300c4e60 0x7fac300c5290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac280097a0 tx=0x7fac2802b940 comp rx=0 tx=0).stop 2023-10-18T11:38:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.660+0000 7fac370c9640 1 -- 172.21.15.151:0/849590988 shutdown_connections 2023-10-18T11:38:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.660+0000 7fac370c9640 1 --2- 172.21.15.151:0/849590988 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac300c4e60 0x7fac300c5290 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.660+0000 7fac370c9640 1 --2- 172.21.15.151:0/849590988 >> v2:172.21.15.151:3300/0 conn(0x7fac301510a0 0x7fac300c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.660+0000 7fac370c9640 1 -- 172.21.15.151:0/849590988 >> 172.21.15.151:0/849590988 conn(0x7fac30069f70 msgr2=0x7fac3006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:12.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.660+0000 7fac370c9640 1 -- 172.21.15.151:0/849590988 shutdown_connections 2023-10-18T11:38:12.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.660+0000 7fac370c9640 1 -- 172.21.15.151:0/849590988 wait complete. 2023-10-18T11:38:12.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.663+0000 7fac370c9640 1 Processor -- start 2023-10-18T11:38:12.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.663+0000 7fac370c9640 1 -- start start 2023-10-18T11:38:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.664+0000 7fac370c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac300c4e60 0x7fac301f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.664+0000 7fac370c9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac301510a0 0x7fac30071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.664+0000 7fac370c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac30157770 0x7fac300bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.664+0000 7fac370c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac301f2a20 con 0x7fac300c4e60 2023-10-18T11:38:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.664+0000 7fac370c9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac301f21a0 con 0x7fac30157770 2023-10-18T11:38:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.664+0000 7fac370c9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac301f2460 con 0x7fac301510a0 2023-10-18T11:38:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.664+0000 7fac34e65640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac300c4e60 0x7fac301f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.665+0000 7fac35666640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac30157770 0x7fac300bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.665+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac301510a0 0x7fac30071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.665+0000 7fac34e65640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac300c4e60 0x7fac301f1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40820/0 (socket says 172.21.15.151:40820) 2023-10-18T11:38:12.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.665+0000 7fac34e65640 1 -- 172.21.15.151:0/1429544195 learned_addr learned my addr 172.21.15.151:0/1429544195 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:12.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.669+0000 7fac35666640 1 -- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac301510a0 msgr2=0x7fac30071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.669+0000 7fac35666640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac301510a0 0x7fac30071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.669+0000 7fac35666640 1 -- 172.21.15.151:0/1429544195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac300c4e60 msgr2=0x7fac301f1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:12.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.669+0000 7fac35666640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac300c4e60 0x7fac301f1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:12.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.669+0000 7fac35666640 1 -- 172.21.15.151:0/1429544195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28009400 con 0x7fac30157770 2023-10-18T11:38:12.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.669+0000 7fac2ffff640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac301510a0 0x7fac30071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:38:12.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.671+0000 7fac35666640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac30157770 0x7fac300bfc80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fac28033000 tx=0x7fac28004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:12.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.674+0000 7fac2d7fa640 1 -- 172.21.15.151:0/1429544195 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2803e040 con 0x7fac30157770 2023-10-18T11:38:12.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.675+0000 7fac2d7fa640 1 -- 172.21.15.151:0/1429544195 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac28039c30 con 0x7fac30157770 2023-10-18T11:38:12.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.675+0000 7fac2d7fa640 1 -- 172.21.15.151:0/1429544195 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280443f0 con 0x7fac30157770 2023-10-18T11:38:12.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.675+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac301f2740 con 0x7fac30157770 2023-10-18T11:38:12.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.675+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac300bf760 con 0x7fac30157770 2023-10-18T11:38:12.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.676+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac300bf950 con 0x7fac30157770 2023-10-18T11:38:12.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.696+0000 7fac2d7fa640 1 -- 172.21.15.151:0/1429544195 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fac2804d3b0 con 0x7fac30157770 2023-10-18T11:38:12.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.698+0000 7fac2d7fa640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fac1406aec0 0x7fac1406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:12.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.698+0000 7fac34e65640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fac1406aec0 0x7fac1406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:12.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.698+0000 7fac2d7fa640 1 -- 172.21.15.151:0/1429544195 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac2807af50 con 0x7fac30157770 2023-10-18T11:38:12.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.699+0000 7fac34e65640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fac1406aec0 0x7fac1406d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fac2400e250 tx=0x7fac2400b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:12.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:12.945+0000 7fac2d7fa640 1 -- 172.21.15.151:0/1429544195 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac28077290 con 0x7fac30157770 2023-10-18T11:38:13.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.148+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fac300c3050 con 0x7fac1406aec0 2023-10-18T11:38:13.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.149+0000 7fac2d7fa640 1 -- 172.21.15.151:0/1429544195 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fac2400f040 con 0x7fac1406aec0 2023-10-18T11:38:13.152 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 4 to deep-scrub 2023-10-18T11:38:13.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.151+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fac1406aec0 msgr2=0x7fac1406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.151+0000 7fac370c9640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fac1406aec0 0x7fac1406d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fac2400e250 tx=0x7fac2400b040 comp rx=0 tx=0).stop 2023-10-18T11:38:13.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac30157770 msgr2=0x7fac300bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac30157770 0x7fac300bfc80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fac28033000 tx=0x7fac28004730 comp rx=0 tx=0).stop 2023-10-18T11:38:13.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 shutdown_connections 2023-10-18T11:38:13.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fac1406aec0 0x7fac1406d380 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac30157770 0x7fac300bfc80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac301510a0 0x7fac30071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 --2- 172.21.15.151:0/1429544195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac300c4e60 0x7fac301f1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 >> 172.21.15.151:0/1429544195 conn(0x7fac30069f70 msgr2=0x7fac3006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:13.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 shutdown_connections 2023-10-18T11:38:13.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.152+0000 7fac370c9640 1 -- 172.21.15.151:0/1429544195 wait complete. 2023-10-18T11:38:13.174 INFO:tasks.ceph:Scrubbing osd.5 2023-10-18T11:38:13.174 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-18T11:38:13.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.373+0000 7f76591c4640 1 Processor -- start 2023-10-18T11:38:13.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.373+0000 7f76591c4640 1 -- start start 2023-10-18T11:38:13.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.375+0000 7f76591c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f765414feb0 0x7f76540c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.375+0000 7f76591c4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f76540c5a90 0x7f76540c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.375+0000 7f76591c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76540c58c0 con 0x7f765406e230 2023-10-18T11:38:13.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.375+0000 7f76591c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76540c53d0 con 0x7f765414feb0 2023-10-18T11:38:13.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.375+0000 7f76591c4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7654070370 con 0x7f76540c5a90 2023-10-18T11:38:13.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.375+0000 7f76589c3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f76540c5a90 0x7f76540c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.376+0000 7f7653fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f765414feb0 0x7f76540c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.376+0000 7f76589c3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f76540c5a90 0x7f76540c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58970/0 (socket says 172.21.15.151:58970) 2023-10-18T11:38:13.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.376+0000 7f76589c3640 1 -- 172.21.15.151:0/178151054 learned_addr learned my addr 172.21.15.151:0/178151054 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:13.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.378+0000 7f76589c3640 1 -- 172.21.15.151:0/178151054 >> v2:172.21.15.151:3300/0 conn(0x7f765414feb0 msgr2=0x7f76540c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:13.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.378+0000 7f76589c3640 1 --2- 172.21.15.151:0/178151054 >> v2:172.21.15.151:3300/0 conn(0x7f765414feb0 0x7f76540c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.378+0000 7f76589c3640 1 -- 172.21.15.151:0/178151054 >> v1:172.21.15.151:6789/0 conn(0x7f765406e230 legacy=0x7f765406fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.378+0000 7f76589c3640 1 -- 172.21.15.151:0/178151054 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7654071660 con 0x7f76540c5a90 2023-10-18T11:38:13.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.381+0000 7f76589c3640 1 --2- 172.21.15.151:0/178151054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76540c5a90 0x7f76540c3480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7654072310 tx=0x7f764c02bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f9405757f956891 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:13.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.382+0000 7f7652ffd640 1 -- 172.21.15.151:0/178151054 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c02cb20 con 0x7f76540c5a90 2023-10-18T11:38:13.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.384+0000 7f7652ffd640 1 -- 172.21.15.151:0/178151054 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c02cc80 con 0x7f76540c5a90 2023-10-18T11:38:13.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.384+0000 7f7652ffd640 1 -- 172.21.15.151:0/178151054 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0343f0 con 0x7f76540c5a90 2023-10-18T11:38:13.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.385+0000 7f76591c4640 1 -- 172.21.15.151:0/178151054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76540c5a90 msgr2=0x7f76540c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.385+0000 7f76591c4640 1 --2- 172.21.15.151:0/178151054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76540c5a90 0x7f76540c3480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7654072310 tx=0x7f764c02bf80 comp rx=0 tx=0).stop 2023-10-18T11:38:13.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.385+0000 7f76591c4640 1 -- 172.21.15.151:0/178151054 shutdown_connections 2023-10-18T11:38:13.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.385+0000 7f76591c4640 1 --2- 172.21.15.151:0/178151054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76540c5a90 0x7f76540c3480 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.385+0000 7f76591c4640 1 --2- 172.21.15.151:0/178151054 >> v2:172.21.15.151:3300/0 conn(0x7f765414feb0 0x7f76540c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.385+0000 7f76591c4640 1 -- 172.21.15.151:0/178151054 >> 172.21.15.151:0/178151054 conn(0x7f7654069d90 msgr2=0x7f765406a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:13.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.385+0000 7f76591c4640 1 -- 172.21.15.151:0/178151054 shutdown_connections 2023-10-18T11:38:13.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.385+0000 7f76591c4640 1 -- 172.21.15.151:0/178151054 wait complete. 2023-10-18T11:38:13.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.387+0000 7f76591c4640 1 Processor -- start 2023-10-18T11:38:13.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.387+0000 7f76591c4640 1 -- start start 2023-10-18T11:38:13.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.388+0000 7f76591c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f765406e230 0x7f76541f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.388+0000 7f76591c4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76540c5a90 0x7f76541f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.388+0000 7f76591c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f765414feb0 0x7f76541f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.388+0000 7f76591c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76541ef7b0 con 0x7f765406e230 2023-10-18T11:38:13.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.388+0000 7f76591c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76541efa90 con 0x7f765414feb0 2023-10-18T11:38:13.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.388+0000 7f76591c4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76541efd70 con 0x7f76540c5a90 2023-10-18T11:38:13.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.389+0000 7f76589c3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f765414feb0 0x7f76541f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.389+0000 7f7653fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f765406e230 0x7f76541f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.389+0000 7f76537fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76540c5a90 0x7f76541f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.389+0000 7f76589c3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f765414feb0 0x7f76541f0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58984/0 (socket says 172.21.15.151:58984) 2023-10-18T11:38:13.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.389+0000 7f76589c3640 1 -- 172.21.15.151:0/2245933152 learned_addr learned my addr 172.21.15.151:0/2245933152 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:13.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.392+0000 7f76589c3640 1 -- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76540c5a90 msgr2=0x7f76541f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.392+0000 7f76589c3640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76540c5a90 0x7f76541f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.392+0000 7f76589c3640 1 -- 172.21.15.151:0/2245933152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f765406e230 msgr2=0x7f76541f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.392+0000 7f76589c3640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f765406e230 0x7f76541f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.392+0000 7f76589c3640 1 -- 172.21.15.151:0/2245933152 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c009b30 con 0x7f765414feb0 2023-10-18T11:38:13.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.395+0000 7f76589c3640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f765414feb0 0x7f76541f0850 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f764c036040 tx=0x7f764c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:13.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.399+0000 7f7650ff9640 1 -- 172.21.15.151:0/2245933152 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c009510 con 0x7f765414feb0 2023-10-18T11:38:13.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.399+0000 7f7650ff9640 1 -- 172.21.15.151:0/2245933152 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c02c920 con 0x7f765414feb0 2023-10-18T11:38:13.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.399+0000 7f7650ff9640 1 -- 172.21.15.151:0/2245933152 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c03e690 con 0x7f765414feb0 2023-10-18T11:38:13.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.399+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76541f0050 con 0x7f765414feb0 2023-10-18T11:38:13.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.399+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76541568a0 con 0x7f765414feb0 2023-10-18T11:38:13.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.400+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76541efc00 con 0x7f765414feb0 2023-10-18T11:38:13.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.420+0000 7f7650ff9640 1 -- 172.21.15.151:0/2245933152 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f764c03e7f0 con 0x7f765414feb0 2023-10-18T11:38:13.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.422+0000 7f7650ff9640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f764006aec0 0x7f764006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.422+0000 7f7650ff9640 1 -- 172.21.15.151:0/2245933152 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f764c0ac7b0 con 0x7f765414feb0 2023-10-18T11:38:13.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.423+0000 7f7653fff640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f764006aec0 0x7f764006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.423+0000 7f7650ff9640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7f7640074820 0x7f7640076cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.423+0000 7f7650ff9640 1 -- 172.21.15.151:0/2245933152 --> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7640077390 con 0x7f7640074820 2023-10-18T11:38:13.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.423+0000 7f7650ff9640 1 -- 172.21.15.151:0/2245933152 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f764c0acc50 con 0x7f765414feb0 2023-10-18T11:38:13.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.423+0000 7f76537fe640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7f7640074820 0x7f7640076cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.424+0000 7f7653fff640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f764006aec0 0x7f764006d380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7644009b40 tx=0x7f7644009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:13.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.424+0000 7f76537fe640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7f7640074820 0x7f7640076cc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:13.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.425+0000 7f7650ff9640 1 -- 172.21.15.151:0/2245933152 <== osd.5 v2:172.21.15.169:6808/2415009442 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7640077390 con 0x7f7640074820 2023-10-18T11:38:13.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.441+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 --> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7654159d00 con 0x7f7640074820 2023-10-18T11:38:13.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.441+0000 7f7650ff9640 1 -- 172.21.15.151:0/2245933152 <== osd.5 v2:172.21.15.169:6808/2415009442 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7648001400 con 0x7f7640074820 2023-10-18T11:38:13.444 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:38:13.444 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T11:38:13.444 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:38:13.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.442+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7f7640074820 msgr2=0x7f7640076cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.442+0000 7f76591c4640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6808/2415009442,v1:172.21.15.169:6810/2415009442] conn(0x7f7640074820 0x7f7640076cc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.443+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f764006aec0 msgr2=0x7f764006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.443+0000 7f76591c4640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f764006aec0 0x7f764006d380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7644009b40 tx=0x7f7644009190 comp rx=0 tx=0).stop 2023-10-18T11:38:13.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.443+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f765414feb0 msgr2=0x7f76541f0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.443+0000 7f76591c4640 1 --2- 172.21.15.151:0/2245933152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f765414feb0 0x7f76541f0850 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f764c036040 tx=0x7f764c004a40 comp rx=0 tx=0).stop 2023-10-18T11:38:13.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.443+0000 7f76589c3640 1 -- 172.21.15.151:0/2245933152 reap_dead start 2023-10-18T11:38:13.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.443+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 shutdown_connections 2023-10-18T11:38:13.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.443+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 >> 172.21.15.151:0/2245933152 conn(0x7f7654069d90 msgr2=0x7f765406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.443+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 shutdown_connections 2023-10-18T11:38:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.443+0000 7f76591c4640 1 -- 172.21.15.151:0/2245933152 wait complete. 2023-10-18T11:38:13.463 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-18T11:38:13.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.674+0000 7f84e4e64640 1 Processor -- start 2023-10-18T11:38:13.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.675+0000 7f84e4e64640 1 -- start start 2023-10-18T11:38:13.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.676+0000 7f84e4e64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 0x7f84e0070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.676+0000 7f84e4e64640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f84e00c8bc0 0x7f84e015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.676+0000 7f84e4e64640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f84e0157a30 0x7f84e00c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.676+0000 7f84e4e64640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e00c7410 con 0x7f84e00c8bc0 2023-10-18T11:38:13.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.676+0000 7f84e4e64640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e01515a0 con 0x7f84e0157a30 2023-10-18T11:38:13.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.676+0000 7f84e4e64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00c60f0 con 0x7f84e01511c0 2023-10-18T11:38:13.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.677+0000 7f84ded9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f84e0157a30 0x7f84e00c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.677+0000 7f84ddd9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f84e00c8bc0 0x7f84e015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.677+0000 7f84de59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 0x7f84e0070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.677+0000 7f84ded9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f84e0157a30 0x7f84e00c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:58996/0 (socket says 172.21.15.151:58996) 2023-10-18T11:38:13.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.677+0000 7f84ded9d640 1 -- 172.21.15.151:0/134993223 learned_addr learned my addr 172.21.15.151:0/134993223 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:13.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.679+0000 7f84de59c640 1 -- 172.21.15.151:0/134993223 >> v2:172.21.15.169:3300/0 conn(0x7f84e0157a30 msgr2=0x7f84e00c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:13.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.679+0000 7f84de59c640 1 --2- 172.21.15.151:0/134993223 >> v2:172.21.15.169:3300/0 conn(0x7f84e0157a30 0x7f84e00c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.679+0000 7f84de59c640 1 -- 172.21.15.151:0/134993223 >> v2:172.21.15.151:3300/0 conn(0x7f84e00c8bc0 msgr2=0x7f84e015a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:13.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.679+0000 7f84de59c640 1 --2- 172.21.15.151:0/134993223 >> v2:172.21.15.151:3300/0 conn(0x7f84e00c8bc0 0x7f84e015a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.679+0000 7f84de59c640 1 -- 172.21.15.151:0/134993223 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e00c63d0 con 0x7f84e01511c0 2023-10-18T11:38:13.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.682+0000 7f84de59c640 1 --2- 172.21.15.151:0/134993223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 0x7f84e0070e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84e00c87e0 tx=0x7f84d002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af39685f0727f38 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:13.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.686+0000 7f84dd59a640 1 -- 172.21.15.151:0/134993223 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0031830 con 0x7f84e01511c0 2023-10-18T11:38:13.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.686+0000 7f84dd59a640 1 -- 172.21.15.151:0/134993223 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d0031990 con 0x7f84e01511c0 2023-10-18T11:38:13.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.686+0000 7f84dd59a640 1 -- 172.21.15.151:0/134993223 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0031d20 con 0x7f84e01511c0 2023-10-18T11:38:13.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.687+0000 7f84e4e64640 1 -- 172.21.15.151:0/134993223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 msgr2=0x7f84e0070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.687+0000 7f84e4e64640 1 --2- 172.21.15.151:0/134993223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 0x7f84e0070e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84e00c87e0 tx=0x7f84d002b8d0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.687+0000 7f84e4e64640 1 -- 172.21.15.151:0/134993223 shutdown_connections 2023-10-18T11:38:13.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.687+0000 7f84e4e64640 1 --2- 172.21.15.151:0/134993223 >> v2:172.21.15.151:3300/0 conn(0x7f84e00c8bc0 0x7f84e015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.687+0000 7f84e4e64640 1 --2- 172.21.15.151:0/134993223 >> v2:172.21.15.169:3300/0 conn(0x7f84e0157a30 0x7f84e00c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.687+0000 7f84e4e64640 1 --2- 172.21.15.151:0/134993223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 0x7f84e0070e00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.687+0000 7f84e4e64640 1 -- 172.21.15.151:0/134993223 >> 172.21.15.151:0/134993223 conn(0x7f84e006b080 msgr2=0x7f84e006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:13.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.687+0000 7f84e4e64640 1 -- 172.21.15.151:0/134993223 shutdown_connections 2023-10-18T11:38:13.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.687+0000 7f84e4e64640 1 -- 172.21.15.151:0/134993223 wait complete. 2023-10-18T11:38:13.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.690+0000 7f84e4e64640 1 Processor -- start 2023-10-18T11:38:13.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.690+0000 7f84e4e64640 1 -- start start 2023-10-18T11:38:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.691+0000 7f84e4e64640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84e00c8bc0 0x7f84e01f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.691+0000 7f84e4e64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 0x7f84e01eed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.691+0000 7f84e4e64640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84e0157a30 0x7f84e006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.691+0000 7f84e4e64640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e01f28b0 con 0x7f84e0157a30 2023-10-18T11:38:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.691+0000 7f84e4e64640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e0158b00 con 0x7f84e00c8bc0 2023-10-18T11:38:13.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.691+0000 7f84e4e64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e0158da0 con 0x7f84e01511c0 2023-10-18T11:38:13.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.692+0000 7f84de59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84e00c8bc0 0x7f84e01f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.692+0000 7f84ded9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84e0157a30 0x7f84e006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.692+0000 7f84de59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84e00c8bc0 0x7f84e01f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:59010/0 (socket says 172.21.15.151:59010) 2023-10-18T11:38:13.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.693+0000 7f84de59c640 1 -- 172.21.15.151:0/4206089542 learned_addr learned my addr 172.21.15.151:0/4206089542 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:13.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.693+0000 7f84ddd9b640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 0x7f84e01eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.696+0000 7f84de59c640 1 -- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 msgr2=0x7f84e01eed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.696+0000 7f84de59c640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 0x7f84e01eed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.696+0000 7f84de59c640 1 -- 172.21.15.151:0/4206089542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84e0157a30 msgr2=0x7f84e006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:13.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.696+0000 7f84de59c640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84e0157a30 0x7f84e006e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:13.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.696+0000 7f84de59c640 1 -- 172.21.15.151:0/4206089542 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d0009400 con 0x7f84e00c8bc0 2023-10-18T11:38:13.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.698+0000 7f84de59c640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84e00c8bc0 0x7f84e01f2370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f84d00098c0 tx=0x7f84d00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.702+0000 7f84d6ffd640 1 -- 172.21.15.151:0/4206089542 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d003a630 con 0x7f84e00c8bc0 2023-10-18T11:38:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.702+0000 7f84d6ffd640 1 -- 172.21.15.151:0/4206089542 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d003a7b0 con 0x7f84e00c8bc0 2023-10-18T11:38:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.702+0000 7f84d6ffd640 1 -- 172.21.15.151:0/4206089542 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d003ab60 con 0x7f84e00c8bc0 2023-10-18T11:38:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.702+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e0159080 con 0x7f84e00c8bc0 2023-10-18T11:38:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.702+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e01ee830 con 0x7f84e00c8bc0 2023-10-18T11:38:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.703+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e004e160 con 0x7f84e00c8bc0 2023-10-18T11:38:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.723+0000 7f84d6ffd640 1 -- 172.21.15.151:0/4206089542 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f84d003acc0 con 0x7f84e00c8bc0 2023-10-18T11:38:13.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.724+0000 7f84d6ffd640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f84c006aec0 0x7f84c006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:13.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.724+0000 7f84d6ffd640 1 -- 172.21.15.151:0/4206089542 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f84d00aba20 con 0x7f84e00c8bc0 2023-10-18T11:38:13.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.725+0000 7f84ddd9b640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f84c006aec0 0x7f84c006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:13.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.725+0000 7f84ddd9b640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f84c006aec0 0x7f84c006d380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84e00c3a60 tx=0x7f84c8009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:13.971+0000 7f84d6ffd640 1 -- 172.21.15.151:0/4206089542 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84d0076a50 con 0x7f84e00c8bc0 2023-10-18T11:38:14.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.199+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f84e0157230 con 0x7f84c006aec0 2023-10-18T11:38:14.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.200+0000 7f84d6ffd640 1 -- 172.21.15.151:0/4206089542 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f84c8004030 con 0x7f84c006aec0 2023-10-18T11:38:14.202 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 5 to deep-scrub 2023-10-18T11:38:14.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.203+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f84c006aec0 msgr2=0x7f84c006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.203+0000 7f84e4e64640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f84c006aec0 0x7f84c006d380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84e00c3a60 tx=0x7f84c8009190 comp rx=0 tx=0).stop 2023-10-18T11:38:14.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.203+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84e00c8bc0 msgr2=0x7f84e01f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.203+0000 7f84e4e64640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84e00c8bc0 0x7f84e01f2370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f84d00098c0 tx=0x7f84d00046c0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.204+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 shutdown_connections 2023-10-18T11:38:14.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.204+0000 7f84e4e64640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84e0157a30 0x7f84e006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.204+0000 7f84e4e64640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84e01511c0 0x7f84e01eed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.204+0000 7f84e4e64640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f84c006aec0 0x7f84c006d380 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.204+0000 7f84e4e64640 1 --2- 172.21.15.151:0/4206089542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84e00c8bc0 0x7f84e01f2370 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.204+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 >> 172.21.15.151:0/4206089542 conn(0x7f84e006b080 msgr2=0x7f84e01503a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:14.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.204+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 shutdown_connections 2023-10-18T11:38:14.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.204+0000 7f84e4e64640 1 -- 172.21.15.151:0/4206089542 wait complete. 2023-10-18T11:38:14.225 INFO:tasks.ceph:Scrubbing osd.6 2023-10-18T11:38:14.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-18T11:38:14.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.430+0000 7f6a27cc9640 1 Processor -- start 2023-10-18T11:38:14.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.431+0000 7f6a27cc9640 1 -- start start 2023-10-18T11:38:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.432+0000 7f6a27cc9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6a2014fe20 0x7f6a201566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.432+0000 7f6a27cc9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6a20070790 0x7f6a200c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.432+0000 7f6a27cc9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a200c18e0 con 0x7f6a20070ee0 2023-10-18T11:38:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.432+0000 7f6a27cc9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a200c5350 con 0x7f6a20070790 2023-10-18T11:38:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.432+0000 7f6a27cc9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a200c20f0 con 0x7f6a2014fe20 2023-10-18T11:38:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.433+0000 7f6a25a65640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6a2014fe20 0x7f6a201566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.433+0000 7f6a25264640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6a20070790 0x7f6a200c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.433+0000 7f6a25a65640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6a2014fe20 0x7f6a201566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:59018/0 (socket says 172.21.15.151:59018) 2023-10-18T11:38:14.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.433+0000 7f6a25a65640 1 -- 172.21.15.151:0/2595618316 learned_addr learned my addr 172.21.15.151:0/2595618316 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.436+0000 7f6a25a65640 1 -- 172.21.15.151:0/2595618316 >> v2:172.21.15.151:3300/0 conn(0x7f6a20070790 msgr2=0x7f6a200c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.436+0000 7f6a25a65640 1 --2- 172.21.15.151:0/2595618316 >> v2:172.21.15.151:3300/0 conn(0x7f6a20070790 0x7f6a200c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.436+0000 7f6a25a65640 1 -- 172.21.15.151:0/2595618316 >> v1:172.21.15.169:6789/0 conn(0x7f6a20070ee0 legacy=0x7f6a200718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.436+0000 7f6a25a65640 1 -- 172.21.15.151:0/2595618316 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200c1b30 con 0x7f6a2014fe20 2023-10-18T11:38:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.439+0000 7f6a25a65640 1 --2- 172.21.15.151:0/2595618316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a2014fe20 0x7f6a201566f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6a200c7bf0 tx=0x7f6a1402e180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afbdb4ac604d40d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.443+0000 7f6a24a63640 1 -- 172.21.15.151:0/2595618316 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400b0d0 con 0x7f6a2014fe20 2023-10-18T11:38:14.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.443+0000 7f6a24a63640 1 -- 172.21.15.151:0/2595618316 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1400b230 con 0x7f6a2014fe20 2023-10-18T11:38:14.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.443+0000 7f6a24a63640 1 -- 172.21.15.151:0/2595618316 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14009600 con 0x7f6a2014fe20 2023-10-18T11:38:14.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.444+0000 7f6a27cc9640 1 -- 172.21.15.151:0/2595618316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a2014fe20 msgr2=0x7f6a201566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.444+0000 7f6a27cc9640 1 --2- 172.21.15.151:0/2595618316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a2014fe20 0x7f6a201566f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6a200c7bf0 tx=0x7f6a1402e180 comp rx=0 tx=0).stop 2023-10-18T11:38:14.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.444+0000 7f6a27cc9640 1 -- 172.21.15.151:0/2595618316 shutdown_connections 2023-10-18T11:38:14.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.444+0000 7f6a27cc9640 1 --2- 172.21.15.151:0/2595618316 >> v2:172.21.15.151:3300/0 conn(0x7f6a20070790 0x7f6a200c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.444+0000 7f6a27cc9640 1 --2- 172.21.15.151:0/2595618316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a2014fe20 0x7f6a201566f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.444+0000 7f6a27cc9640 1 -- 172.21.15.151:0/2595618316 >> 172.21.15.151:0/2595618316 conn(0x7f6a20069f70 msgr2=0x7f6a2006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.444+0000 7f6a27cc9640 1 -- 172.21.15.151:0/2595618316 shutdown_connections 2023-10-18T11:38:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.444+0000 7f6a27cc9640 1 -- 172.21.15.151:0/2595618316 wait complete. 2023-10-18T11:38:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.446+0000 7f6a27cc9640 1 Processor -- start 2023-10-18T11:38:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.446+0000 7f6a27cc9640 1 -- start start 2023-10-18T11:38:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.447+0000 7f6a27cc9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a20070790 0x7f6a20153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.447+0000 7f6a27cc9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a20070ee0 0x7f6a201f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.447+0000 7f6a27cc9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a2014fe20 0x7f6a201eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.447+0000 7f6a27cc9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a201ee810 con 0x7f6a2014fe20 2023-10-18T11:38:14.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.447+0000 7f6a27cc9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a201ee200 con 0x7f6a20070790 2023-10-18T11:38:14.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.447+0000 7f6a27cc9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20154460 con 0x7f6a20070ee0 2023-10-18T11:38:14.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.448+0000 7f6a26266640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a2014fe20 0x7f6a201eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.448+0000 7f6a25a65640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a20070790 0x7f6a20153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.448+0000 7f6a25264640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a20070ee0 0x7f6a201f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.448+0000 7f6a25a65640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a20070790 0x7f6a20153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:59024/0 (socket says 172.21.15.151:59024) 2023-10-18T11:38:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.448+0000 7f6a25a65640 1 -- 172.21.15.151:0/1861491262 learned_addr learned my addr 172.21.15.151:0/1861491262 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.448+0000 7f6a26266640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a2014fe20 0x7f6a201eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40880/0 (socket says 172.21.15.151:40880) 2023-10-18T11:38:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.451+0000 7f6a25a65640 1 -- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a20070ee0 msgr2=0x7f6a201f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.451+0000 7f6a25a65640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a20070ee0 0x7f6a201f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.451+0000 7f6a25a65640 1 -- 172.21.15.151:0/1861491262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a2014fe20 msgr2=0x7f6a201eeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.451+0000 7f6a25a65640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a2014fe20 0x7f6a201eeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.451+0000 7f6a25a65640 1 -- 172.21.15.151:0/1861491262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1400bd40 con 0x7f6a20070790 2023-10-18T11:38:14.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.453+0000 7f6a25a65640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a20070790 0x7f6a20153210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6a14038040 tx=0x7f6a14004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.457+0000 7f6a1e7fc640 1 -- 172.21.15.151:0/1861491262 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14036800 con 0x7f6a20070790 2023-10-18T11:38:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.457+0000 7f6a1e7fc640 1 -- 172.21.15.151:0/1861491262 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14036980 con 0x7f6a20070790 2023-10-18T11:38:14.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.457+0000 7f6a1e7fc640 1 -- 172.21.15.151:0/1861491262 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14036d30 con 0x7f6a20070790 2023-10-18T11:38:14.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.457+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a20154740 con 0x7f6a20070790 2023-10-18T11:38:14.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.457+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a20154a20 con 0x7f6a20070790 2023-10-18T11:38:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.458+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a200c4fe0 con 0x7f6a20070790 2023-10-18T11:38:14.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.479+0000 7f6a1e7fc640 1 -- 172.21.15.151:0/1861491262 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6a1404a460 con 0x7f6a20070790 2023-10-18T11:38:14.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.481+0000 7f6a1e7fc640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6a0406aec0 0x7f6a0406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.481+0000 7f6a1e7fc640 1 -- 172.21.15.151:0/1861491262 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6a1407c050 con 0x7f6a20070790 2023-10-18T11:38:14.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.481+0000 7f6a25264640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6a0406aec0 0x7f6a0406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.482+0000 7f6a1e7fc640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7f6a040747a0 0x7f6a04076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.482+0000 7f6a1e7fc640 1 -- 172.21.15.151:0/1861491262 --> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a04077310 con 0x7f6a040747a0 2023-10-18T11:38:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.482+0000 7f6a1e7fc640 1 -- 172.21.15.151:0/1861491262 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a14036e90 con 0x7f6a20070790 2023-10-18T11:38:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.482+0000 7f6a26266640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7f6a040747a0 0x7f6a04076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.483+0000 7f6a25264640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6a0406aec0 0x7f6a0406d380 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a20153750 tx=0x7f6a0c009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:14.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.483+0000 7f6a26266640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7f6a040747a0 0x7f6a04076c40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:14.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.483+0000 7f6a1e7fc640 1 -- 172.21.15.151:0/1861491262 <== osd.6 v2:172.21.15.169:6809/1118238952 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6a04077310 con 0x7f6a040747a0 2023-10-18T11:38:14.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.498+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 --> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a200c1e10 con 0x7f6a040747a0 2023-10-18T11:38:14.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.499+0000 7f6a1e7fc640 1 -- 172.21.15.151:0/1861491262 <== osd.6 v2:172.21.15.169:6809/1118238952 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6a18001420 con 0x7f6a040747a0 2023-10-18T11:38:14.501 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:38:14.502 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T11:38:14.502 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:38:14.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.499+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7f6a040747a0 msgr2=0x7f6a04076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.499+0000 7f6a27cc9640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6809/1118238952,v1:172.21.15.169:6811/1118238952] conn(0x7f6a040747a0 0x7f6a04076c40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.500+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6a0406aec0 msgr2=0x7f6a0406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.500+0000 7f6a27cc9640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6a0406aec0 0x7f6a0406d380 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a20153750 tx=0x7f6a0c009190 comp rx=0 tx=0).stop 2023-10-18T11:38:14.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.500+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a20070790 msgr2=0x7f6a20153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.500+0000 7f6a27cc9640 1 --2- 172.21.15.151:0/1861491262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a20070790 0x7f6a20153210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6a14038040 tx=0x7f6a14004a40 comp rx=0 tx=0).stop 2023-10-18T11:38:14.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.500+0000 7f6a26266640 1 -- 172.21.15.151:0/1861491262 reap_dead start 2023-10-18T11:38:14.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.500+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 shutdown_connections 2023-10-18T11:38:14.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.500+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 >> 172.21.15.151:0/1861491262 conn(0x7f6a20069f70 msgr2=0x7f6a2006d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:14.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.500+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 shutdown_connections 2023-10-18T11:38:14.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.500+0000 7f6a27cc9640 1 -- 172.21.15.151:0/1861491262 wait complete. 2023-10-18T11:38:14.521 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-18T11:38:14.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.729+0000 7fd7eaefc640 1 Processor -- start 2023-10-18T11:38:14.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.729+0000 7fd7eaefc640 1 -- start start 2023-10-18T11:38:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.731+0000 7fd7eaefc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.731+0000 7fd7eaefc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd7e4071800 0x7fd7e4071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.731+0000 7fd7eaefc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e40c53c0 con 0x7fd7e40c4fe0 2023-10-18T11:38:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.731+0000 7fd7eaefc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e40c7f40 con 0x7fd7e4071800 2023-10-18T11:38:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.731+0000 7fd7eaefc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40c8220 con 0x7fd7e406e730 2023-10-18T11:38:14.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.732+0000 7fd7e8c98640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd7e40c4fe0 0x7fd7e4069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47292/0 (socket says 172.21.15.151:47292) 2023-10-18T11:38:14.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.732+0000 7fd7e8c98640 1 -- 172.21.15.151:0/1167690821 learned_addr learned my addr 172.21.15.151:0/1167690821 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:14.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.732+0000 7fd7e3fff640 1 --2- 172.21.15.151:0/1167690821 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.732+0000 7fd7e9499640 1 --2- 172.21.15.151:0/1167690821 >> v2:172.21.15.151:3300/0 conn(0x7fd7e4071800 0x7fd7e4071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.734+0000 7fd7e37fe640 1 -- 172.21.15.151:0/1167690821 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025349162 0 0) 0x7fd7e40c53c0 con 0x7fd7e40c4fe0 2023-10-18T11:38:14.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.734+0000 7fd7e37fe640 1 -- 172.21.15.151:0/1167690821 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d0003520 con 0x7fd7e40c4fe0 2023-10-18T11:38:14.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.734+0000 7fd7e3fff640 1 -- 172.21.15.151:0/1167690821 >> v2:172.21.15.151:3300/0 conn(0x7fd7e4071800 msgr2=0x7fd7e4071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:14.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.734+0000 7fd7e3fff640 1 --2- 172.21.15.151:0/1167690821 >> v2:172.21.15.151:3300/0 conn(0x7fd7e4071800 0x7fd7e4071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.735+0000 7fd7e3fff640 1 -- 172.21.15.151:0/1167690821 >> v1:172.21.15.169:6789/0 conn(0x7fd7e40c4fe0 legacy=0x7fd7e4069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.735+0000 7fd7e3fff640 1 -- 172.21.15.151:0/1167690821 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40c8500 con 0x7fd7e406e730 2023-10-18T11:38:14.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.737+0000 7fd7e3fff640 1 --2- 172.21.15.151:0/1167690821 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e406eb50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0097a0 tx=0x7fd7cc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6883c791a56c21c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:14.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.739+0000 7fd7e37fe640 1 -- 172.21.15.151:0/1167690821 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc030610 con 0x7fd7e406e730 2023-10-18T11:38:14.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.741+0000 7fd7e37fe640 1 -- 172.21.15.151:0/1167690821 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc030770 con 0x7fd7e406e730 2023-10-18T11:38:14.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.741+0000 7fd7e37fe640 1 -- 172.21.15.151:0/1167690821 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc030ae0 con 0x7fd7e406e730 2023-10-18T11:38:14.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.742+0000 7fd7eaefc640 1 -- 172.21.15.151:0/1167690821 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 msgr2=0x7fd7e406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.742+0000 7fd7eaefc640 1 --2- 172.21.15.151:0/1167690821 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e406eb50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0097a0 tx=0x7fd7cc02b960 comp rx=0 tx=0).stop 2023-10-18T11:38:14.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.742+0000 7fd7eaefc640 1 -- 172.21.15.151:0/1167690821 shutdown_connections 2023-10-18T11:38:14.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.742+0000 7fd7eaefc640 1 --2- 172.21.15.151:0/1167690821 >> v2:172.21.15.151:3300/0 conn(0x7fd7e4071800 0x7fd7e4071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.742+0000 7fd7eaefc640 1 --2- 172.21.15.151:0/1167690821 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e406eb50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.742+0000 7fd7eaefc640 1 -- 172.21.15.151:0/1167690821 >> 172.21.15.151:0/1167690821 conn(0x7fd7e406b080 msgr2=0x7fd7e406b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:14.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.742+0000 7fd7eaefc640 1 -- 172.21.15.151:0/1167690821 shutdown_connections 2023-10-18T11:38:14.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.742+0000 7fd7eaefc640 1 -- 172.21.15.151:0/1167690821 wait complete. 2023-10-18T11:38:14.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.743+0000 7fd7eaefc640 1 Processor -- start 2023-10-18T11:38:14.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.744+0000 7fd7eaefc640 1 -- start start 2023-10-18T11:38:14.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.744+0000 7fd7eaefc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e4158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.744+0000 7fd7eaefc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7e4071800 0x7fd7e4153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.745+0000 7fd7eaefc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e40c4fe0 0x7fd7e40bc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.745+0000 7fd7eaefc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4158e50 con 0x7fd7e40c4fe0 2023-10-18T11:38:14.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.745+0000 7fd7eaefc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41f2210 con 0x7fd7e4071800 2023-10-18T11:38:14.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.745+0000 7fd7eaefc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4159070 con 0x7fd7e406e730 2023-10-18T11:38:14.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.745+0000 7fd7e9499640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e40c4fe0 0x7fd7e40bc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.745+0000 7fd7e3fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7e4071800 0x7fd7e4153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.745+0000 7fd7e8c98640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e4158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.746+0000 7fd7e9499640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e40c4fe0 0x7fd7e40bc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40906/0 (socket says 172.21.15.151:40906) 2023-10-18T11:38:14.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.746+0000 7fd7e9499640 1 -- 172.21.15.151:0/3156445889 learned_addr learned my addr 172.21.15.151:0/3156445889 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:14.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.749+0000 7fd7e8c98640 1 -- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7e4071800 msgr2=0x7fd7e4153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.749+0000 7fd7e8c98640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7e4071800 0x7fd7e4153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.749+0000 7fd7e8c98640 1 -- 172.21.15.151:0/3156445889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e40c4fe0 msgr2=0x7fd7e40bc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:14.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.749+0000 7fd7e8c98640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e40c4fe0 0x7fd7e40bc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:14.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.749+0000 7fd7e8c98640 1 -- 172.21.15.151:0/3156445889 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc009400 con 0x7fd7e406e730 2023-10-18T11:38:14.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.751+0000 7fd7e8c98640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e4158910 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400cad0 tx=0x7fd7d400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:14.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.755+0000 7fd7e17fa640 1 -- 172.21.15.151:0/3156445889 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d400ac30 con 0x7fd7e406e730 2023-10-18T11:38:14.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.755+0000 7fd7e17fa640 1 -- 172.21.15.151:0/3156445889 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d400ad90 con 0x7fd7e406e730 2023-10-18T11:38:14.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.755+0000 7fd7e17fa640 1 -- 172.21.15.151:0/3156445889 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4012600 con 0x7fd7e406e730 2023-10-18T11:38:14.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.755+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e41f1600 con 0x7fd7e406e730 2023-10-18T11:38:14.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.755+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e41f1bc0 con 0x7fd7e406e730 2023-10-18T11:38:14.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.756+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e41f23a0 con 0x7fd7e406e730 2023-10-18T11:38:14.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.774+0000 7fd7e17fa640 1 -- 172.21.15.151:0/3156445889 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd7d4007070 con 0x7fd7e406e730 2023-10-18T11:38:14.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.775+0000 7fd7e17fa640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd7c406aef0 0x7fd7c406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:14.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.776+0000 7fd7e3fff640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd7c406aef0 0x7fd7c406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:14.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.776+0000 7fd7e3fff640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd7c406aef0 0x7fd7c406d3b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc036000 tx=0x7fd7cc008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:14.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:14.777+0000 7fd7e17fa640 1 -- 172.21.15.151:0/3156445889 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd7d4058760 con 0x7fd7e406e730 2023-10-18T11:38:15.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.014+0000 7fd7e17fa640 1 -- 172.21.15.151:0/3156445889 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd7d4054aa0 con 0x7fd7e406e730 2023-10-18T11:38:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.215+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7e40c8ac0 con 0x7fd7c406aef0 2023-10-18T11:38:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.217+0000 7fd7e17fa640 1 -- 172.21.15.151:0/3156445889 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd7cc040040 con 0x7fd7c406aef0 2023-10-18T11:38:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 6 to deep-scrub 2023-10-18T11:38:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd7c406aef0 msgr2=0x7fd7c406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd7c406aef0 0x7fd7c406d3b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc036000 tx=0x7fd7cc008030 comp rx=0 tx=0).stop 2023-10-18T11:38:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 msgr2=0x7fd7e4158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e4158910 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400cad0 tx=0x7fd7d400cf90 comp rx=0 tx=0).stop 2023-10-18T11:38:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 shutdown_connections 2023-10-18T11:38:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e40c4fe0 0x7fd7e40bc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd7c406aef0 0x7fd7c406d3b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7e4071800 0x7fd7e4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 --2- 172.21.15.151:0/3156445889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e406e730 0x7fd7e4158910 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 >> 172.21.15.151:0/3156445889 conn(0x7fd7e406b080 msgr2=0x7fd7e40ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:15.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.219+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 shutdown_connections 2023-10-18T11:38:15.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.220+0000 7fd7eaefc640 1 -- 172.21.15.151:0/3156445889 wait complete. 2023-10-18T11:38:15.240 INFO:tasks.ceph:Scrubbing osd.7 2023-10-18T11:38:15.241 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-18T11:38:15.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.449+0000 7f460ffff640 1 Processor -- start 2023-10-18T11:38:15.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.449+0000 7f460ffff640 1 -- start start 2023-10-18T11:38:15.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.450+0000 7f460ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610069d90 0x7f461015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.451+0000 7f460ffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4610157be0 con 0x7f4610157750 2023-10-18T11:38:15.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.451+0000 7f460ffff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46100c8100 con 0x7f4610150c50 2023-10-18T11:38:15.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.451+0000 7f460ffff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46100c8360 con 0x7f4610069d90 2023-10-18T11:38:15.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.451+0000 7f460e7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610069d90 0x7f461015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.451+0000 7f460effd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f4610150c50 0x7f461006d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47294/0 (socket says 172.21.15.151:47294) 2023-10-18T11:38:15.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.451+0000 7f460effd640 1 -- 172.21.15.151:0/314087211 learned_addr learned my addr 172.21.15.151:0/314087211 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:15.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.454+0000 7f460e7fc640 1 -- 172.21.15.151:0/314087211 >> v1:172.21.15.169:6789/0 conn(0x7f4610150c50 legacy=0x7f461006d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.454+0000 7f460e7fc640 1 -- 172.21.15.151:0/314087211 >> v1:172.21.15.151:6789/0 conn(0x7f4610157750 legacy=0x7f4610161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:15.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.454+0000 7f460e7fc640 1 -- 172.21.15.151:0/314087211 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100c8640 con 0x7f4610069d90 2023-10-18T11:38:15.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.456+0000 7f460e7fc640 1 --2- 172.21.15.151:0/314087211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610069d90 0x7f461015a1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45f80097d0 tx=0x7f45f802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e290ce9d1799caeb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:15.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.514+0000 7f460dffb640 1 -- 172.21.15.151:0/314087211 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8031890 con 0x7f4610069d90 2023-10-18T11:38:15.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.515+0000 7f460dffb640 1 -- 172.21.15.151:0/314087211 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f80319f0 con 0x7f4610069d90 2023-10-18T11:38:15.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.515+0000 7f460dffb640 1 -- 172.21.15.151:0/314087211 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8031d80 con 0x7f4610069d90 2023-10-18T11:38:15.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.516+0000 7f460ffff640 1 -- 172.21.15.151:0/314087211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610069d90 msgr2=0x7f461015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.516+0000 7f460ffff640 1 --2- 172.21.15.151:0/314087211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610069d90 0x7f461015a1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45f80097d0 tx=0x7f45f802b930 comp rx=0 tx=0).stop 2023-10-18T11:38:15.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.516+0000 7f460ffff640 1 -- 172.21.15.151:0/314087211 shutdown_connections 2023-10-18T11:38:15.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.516+0000 7f460ffff640 1 --2- 172.21.15.151:0/314087211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610069d90 0x7f461015a1f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.516+0000 7f460ffff640 1 -- 172.21.15.151:0/314087211 >> 172.21.15.151:0/314087211 conn(0x7f461006c860 msgr2=0x7f461006cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:15.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.516+0000 7f460ffff640 1 -- 172.21.15.151:0/314087211 shutdown_connections 2023-10-18T11:38:15.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.516+0000 7f460ffff640 1 -- 172.21.15.151:0/314087211 wait complete. 2023-10-18T11:38:15.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.519+0000 7f460ffff640 1 Processor -- start 2023-10-18T11:38:15.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.519+0000 7f460ffff640 1 -- start start 2023-10-18T11:38:15.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.521+0000 7f460ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4610069d90 0x7f4610147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.521+0000 7f460ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610150c50 0x7f46101e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.521+0000 7f460ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4610157750 0x7f46101e2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.521+0000 7f460ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4610154590 con 0x7f4610069d90 2023-10-18T11:38:15.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.521+0000 7f460ffff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4610152e50 con 0x7f4610157750 2023-10-18T11:38:15.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.521+0000 7f460ffff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461014f820 con 0x7f4610150c50 2023-10-18T11:38:15.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.522+0000 7f460e7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610150c50 0x7f46101e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.522+0000 7f460f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4610157750 0x7f46101e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.522+0000 7f460e7fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610150c50 0x7f46101e1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41978/0 (socket says 172.21.15.151:41978) 2023-10-18T11:38:15.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.522+0000 7f460e7fc640 1 -- 172.21.15.151:0/3193238992 learned_addr learned my addr 172.21.15.151:0/3193238992 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:15.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.524+0000 7f460effd640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4610069d90 0x7f4610147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.526+0000 7f460f7fe640 1 -- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610150c50 msgr2=0x7f46101e1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.526+0000 7f460f7fe640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4610150c50 0x7f46101e1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.526+0000 7f460f7fe640 1 -- 172.21.15.151:0/3193238992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4610069d90 msgr2=0x7f4610147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.526+0000 7f460f7fe640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4610069d90 0x7f4610147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.526+0000 7f460f7fe640 1 -- 172.21.15.151:0/3193238992 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8009400 con 0x7f4610157750 2023-10-18T11:38:15.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.531+0000 7f460f7fe640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4610157750 0x7f46101e2530 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f460000b470 tx=0x7f460000b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:15.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.535+0000 7f45ff7fe640 1 -- 172.21.15.151:0/3193238992 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600011830 con 0x7f4610157750 2023-10-18T11:38:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.535+0000 7f45ff7fe640 1 -- 172.21.15.151:0/3193238992 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46000119b0 con 0x7f4610157750 2023-10-18T11:38:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.535+0000 7f45ff7fe640 1 -- 172.21.15.151:0/3193238992 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600011d60 con 0x7f4610157750 2023-10-18T11:38:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.535+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461014fcf0 con 0x7f4610157750 2023-10-18T11:38:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.535+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461014fa50 con 0x7f4610157750 2023-10-18T11:38:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.536+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4610156f50 con 0x7f4610157750 2023-10-18T11:38:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.555+0000 7f45ff7fe640 1 -- 172.21.15.151:0/3193238992 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f460001a400 con 0x7f4610157750 2023-10-18T11:38:15.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.557+0000 7f45ff7fe640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f45f006aec0 0x7f45f006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.557+0000 7f45ff7fe640 1 -- 172.21.15.151:0/3193238992 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4600089e60 con 0x7f4610157750 2023-10-18T11:38:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.557+0000 7f460effd640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f45f006aec0 0x7f45f006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.557+0000 7f45ff7fe640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f45f00747a0 0x7f45f0076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.557+0000 7f45ff7fe640 1 -- 172.21.15.151:0/3193238992 --> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45f0077310 con 0x7f45f00747a0 2023-10-18T11:38:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.558+0000 7f460e7fc640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f45f00747a0 0x7f45f0076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.558+0000 7f460effd640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f45f006aec0 0x7f45f006d380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4608005c00 tx=0x7f4608009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.558+0000 7f460e7fc640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f45f00747a0 0x7f45f0076c40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.559+0000 7f45ff7fe640 1 -- 172.21.15.151:0/3193238992 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4600054ce0 con 0x7f4610157750 2023-10-18T11:38:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.559+0000 7f45ff7fe640 1 -- 172.21.15.151:0/3193238992 <== osd.7 v2:172.21.15.169:6824/3969633295 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f45f0077310 con 0x7f45f00747a0 2023-10-18T11:38:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.575+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 --> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f46100c8920 con 0x7f45f00747a0 2023-10-18T11:38:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.576+0000 7f45ff7fe640 1 -- 172.21.15.151:0/3193238992 <== osd.7 v2:172.21.15.169:6824/3969633295 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f45f8004040 con 0x7f45f00747a0 2023-10-18T11:38:15.579 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-18T11:38:15.579 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T11:38:15.579 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-18T11:38:15.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.576+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f45f00747a0 msgr2=0x7f45f0076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.576+0000 7f460ffff640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6824/3969633295,v1:172.21.15.169:6825/3969633295] conn(0x7f45f00747a0 0x7f45f0076c40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.577+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f45f006aec0 msgr2=0x7f45f006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.577+0000 7f460ffff640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f45f006aec0 0x7f45f006d380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4608005c00 tx=0x7f4608009040 comp rx=0 tx=0).stop 2023-10-18T11:38:15.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.577+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4610157750 msgr2=0x7f46101e2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.577+0000 7f460ffff640 1 --2- 172.21.15.151:0/3193238992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4610157750 0x7f46101e2530 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f460000b470 tx=0x7f460000b930 comp rx=0 tx=0).stop 2023-10-18T11:38:15.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.577+0000 7f460f7fe640 1 -- 172.21.15.151:0/3193238992 reap_dead start 2023-10-18T11:38:15.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.577+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 shutdown_connections 2023-10-18T11:38:15.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.577+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 >> 172.21.15.151:0/3193238992 conn(0x7f461006c860 msgr2=0x7f461006d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:15.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.577+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 shutdown_connections 2023-10-18T11:38:15.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.577+0000 7f460ffff640 1 -- 172.21.15.151:0/3193238992 wait complete. 2023-10-18T11:38:15.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-18T11:38:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.809+0000 7fd3bcefc640 1 Processor -- start 2023-10-18T11:38:15.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.809+0000 7fd3bcefc640 1 -- start start 2023-10-18T11:38:15.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.811+0000 7fd3bcefc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd3b81532a0 0x7fd3b80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.811+0000 7fd3bcefc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b815c5d0 0x7fd3b815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.811+0000 7fd3bcefc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80c5ae0 con 0x7fd3b80c5f10 2023-10-18T11:38:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.811+0000 7fd3bcefc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80c54a0 con 0x7fd3b81532a0 2023-10-18T11:38:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.811+0000 7fd3bcefc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c5780 con 0x7fd3b815c5d0 2023-10-18T11:38:15.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.812+0000 7fd3b6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b815c5d0 0x7fd3b815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.812+0000 7fd3b659c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd3b81532a0 0x7fd3b80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.812+0000 7fd3b6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b815c5d0 0x7fd3b815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:41980/0 (socket says 172.21.15.151:41980) 2023-10-18T11:38:15.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.812+0000 7fd3b6d9d640 1 -- 172.21.15.151:0/1115955689 learned_addr learned my addr 172.21.15.151:0/1115955689 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:15.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.812+0000 7fd3affff640 1 --1- 172.21.15.151:0/1115955689 >> v1:172.21.15.151:6789/0 conn(0x7fd3b80c5f10 0x7fd3b806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:43590/0 (socket says 172.21.15.151:43590) 2023-10-18T11:38:15.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.814+0000 7fd3b6d9d640 1 -- 172.21.15.151:0/1115955689 >> v2:172.21.15.151:3300/0 conn(0x7fd3b81532a0 msgr2=0x7fd3b80715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:15.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.814+0000 7fd3b6d9d640 1 --2- 172.21.15.151:0/1115955689 >> v2:172.21.15.151:3300/0 conn(0x7fd3b81532a0 0x7fd3b80715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.814+0000 7fd3b6d9d640 1 -- 172.21.15.151:0/1115955689 >> v1:172.21.15.151:6789/0 conn(0x7fd3b80c5f10 legacy=0x7fd3b806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.814+0000 7fd3b6d9d640 1 -- 172.21.15.151:0/1115955689 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b8070810 con 0x7fd3b815c5d0 2023-10-18T11:38:15.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.817+0000 7fd3b6d9d640 1 --2- 172.21.15.151:0/1115955689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b815c5d0 0x7fd3b815ca60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009e50 tx=0x7fd3b002bfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3caa19589424a041 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:15.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.820+0000 7fd3b5d9b640 1 -- 172.21.15.151:0/1115955689 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b002cb80 con 0x7fd3b815c5d0 2023-10-18T11:38:15.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3b5d9b640 1 -- 172.21.15.151:0/1115955689 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b002cce0 con 0x7fd3b815c5d0 2023-10-18T11:38:15.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3b5d9b640 1 -- 172.21.15.151:0/1115955689 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0034610 con 0x7fd3b815c5d0 2023-10-18T11:38:15.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3bcefc640 1 -- 172.21.15.151:0/1115955689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b815c5d0 msgr2=0x7fd3b815ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3bcefc640 1 --2- 172.21.15.151:0/1115955689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b815c5d0 0x7fd3b815ca60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009e50 tx=0x7fd3b002bfe0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3bcefc640 1 -- 172.21.15.151:0/1115955689 shutdown_connections 2023-10-18T11:38:15.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3bcefc640 1 --2- 172.21.15.151:0/1115955689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b815c5d0 0x7fd3b815ca60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3bcefc640 1 --2- 172.21.15.151:0/1115955689 >> v2:172.21.15.151:3300/0 conn(0x7fd3b81532a0 0x7fd3b80715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3bcefc640 1 -- 172.21.15.151:0/1115955689 >> 172.21.15.151:0/1115955689 conn(0x7fd3b8069f70 msgr2=0x7fd3b806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:15.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3bcefc640 1 -- 172.21.15.151:0/1115955689 shutdown_connections 2023-10-18T11:38:15.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.821+0000 7fd3bcefc640 1 -- 172.21.15.151:0/1115955689 wait complete. 2023-10-18T11:38:15.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.823+0000 7fd3bcefc640 1 Processor -- start 2023-10-18T11:38:15.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.823+0000 7fd3bcefc640 1 -- start start 2023-10-18T11:38:15.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.824+0000 7fd3bcefc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3b80c5f10 0x7fd3b80c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.824+0000 7fd3bcefc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b81532a0 0x7fd3b80c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.824+0000 7fd3bcefc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b815c5d0 0x7fd3b8154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.824+0000 7fd3bcefc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c2dd0 con 0x7fd3b815c5d0 2023-10-18T11:38:15.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.824+0000 7fd3bcefc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8156520 con 0x7fd3b80c5f10 2023-10-18T11:38:15.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.824+0000 7fd3bcefc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c3020 con 0x7fd3b81532a0 2023-10-18T11:38:15.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.825+0000 7fd3affff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b81532a0 0x7fd3b80c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.825+0000 7fd3b6d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b815c5d0 0x7fd3b8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.825+0000 7fd3b659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3b80c5f10 0x7fd3b80c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.825+0000 7fd3b6d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b815c5d0 0x7fd3b8154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40942/0 (socket says 172.21.15.151:40942) 2023-10-18T11:38:15.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.825+0000 7fd3b6d9d640 1 -- 172.21.15.151:0/3073080582 learned_addr learned my addr 172.21.15.151:0/3073080582 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:15.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.829+0000 7fd3affff640 1 -- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3b80c5f10 msgr2=0x7fd3b80c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.829+0000 7fd3affff640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3b80c5f10 0x7fd3b80c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.829+0000 7fd3affff640 1 -- 172.21.15.151:0/3073080582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b815c5d0 msgr2=0x7fd3b8154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:15.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.829+0000 7fd3affff640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b815c5d0 0x7fd3b8154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:15.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.829+0000 7fd3affff640 1 -- 172.21.15.151:0/3073080582 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b0009b30 con 0x7fd3b81532a0 2023-10-18T11:38:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.831+0000 7fd3affff640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b81532a0 0x7fd3b80c96d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000c430 tx=0x7fd3a000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:15.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.835+0000 7fd3aeffd640 1 -- 172.21.15.151:0/3073080582 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00074e0 con 0x7fd3b81532a0 2023-10-18T11:38:15.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.835+0000 7fd3aeffd640 1 -- 172.21.15.151:0/3073080582 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0007640 con 0x7fd3b81532a0 2023-10-18T11:38:15.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.835+0000 7fd3aeffd640 1 -- 172.21.15.151:0/3073080582 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0004a00 con 0x7fd3b81532a0 2023-10-18T11:38:15.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.835+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b80c3300 con 0x7fd3b81532a0 2023-10-18T11:38:15.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.835+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b8154030 con 0x7fd3b81532a0 2023-10-18T11:38:15.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.836+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b80cb410 con 0x7fd3b81532a0 2023-10-18T11:38:15.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.854+0000 7fd3aeffd640 1 -- 172.21.15.151:0/3073080582 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd3a0004b60 con 0x7fd3b81532a0 2023-10-18T11:38:15.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.855+0000 7fd3aeffd640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd39806aec0 0x7fd39806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:15.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.856+0000 7fd3b659c640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd39806aec0 0x7fd39806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:15.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.856+0000 7fd3b659c640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd39806aec0 0x7fd39806d380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009b40 tx=0x7fd3a8009190 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:15.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:15.857+0000 7fd3aeffd640 1 -- 172.21.15.151:0/3073080582 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3a0058450 con 0x7fd3b81532a0 2023-10-18T11:38:16.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.096+0000 7fd3aeffd640 1 -- 172.21.15.151:0/3073080582 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3a0054790 con 0x7fd3b81532a0 2023-10-18T11:38:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.304+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3b8070dd0 con 0x7fd39806aec0 2023-10-18T11:38:16.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.305+0000 7fd3aeffd640 1 -- 172.21.15.151:0/3073080582 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd3a8011a60 con 0x7fd39806aec0 2023-10-18T11:38:16.308 INFO:teuthology.orchestra.run.smithi151.stderr:instructed osd(s) 7 to deep-scrub 2023-10-18T11:38:16.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd39806aec0 msgr2=0x7fd39806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:16.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd39806aec0 0x7fd39806d380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009b40 tx=0x7fd3a8009190 comp rx=0 tx=0).stop 2023-10-18T11:38:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b81532a0 msgr2=0x7fd3b80c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b81532a0 0x7fd3b80c96d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000c430 tx=0x7fd3a000c8f0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 shutdown_connections 2023-10-18T11:38:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b815c5d0 0x7fd3b8154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3b81532a0 0x7fd3b80c96d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fd39806aec0 0x7fd39806d380 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 --2- 172.21.15.151:0/3073080582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3b80c5f10 0x7fd3b80c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.308+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 >> 172.21.15.151:0/3073080582 conn(0x7fd3b8069f70 msgr2=0x7fd3b806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:16.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.309+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 shutdown_connections 2023-10-18T11:38:16.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.309+0000 7fd3bcefc640 1 -- 172.21.15.151:0/3073080582 wait complete. 2023-10-18T11:38:16.330 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:38:16.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.551+0000 7f7b68c32640 1 Processor -- start 2023-10-18T11:38:16.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.551+0000 7f7b68c32640 1 -- start start 2023-10-18T11:38:16.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.554+0000 7f7b68c32640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7b6415d2f0 0x7f7b64159100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:16.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.554+0000 7f7b68c32640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b640c5c90 con 0x7f7b64153460 2023-10-18T11:38:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.554+0000 7f7b68c32640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b64153840 con 0x7f7b6406a970 2023-10-18T11:38:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.554+0000 7f7b68c32640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b640c5f30 con 0x7f7b6415d2f0 2023-10-18T11:38:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.555+0000 7f7b62d9d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f7b6406a970 0x7f7b641639a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:47300/0 (socket says 172.21.15.151:47300) 2023-10-18T11:38:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.555+0000 7f7b62d9d640 1 -- 172.21.15.151:0/1044774983 learned_addr learned my addr 172.21.15.151:0/1044774983 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:38:16.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.604+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040402701 0 0) 0x7f7b64153840 con 0x7f7b6406a970 2023-10-18T11:38:16.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.604+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b50003520 con 0x7f7b6406a970 2023-10-18T11:38:16.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.607+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3347436884 0 0) 0x7f7b50003520 con 0x7f7b6406a970 2023-10-18T11:38:16.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.607+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 >> v2:172.21.15.151:3300/0 conn(0x7f7b6415d2f0 msgr2=0x7f7b64159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:16.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.607+0000 7f7b61d9b640 1 --2- 172.21.15.151:0/1044774983 >> v2:172.21.15.151:3300/0 conn(0x7f7b6415d2f0 0x7f7b64159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.607+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 >> v1:172.21.15.151:6789/0 conn(0x7f7b64153460 legacy=0x7f7b6406b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:16.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.607+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b640c6210 con 0x7f7b6406a970 2023-10-18T11:38:16.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.608+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 678048370 0 0) 0x7f7b5c0019f0 con 0x7f7b6406a970 2023-10-18T11:38:16.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.608+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 >> v1:172.21.15.169:6789/0 conn(0x7f7b6406a970 legacy=0x7f7b641639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:16.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.608+0000 7f7b61d9b640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500039c0 0x7f7b50003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:16.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.608+0000 7f7b61d9b640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b500047c0 0x7f7b50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:16.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.608+0000 7f7b61d9b640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b500052a0 0x7f7b5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:16.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.608+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640c5f30 con 0x7f7b500052a0 2023-10-18T11:38:16.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.608+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5000c1f0 con 0x7f7b500039c0 2023-10-18T11:38:16.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.608+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5000c3b0 con 0x7f7b500047c0 2023-10-18T11:38:16.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.609+0000 7f7b5bfff640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b500047c0 0x7f7b50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:16.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.611+0000 7f7b6259c640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500039c0 0x7f7b50003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:16.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.612+0000 7f7b5bfff640 1 -- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500039c0 msgr2=0x7f7b50003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:16.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.612+0000 7f7b5bfff640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500039c0 0x7f7b50003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.612+0000 7f7b5bfff640 1 -- 172.21.15.151:0/1044774983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b500052a0 msgr2=0x7f7b5000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:16.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.612+0000 7f7b5bfff640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b500052a0 0x7f7b5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.612+0000 7f7b5bfff640 1 -- 172.21.15.151:0/1044774983 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b50003520 con 0x7f7b500047c0 2023-10-18T11:38:16.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.612+0000 7f7b62d9d640 1 -- 172.21.15.151:0/1044774983 reap_dead start 2023-10-18T11:38:16.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.617+0000 7f7b5bfff640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b500047c0 0x7f7b50004c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c006fd0 tx=0x7f7b500057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3127e0499d875db server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:16.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.621+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c032600 con 0x7f7b500047c0 2023-10-18T11:38:16.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.621+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c02e050 con 0x7f7b500047c0 2023-10-18T11:38:16.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.621+0000 7f7b61d9b640 1 -- 172.21.15.151:0/1044774983 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c032a00 con 0x7f7b500047c0 2023-10-18T11:38:16.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.623+0000 7f7b68c32640 1 -- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b500047c0 msgr2=0x7f7b50004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:16.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.623+0000 7f7b68c32640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b500047c0 0x7f7b50004c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c006fd0 tx=0x7f7b500057f0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.623+0000 7f7b68c32640 1 -- 172.21.15.151:0/1044774983 shutdown_connections 2023-10-18T11:38:16.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.623+0000 7f7b68c32640 1 --2- 172.21.15.151:0/1044774983 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b500047c0 0x7f7b50004c40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.623+0000 7f7b68c32640 1 -- 172.21.15.151:0/1044774983 >> 172.21.15.151:0/1044774983 conn(0x7f7b640ce890 msgr2=0x7f7b640ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:16.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.623+0000 7f7b68c32640 1 -- 172.21.15.151:0/1044774983 shutdown_connections 2023-10-18T11:38:16.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.623+0000 7f7b68c32640 1 -- 172.21.15.151:0/1044774983 wait complete. 2023-10-18T11:38:16.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.626+0000 7f7b68c32640 1 Processor -- start 2023-10-18T11:38:16.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.627+0000 7f7b68c32640 1 -- start start 2023-10-18T11:38:16.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.628+0000 7f7b68c32640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500047c0 0x7f7b64145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:16.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.628+0000 7f7b68c32640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b6415a260 0x7f7b641ef220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:16.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.629+0000 7f7b68c32640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b6415a780 0x7f7b64144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:16.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.629+0000 7f7b68c32640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641eee00 con 0x7f7b6415a260 2023-10-18T11:38:16.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.629+0000 7f7b68c32640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640cdeb0 con 0x7f7b500047c0 2023-10-18T11:38:16.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.629+0000 7f7b68c32640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641f2bd0 con 0x7f7b6415a780 2023-10-18T11:38:16.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.629+0000 7f7b62d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b6415a780 0x7f7b64144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:16.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.629+0000 7f7b6259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500047c0 0x7f7b64145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:16.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.630+0000 7f7b6259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500047c0 0x7f7b64145930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:59078/0 (socket says 172.21.15.151:59078) 2023-10-18T11:38:16.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.630+0000 7f7b6259c640 1 -- 172.21.15.151:0/155801782 learned_addr learned my addr 172.21.15.151:0/155801782 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.634+0000 7f7b6259c640 1 -- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b6415a780 msgr2=0x7f7b64144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.634+0000 7f7b6259c640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b6415a780 0x7f7b64144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.634+0000 7f7b6259c640 1 -- 172.21.15.151:0/155801782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b6415a260 msgr2=0x7f7b641ef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.635+0000 7f7b6259c640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b6415a260 0x7f7b641ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:16.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.635+0000 7f7b6259c640 1 -- 172.21.15.151:0/155801782 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6415c1f0 con 0x7f7b500047c0 2023-10-18T11:38:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.637+0000 7f7b6259c640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500047c0 0x7f7b64145930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400f840 tx=0x7f7b5400fd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.640+0000 7f7b5affd640 1 -- 172.21.15.151:0/155801782 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54004a60 con 0x7f7b500047c0 2023-10-18T11:38:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.640+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6415c4d0 con 0x7f7b500047c0 2023-10-18T11:38:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.640+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b64146ea0 con 0x7f7b500047c0 2023-10-18T11:38:16.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.641+0000 7f7b5affd640 1 -- 172.21.15.151:0/155801782 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b54003800 con 0x7f7b500047c0 2023-10-18T11:38:16.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.641+0000 7f7b5affd640 1 -- 172.21.15.151:0/155801782 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54003bb0 con 0x7f7b500047c0 2023-10-18T11:38:16.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.642+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b48005250 con 0x7f7b500047c0 2023-10-18T11:38:16.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.902+0000 7f7b5affd640 1 -- 172.21.15.151:0/155801782 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b54003d10 con 0x7f7b500047c0 2023-10-18T11:38:16.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.904+0000 7f7b5affd640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7b4406ae70 0x7f7b4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:16.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.904+0000 7f7b5affd640 1 -- 172.21.15.151:0/155801782 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7b5408a1b0 con 0x7f7b500047c0 2023-10-18T11:38:16.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.905+0000 7f7b5bfff640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7b4406ae70 0x7f7b4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.906+0000 7f7b5bfff640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7b4406ae70 0x7f7b4406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c034000 tx=0x7f7b4c02f000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:16.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:16.912+0000 7f7b5affd640 1 -- 172.21.15.151:0/155801782 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b54054f10 con 0x7f7b500047c0 2023-10-18T11:38:17.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.123+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b48000bc0 con 0x7f7b4406ae70 2023-10-18T11:38:17.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.134+0000 7f7b5affd640 1 -- 172.21.15.151:0/155801782 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368182 (secure 0 0 0) 0x7f7b48000bc0 con 0x7f7b4406ae70 2023-10-18T11:38:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:38:17.144 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:38:17.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.140+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7b4406ae70 msgr2=0x7f7b4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:17.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.140+0000 7f7b68c32640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7b4406ae70 0x7f7b4406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c034000 tx=0x7f7b4c02f000 comp rx=0 tx=0).stop 2023-10-18T11:38:17.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.140+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500047c0 msgr2=0x7f7b64145930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:17.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.140+0000 7f7b68c32640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500047c0 0x7f7b64145930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400f840 tx=0x7f7b5400fd00 comp rx=0 tx=0).stop 2023-10-18T11:38:17.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.140+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 shutdown_connections 2023-10-18T11:38:17.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.140+0000 7f7b68c32640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b6415a780 0x7f7b64144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:17.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.140+0000 7f7b68c32640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b6415a260 0x7f7b641ef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:17.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.140+0000 7f7b68c32640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f7b4406ae70 0x7f7b4406d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:17.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.140+0000 7f7b68c32640 1 --2- 172.21.15.151:0/155801782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b500047c0 0x7f7b64145930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:17.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.141+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 >> 172.21.15.151:0/155801782 conn(0x7f7b640ce890 msgr2=0x7f7b640cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:17.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.141+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 shutdown_connections 2023-10-18T11:38:17.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:17.141+0000 7f7b68c32640 1 -- 172.21.15.151:0/155801782 wait complete. 2023-10-18T11:38:17.165 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":894,"stamp":"2023-10-18T11:38:16.609599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":100597386,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":4304,"num_read_kb":487225,"num_write":36997,"num_write_kb":691404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47757,"ondisk_log_size":47757,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":893040,"kb_used_data":158000,"kb_used_omap":12,"kb_used_meta":734963,"kb_avail":754081680,"statfs":{"total":773094113280,"available":772179640320,"internally_reserved":0,"allocated":161792000,"data_stored":202273572,"data_compressed":12494466,"data_compressed_allocated":19447808,"data_compressed_original":61759488,"omap_allocated":12742,"internal_metadata":752602682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3581,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002656"},"pg_stats":[{"pgid":"2.1f","version":"31'1794","reported_seq":1837,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.079350+0000","last_change":"2023-10-18T11:38:12.079438+0000","last_active":"2023-10-18T11:38:12.079350+0000","last_peered":"2023-10-18T11:38:12.079350+0000","last_clean":"2023-10-18T11:38:12.079350+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:38:12.079350+0000","last_undegraded":"2023-10-18T11:38:12.079350+0000","last_fullsized":"2023-10-18T11:38:12.079350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1794","last_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_deep_scrub":"31'1794","last_deep_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.079262+0000","objects_scrubbed":9,"log_size":1794,"log_dups_size":0,"ondisk_log_size":1794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:20:44.669761+0000","scrub_duration":0.099044419999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9277295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":10015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'142","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.032783+0000","last_change":"2023-10-18T11:09:39.421701+0000","last_active":"2023-10-18T11:38:03.032783+0000","last_peered":"2023-10-18T11:38:03.032783+0000","last_clean":"2023-10-18T11:38:03.032783+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:38:03.032783+0000","last_undegraded":"2023-10-18T11:38:03.032783+0000","last_fullsized":"2023-10-18T11:38:03.032783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'384","reported_seq":458,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.555199+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:37:03.555199+0000","last_peered":"2023-10-18T11:37:03.555199+0000","last_clean":"2023-10-18T11:37:03.555199+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:37:03.555199+0000","last_undegraded":"2023-10-18T11:37:03.555199+0000","last_fullsized":"2023-10-18T11:37:03.555199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":285,"num_write_kb":10314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'1437","reported_seq":1473,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:37.191910+0000","last_change":"2023-10-18T11:09:36.909894+0000","last_active":"2023-10-18T11:37:37.191910+0000","last_peered":"2023-10-18T11:37:37.191910+0000","last_clean":"2023-10-18T11:37:37.191910+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:37:37.191910+0000","last_undegraded":"2023-10-18T11:37:37.191910+0000","last_fullsized":"2023-10-18T11:37:37.191910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1437,"log_dups_size":0,"ondisk_log_size":1437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1431,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'165","reported_seq":197,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.185754+0000","last_change":"2023-10-18T11:09:39.363102+0000","last_active":"2023-10-18T11:38:03.185754+0000","last_peered":"2023-10-18T11:38:03.185754+0000","last_clean":"2023-10-18T11:38:03.185754+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:38:03.185754+0000","last_undegraded":"2023-10-18T11:38:03.185754+0000","last_fullsized":"2023-10-18T11:38:03.185754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'453","reported_seq":593,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.771594+0000","last_change":"2023-10-18T11:09:46.109981+0000","last_active":"2023-10-18T11:37:08.771594+0000","last_peered":"2023-10-18T11:37:08.771594+0000","last_clean":"2023-10-18T11:37:08.771594+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:37:08.771594+0000","last_undegraded":"2023-10-18T11:37:08.771594+0000","last_fullsized":"2023-10-18T11:37:08.771594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":14204,"num_write":357,"num_write_kb":21017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'817","reported_seq":849,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.500981+0000","last_change":"2023-10-18T11:09:36.896708+0000","last_active":"2023-10-18T11:38:02.500981+0000","last_peered":"2023-10-18T11:38:02.500981+0000","last_clean":"2023-10-18T11:38:02.500981+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:38:02.500981+0000","last_undegraded":"2023-10-18T11:38:02.500981+0000","last_fullsized":"2023-10-18T11:38:02.500981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:34.258633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3060357,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'145","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.046942+0000","last_change":"2023-10-18T11:09:39.397225+0000","last_active":"2023-10-18T11:38:03.046942+0000","last_peered":"2023-10-18T11:38:03.046942+0000","last_clean":"2023-10-18T11:38:03.046942+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:38:03.046942+0000","last_undegraded":"2023-10-18T11:38:03.046942+0000","last_fullsized":"2023-10-18T11:38:03.046942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'331","reported_seq":404,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.082012+0000","last_change":"2023-10-18T11:09:46.114798+0000","last_active":"2023-10-18T11:37:16.082012+0000","last_peered":"2023-10-18T11:37:16.082012+0000","last_clean":"2023-10-18T11:37:16.082012+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:37:16.082012+0000","last_undegraded":"2023-10-18T11:37:16.082012+0000","last_fullsized":"2023-10-18T11:37:16.082012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":213,"num_write_kb":9865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:34:36.253199+0000","last_change":"2023-10-18T11:09:36.795004+0000","last_active":"2023-10-18T11:34:36.253199+0000","last_peered":"2023-10-18T11:34:36.253199+0000","last_clean":"2023-10-18T11:34:36.253199+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:34:36.253199+0000","last_undegraded":"2023-10-18T11:34:36.253199+0000","last_fullsized":"2023-10-18T11:34:36.253199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'167","reported_seq":197,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.046852+0000","last_change":"2023-10-18T11:09:39.398621+0000","last_active":"2023-10-18T11:38:03.046852+0000","last_peered":"2023-10-18T11:38:03.046852+0000","last_clean":"2023-10-18T11:38:03.046852+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:38:03.046852+0000","last_undegraded":"2023-10-18T11:38:03.046852+0000","last_fullsized":"2023-10-18T11:38:03.046852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'461","reported_seq":544,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.081984+0000","last_change":"2023-10-18T11:09:46.115280+0000","last_active":"2023-10-18T11:37:16.081984+0000","last_peered":"2023-10-18T11:37:16.081984+0000","last_clean":"2023-10-18T11:37:16.081984+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:37:16.081984+0000","last_undegraded":"2023-10-18T11:37:16.081984+0000","last_fullsized":"2023-10-18T11:37:16.081984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":15764,"num_write":351,"num_write_kb":32860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'140","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.137538+0000","last_change":"2023-10-18T11:09:39.397253+0000","last_active":"2023-10-18T11:38:03.137538+0000","last_peered":"2023-10-18T11:38:03.137538+0000","last_clean":"2023-10-18T11:38:03.137538+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:38:03.137538+0000","last_undegraded":"2023-10-18T11:38:03.137538+0000","last_fullsized":"2023-10-18T11:38:03.137538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:18:55.564587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'767","reported_seq":800,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.393018+0000","last_change":"2023-10-18T11:09:36.893066+0000","last_active":"2023-10-18T11:37:42.393018+0000","last_peered":"2023-10-18T11:37:42.393018+0000","last_clean":"2023-10-18T11:37:42.393018+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:37:42.393018+0000","last_undegraded":"2023-10-18T11:37:42.393018+0000","last_fullsized":"2023-10-18T11:37:42.393018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:32.587464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'437","reported_seq":510,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.557498+0000","last_change":"2023-10-18T11:09:46.096113+0000","last_active":"2023-10-18T11:37:03.557498+0000","last_peered":"2023-10-18T11:37:03.557498+0000","last_clean":"2023-10-18T11:37:03.557498+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:37:03.557498+0000","last_undegraded":"2023-10-18T11:37:03.557498+0000","last_fullsized":"2023-10-18T11:37:03.557498+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":11430,"num_write":325,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'139","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.056726+0000","last_change":"2023-10-18T11:09:39.423651+0000","last_active":"2023-10-18T11:38:03.056726+0000","last_peered":"2023-10-18T11:38:03.056726+0000","last_clean":"2023-10-18T11:38:03.056726+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:38:03.056726+0000","last_undegraded":"2023-10-18T11:38:03.056726+0000","last_fullsized":"2023-10-18T11:38:03.056726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'486","reported_seq":529,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.714481+0000","last_change":"2023-10-18T11:38:15.714604+0000","last_active":"2023-10-18T11:38:15.714481+0000","last_peered":"2023-10-18T11:38:15.714481+0000","last_clean":"2023-10-18T11:38:15.714481+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:38:15.714481+0000","last_undegraded":"2023-10-18T11:38:15.714481+0000","last_fullsized":"2023-10-18T11:38:15.714481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'486","last_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_deep_scrub":"31'486","last_deep_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.714323+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:22:01.854784+0000","scrub_duration":0.005976121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'427","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.755728+0000","last_change":"2023-10-18T11:09:46.114729+0000","last_active":"2023-10-18T11:37:07.755728+0000","last_peered":"2023-10-18T11:37:07.755728+0000","last_clean":"2023-10-18T11:37:07.755728+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:37:07.755728+0000","last_undegraded":"2023-10-18T11:37:07.755728+0000","last_fullsized":"2023-10-18T11:37:07.755728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":327,"num_write_kb":17650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'148","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.949313+0000","last_change":"2023-10-18T11:38:14.949444+0000","last_active":"2023-10-18T11:38:14.949313+0000","last_peered":"2023-10-18T11:38:14.949313+0000","last_clean":"2023-10-18T11:38:14.949313+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:38:14.949313+0000","last_undegraded":"2023-10-18T11:38:14.949313+0000","last_fullsized":"2023-10-18T11:38:14.949313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.949157+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:41:56.369387+0000","scrub_duration":0.0041327179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'280","reported_seq":315,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.268286+0000","last_change":"2023-10-18T11:09:36.915198+0000","last_active":"2023-10-18T11:37:46.268286+0000","last_peered":"2023-10-18T11:37:46.268286+0000","last_clean":"2023-10-18T11:37:46.268286+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:37:46.268286+0000","last_undegraded":"2023-10-18T11:37:46.268286+0000","last_fullsized":"2023-10-18T11:37:46.268286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'423","reported_seq":481,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:11.384453+0000","last_change":"2023-10-18T11:10:10.413988+0000","last_active":"2023-10-18T11:37:11.384453+0000","last_peered":"2023-10-18T11:37:11.384453+0000","last_clean":"2023-10-18T11:37:11.384453+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:37:11.384453+0000","last_undegraded":"2023-10-18T11:37:11.384453+0000","last_fullsized":"2023-10-18T11:37:11.384453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":324,"num_write_kb":16893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'124","reported_seq":156,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.928116+0000","last_change":"2023-10-18T11:09:39.399181+0000","last_active":"2023-10-18T11:38:02.928116+0000","last_peered":"2023-10-18T11:38:02.928116+0000","last_clean":"2023-10-18T11:38:02.928116+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:38:02.928116+0000","last_undegraded":"2023-10-18T11:38:02.928116+0000","last_fullsized":"2023-10-18T11:38:02.928116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:42.981750+0000","last_change":"2023-10-18T11:09:36.797637+0000","last_active":"2023-10-18T11:37:42.981750+0000","last_peered":"2023-10-18T11:37:42.981750+0000","last_clean":"2023-10-18T11:37:42.981750+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:37:42.981750+0000","last_undegraded":"2023-10-18T11:37:42.981750+0000","last_fullsized":"2023-10-18T11:37:42.981750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:08.109221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'432","reported_seq":616,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.833017+0000","last_change":"2023-10-18T11:09:46.109408+0000","last_active":"2023-10-18T11:37:04.833017+0000","last_peered":"2023-10-18T11:37:04.833017+0000","last_clean":"2023-10-18T11:37:04.833017+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:37:04.833017+0000","last_undegraded":"2023-10-18T11:37:04.833017+0000","last_fullsized":"2023-10-18T11:37:04.833017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":19825,"num_write":333,"num_write_kb":19445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'132","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.180435+0000","last_change":"2023-10-18T11:09:39.366234+0000","last_active":"2023-10-18T11:38:03.180435+0000","last_peered":"2023-10-18T11:38:03.180435+0000","last_clean":"2023-10-18T11:38:03.180435+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:38:03.180435+0000","last_undegraded":"2023-10-18T11:38:03.180435+0000","last_fullsized":"2023-10-18T11:38:03.180435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.152488+0000","last_change":"2023-10-18T11:09:36.896533+0000","last_active":"2023-10-18T11:37:54.152488+0000","last_peered":"2023-10-18T11:37:54.152488+0000","last_clean":"2023-10-18T11:37:54.152488+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:37:54.152488+0000","last_undegraded":"2023-10-18T11:37:54.152488+0000","last_fullsized":"2023-10-18T11:37:54.152488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:34:42.956311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'438","reported_seq":521,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.516838+0000","last_change":"2023-10-18T11:09:46.094196+0000","last_active":"2023-10-18T11:37:04.516838+0000","last_peered":"2023-10-18T11:37:04.516838+0000","last_clean":"2023-10-18T11:37:04.516838+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:37:04.516838+0000","last_undegraded":"2023-10-18T11:37:04.516838+0000","last_fullsized":"2023-10-18T11:37:04.516838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":16856,"num_write":335,"num_write_kb":23716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'142","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.052072+0000","last_change":"2023-10-18T11:09:39.420016+0000","last_active":"2023-10-18T11:38:03.052072+0000","last_peered":"2023-10-18T11:38:03.052072+0000","last_clean":"2023-10-18T11:38:03.052072+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:38:03.052072+0000","last_undegraded":"2023-10-18T11:38:03.052072+0000","last_fullsized":"2023-10-18T11:38:03.052072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'289","reported_seq":324,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:06.249210+0000","last_change":"2023-10-18T11:09:36.913659+0000","last_active":"2023-10-18T11:38:06.249210+0000","last_peered":"2023-10-18T11:38:06.249210+0000","last_clean":"2023-10-18T11:38:06.249210+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:38:06.249210+0000","last_undegraded":"2023-10-18T11:38:06.249210+0000","last_fullsized":"2023-10-18T11:38:06.249210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'450","reported_seq":536,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415835+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:37:46.415835+0000","last_peered":"2023-10-18T11:37:46.415835+0000","last_clean":"2023-10-18T11:37:46.415835+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:37:46.415835+0000","last_undegraded":"2023-10-18T11:37:46.415835+0000","last_fullsized":"2023-10-18T11:37:46.415835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":337,"num_write_kb":25264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'150","reported_seq":182,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.079736+0000","last_change":"2023-10-18T11:09:39.243607+0000","last_active":"2023-10-18T11:38:03.079736+0000","last_peered":"2023-10-18T11:38:03.079736+0000","last_clean":"2023-10-18T11:38:03.079736+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:38:03.079736+0000","last_undegraded":"2023-10-18T11:38:03.079736+0000","last_fullsized":"2023-10-18T11:38:03.079736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'242","reported_seq":276,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:40.777847+0000","last_change":"2023-10-18T11:09:36.798396+0000","last_active":"2023-10-18T11:37:40.777847+0000","last_peered":"2023-10-18T11:37:40.777847+0000","last_clean":"2023-10-18T11:37:40.777847+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:37:40.777847+0000","last_undegraded":"2023-10-18T11:37:40.777847+0000","last_fullsized":"2023-10-18T11:37:40.777847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:04.311252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'490","reported_seq":563,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.793255+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:36:58.793255+0000","last_peered":"2023-10-18T11:36:58.793255+0000","last_clean":"2023-10-18T11:36:58.793255+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:36:58.793255+0000","last_undegraded":"2023-10-18T11:36:58.793255+0000","last_fullsized":"2023-10-18T11:36:58.793255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":390,"num_write_kb":31170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'172","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.062602+0000","last_change":"2023-10-18T11:09:39.417304+0000","last_active":"2023-10-18T11:38:03.062602+0000","last_peered":"2023-10-18T11:38:03.062602+0000","last_clean":"2023-10-18T11:38:03.062602+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:38:03.062602+0000","last_undegraded":"2023-10-18T11:38:03.062602+0000","last_fullsized":"2023-10-18T11:38:03.062602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'791","reported_seq":834,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.776459+0000","last_change":"2023-10-18T11:38:13.776538+0000","last_active":"2023-10-18T11:38:13.776459+0000","last_peered":"2023-10-18T11:38:13.776459+0000","last_clean":"2023-10-18T11:38:13.776459+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:38:13.776459+0000","last_undegraded":"2023-10-18T11:38:13.776459+0000","last_fullsized":"2023-10-18T11:38:13.776459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'791","last_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_deep_scrub":"31'791","last_deep_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.776362+0000","objects_scrubbed":1,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.684568+0000","scrub_duration":0.035930087999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'468","reported_seq":528,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.545596+0000","last_change":"2023-10-18T11:09:46.100735+0000","last_active":"2023-10-18T11:37:03.545596+0000","last_peered":"2023-10-18T11:37:03.545596+0000","last_clean":"2023-10-18T11:37:03.545596+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:37:03.545596+0000","last_undegraded":"2023-10-18T11:37:03.545596+0000","last_fullsized":"2023-10-18T11:37:03.545596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":9414,"num_write":343,"num_write_kb":17104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'148","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.922537+0000","last_change":"2023-10-18T11:09:39.400602+0000","last_active":"2023-10-18T11:38:02.922537+0000","last_peered":"2023-10-18T11:38:02.922537+0000","last_clean":"2023-10-18T11:38:02.922537+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:38:02.922537+0000","last_undegraded":"2023-10-18T11:38:02.922537+0000","last_fullsized":"2023-10-18T11:38:02.922537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1648","reported_seq":1683,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:54.272116+0000","last_change":"2023-10-18T11:09:36.915028+0000","last_active":"2023-10-18T11:37:54.272116+0000","last_peered":"2023-10-18T11:37:54.272116+0000","last_clean":"2023-10-18T11:37:54.272116+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:37:54.272116+0000","last_undegraded":"2023-10-18T11:37:54.272116+0000","last_fullsized":"2023-10-18T11:37:54.272116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1639,"num_write_kb":9112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'412","reported_seq":498,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.245534+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:37:05.245534+0000","last_peered":"2023-10-18T11:37:05.245534+0000","last_clean":"2023-10-18T11:37:05.245534+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:37:05.245534+0000","last_undegraded":"2023-10-18T11:37:05.245534+0000","last_fullsized":"2023-10-18T11:37:05.245534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":14478,"num_write":303,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'145","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.079388+0000","last_change":"2023-10-18T11:09:39.243829+0000","last_active":"2023-10-18T11:38:03.079388+0000","last_peered":"2023-10-18T11:38:03.079388+0000","last_clean":"2023-10-18T11:38:03.079388+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:38:03.079388+0000","last_undegraded":"2023-10-18T11:38:03.079388+0000","last_fullsized":"2023-10-18T11:38:03.079388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'1264","reported_seq":1756,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:58.345408+0000","last_change":"2023-10-18T11:09:36.910270+0000","last_active":"2023-10-18T11:37:58.345408+0000","last_peered":"2023-10-18T11:37:58.345408+0000","last_clean":"2023-10-18T11:37:58.345408+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:37:58.345408+0000","last_undegraded":"2023-10-18T11:37:58.345408+0000","last_fullsized":"2023-10-18T11:37:58.345408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4329052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":492,"num_write":1258,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'421","reported_seq":528,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.270146+0000","last_change":"2023-10-18T11:09:46.114610+0000","last_active":"2023-10-18T11:37:56.270146+0000","last_peered":"2023-10-18T11:37:56.270146+0000","last_clean":"2023-10-18T11:37:56.270146+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:37:56.270146+0000","last_undegraded":"2023-10-18T11:37:56.270146+0000","last_fullsized":"2023-10-18T11:37:56.270146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":19812,"num_write":327,"num_write_kb":12739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'143","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.182474+0000","last_change":"2023-10-18T11:09:39.404210+0000","last_active":"2023-10-18T11:38:03.182474+0000","last_peered":"2023-10-18T11:38:03.182474+0000","last_clean":"2023-10-18T11:38:03.182474+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:38:03.182474+0000","last_undegraded":"2023-10-18T11:38:03.182474+0000","last_fullsized":"2023-10-18T11:38:03.182474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'375","reported_seq":410,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.494841+0000","last_change":"2023-10-18T11:09:36.913804+0000","last_active":"2023-10-18T11:38:02.494841+0000","last_peered":"2023-10-18T11:38:02.494841+0000","last_clean":"2023-10-18T11:38:02.494841+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:38:02.494841+0000","last_undegraded":"2023-10-18T11:38:02.494841+0000","last_fullsized":"2023-10-18T11:38:02.494841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:32:04.836618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956517,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'424","reported_seq":517,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.202696+0000","last_change":"2023-10-18T11:09:46.092566+0000","last_active":"2023-10-18T11:37:56.202696+0000","last_peered":"2023-10-18T11:37:56.202696+0000","last_clean":"2023-10-18T11:37:56.202696+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:37:56.202696+0000","last_undegraded":"2023-10-18T11:37:56.202696+0000","last_fullsized":"2023-10-18T11:37:56.202696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":329,"num_write_kb":22819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'140","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.033705+0000","last_change":"2023-10-18T11:09:39.422507+0000","last_active":"2023-10-18T11:38:03.033705+0000","last_peered":"2023-10-18T11:38:03.033705+0000","last_clean":"2023-10-18T11:38:03.033705+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:38:03.033705+0000","last_undegraded":"2023-10-18T11:38:03.033705+0000","last_fullsized":"2023-10-18T11:38:03.033705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'9","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:31.481422+0000","last_change":"2023-10-18T11:09:36.828474+0000","last_active":"2023-10-18T11:37:31.481422+0000","last_peered":"2023-10-18T11:37:31.481422+0000","last_clean":"2023-10-18T11:37:31.481422+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:37:31.481422+0000","last_undegraded":"2023-10-18T11:37:31.481422+0000","last_fullsized":"2023-10-18T11:37:31.481422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:35:21.257875+0000","last_change":"2023-10-18T11:09:19.365660+0000","last_active":"2023-10-18T11:35:21.257875+0000","last_peered":"2023-10-18T11:35:21.257875+0000","last_clean":"2023-10-18T11:35:21.257875+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:35:21.257875+0000","last_undegraded":"2023-10-18T11:35:21.257875+0000","last_fullsized":"2023-10-18T11:35:21.257875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:17.711667+0000","last_clean_scrub_stamp":"2023-10-18T11:09:17.711667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:34:53.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'526","reported_seq":631,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.294647+0000","last_change":"2023-10-18T11:09:46.118571+0000","last_active":"2023-10-18T11:37:07.294647+0000","last_peered":"2023-10-18T11:37:07.294647+0000","last_clean":"2023-10-18T11:37:07.294647+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:37:07.294647+0000","last_undegraded":"2023-10-18T11:37:07.294647+0000","last_fullsized":"2023-10-18T11:37:07.294647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:46.781070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":19822,"num_write":415,"num_write_kb":19524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'153","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.943258+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:38:02.943258+0000","last_peered":"2023-10-18T11:38:02.943258+0000","last_clean":"2023-10-18T11:38:02.943258+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:38:02.943258+0000","last_undegraded":"2023-10-18T11:38:02.943258+0000","last_fullsized":"2023-10-18T11:38:02.943258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:38:21.622975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'899","reported_seq":933,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:52.074126+0000","last_change":"2023-10-18T11:09:36.829100+0000","last_active":"2023-10-18T11:37:52.074126+0000","last_peered":"2023-10-18T11:37:52.074126+0000","last_clean":"2023-10-18T11:37:52.074126+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:37:52.074126+0000","last_undegraded":"2023-10-18T11:37:52.074126+0000","last_fullsized":"2023-10-18T11:37:52.074126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'411","reported_seq":522,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.809149+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:37:07.809149+0000","last_peered":"2023-10-18T11:37:07.809149+0000","last_clean":"2023-10-18T11:37:07.809149+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:37:07.809149+0000","last_undegraded":"2023-10-18T11:37:07.809149+0000","last_fullsized":"2023-10-18T11:37:07.809149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:56:51.052081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":18796,"num_write":308,"num_write_kb":13390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'137","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.062605+0000","last_change":"2023-10-18T11:09:39.419862+0000","last_active":"2023-10-18T11:38:03.062605+0000","last_peered":"2023-10-18T11:38:03.062605+0000","last_clean":"2023-10-18T11:38:03.062605+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:38:03.062605+0000","last_undegraded":"2023-10-18T11:38:03.062605+0000","last_fullsized":"2023-10-18T11:38:03.062605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'1292","reported_seq":1326,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.076616+0000","last_change":"2023-10-18T11:09:36.912905+0000","last_active":"2023-10-18T11:38:03.076616+0000","last_peered":"2023-10-18T11:38:03.076616+0000","last_clean":"2023-10-18T11:38:03.076616+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:38:03.076616+0000","last_undegraded":"2023-10-18T11:38:03.076616+0000","last_fullsized":"2023-10-18T11:38:03.076616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7520929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1284,"num_write_kb":8040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'435","reported_seq":549,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.999963+0000","last_change":"2023-10-18T11:09:46.097744+0000","last_active":"2023-10-18T11:37:04.999963+0000","last_peered":"2023-10-18T11:37:04.999963+0000","last_clean":"2023-10-18T11:37:04.999963+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:37:04.999963+0000","last_undegraded":"2023-10-18T11:37:04.999963+0000","last_fullsized":"2023-10-18T11:37:04.999963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":340,"num_write_kb":14424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'136","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.943598+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:38:02.943598+0000","last_peered":"2023-10-18T11:38:02.943598+0000","last_clean":"2023-10-18T11:38:02.943598+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:38:02.943598+0000","last_undegraded":"2023-10-18T11:38:02.943598+0000","last_fullsized":"2023-10-18T11:38:02.943598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:51.220855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:14.880065+0000","last_change":"2023-10-18T11:09:36.907280+0000","last_active":"2023-10-18T11:37:14.880065+0000","last_peered":"2023-10-18T11:37:14.880065+0000","last_clean":"2023-10-18T11:37:14.880065+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:37:14.880065+0000","last_undegraded":"2023-10-18T11:37:14.880065+0000","last_fullsized":"2023-10-18T11:37:14.880065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'409","reported_seq":499,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.157684+0000","last_change":"2023-10-18T11:09:46.096894+0000","last_active":"2023-10-18T11:37:56.157684+0000","last_peered":"2023-10-18T11:37:56.157684+0000","last_clean":"2023-10-18T11:37:56.157684+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:37:56.157684+0000","last_undegraded":"2023-10-18T11:37:56.157684+0000","last_fullsized":"2023-10-18T11:37:56.157684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":17064,"num_write":295,"num_write_kb":17834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'136","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.941639+0000","last_change":"2023-10-18T11:09:39.399750+0000","last_active":"2023-10-18T11:38:02.941639+0000","last_peered":"2023-10-18T11:38:02.941639+0000","last_clean":"2023-10-18T11:38:02.941639+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:38:02.941639+0000","last_undegraded":"2023-10-18T11:38:02.941639+0000","last_fullsized":"2023-10-18T11:38:02.941639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:27:35.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'255","reported_seq":297,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.648441+0000","last_change":"2023-10-18T11:38:13.648486+0000","last_active":"2023-10-18T11:38:13.648441+0000","last_peered":"2023-10-18T11:38:13.648441+0000","last_clean":"2023-10-18T11:38:13.648441+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:38:13.648441+0000","last_undegraded":"2023-10-18T11:38:13.648441+0000","last_fullsized":"2023-10-18T11:38:13.648441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'255","last_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_deep_scrub":"31'255","last_deep_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.648347+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:37.829270+0000","scrub_duration":0.0050540170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'390","reported_seq":459,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.086518+0000","last_change":"2023-10-18T11:09:46.109151+0000","last_active":"2023-10-18T11:37:56.086518+0000","last_peered":"2023-10-18T11:37:56.086518+0000","last_clean":"2023-10-18T11:37:56.086518+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:37:56.086518+0000","last_undegraded":"2023-10-18T11:37:56.086518+0000","last_fullsized":"2023-10-18T11:37:56.086518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":302,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'129","reported_seq":159,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.941813+0000","last_change":"2023-10-18T11:09:39.397483+0000","last_active":"2023-10-18T11:38:02.941813+0000","last_peered":"2023-10-18T11:38:02.941813+0000","last_clean":"2023-10-18T11:38:02.941813+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:38:02.941813+0000","last_undegraded":"2023-10-18T11:38:02.941813+0000","last_fullsized":"2023-10-18T11:38:02.941813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:45:22.524037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'1792","reported_seq":1826,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:58.351150+0000","last_change":"2023-10-18T11:09:36.916080+0000","last_active":"2023-10-18T11:37:58.351150+0000","last_peered":"2023-10-18T11:37:58.351150+0000","last_clean":"2023-10-18T11:37:58.351150+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:37:58.351150+0000","last_undegraded":"2023-10-18T11:37:58.351150+0000","last_fullsized":"2023-10-18T11:37:58.351150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":9197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'468","reported_seq":551,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.715256+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:36:58.715256+0000","last_peered":"2023-10-18T11:36:58.715256+0000","last_clean":"2023-10-18T11:36:58.715256+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:36:58.715256+0000","last_undegraded":"2023-10-18T11:36:58.715256+0000","last_fullsized":"2023-10-18T11:36:58.715256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":372,"num_write_kb":11119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'118","reported_seq":148,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.093107+0000","last_change":"2023-10-18T11:09:39.358262+0000","last_active":"2023-10-18T11:38:03.093107+0000","last_peered":"2023-10-18T11:38:03.093107+0000","last_clean":"2023-10-18T11:38:03.093107+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:38:03.093107+0000","last_undegraded":"2023-10-18T11:38:03.093107+0000","last_fullsized":"2023-10-18T11:38:03.093107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:38:00.404943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'909","reported_seq":942,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:40.118546+0000","last_change":"2023-10-18T11:09:36.893045+0000","last_active":"2023-10-18T11:37:40.118546+0000","last_peered":"2023-10-18T11:37:40.118546+0000","last_clean":"2023-10-18T11:37:40.118546+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:37:40.118546+0000","last_undegraded":"2023-10-18T11:37:40.118546+0000","last_fullsized":"2023-10-18T11:37:40.118546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:00:48.016973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'408","reported_seq":478,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.237329+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:37:05.237329+0000","last_peered":"2023-10-18T11:37:05.237329+0000","last_clean":"2023-10-18T11:37:05.237329+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:37:05.237329+0000","last_undegraded":"2023-10-18T11:37:05.237329+0000","last_fullsized":"2023-10-18T11:37:05.237329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":10922,"num_write":302,"num_write_kb":9791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'154","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.943257+0000","last_change":"2023-10-18T11:09:39.399188+0000","last_active":"2023-10-18T11:38:02.943257+0000","last_peered":"2023-10-18T11:38:02.943257+0000","last_clean":"2023-10-18T11:38:02.943257+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:38:02.943257+0000","last_undegraded":"2023-10-18T11:38:02.943257+0000","last_fullsized":"2023-10-18T11:38:02.943257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:21:39.702496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'1004","reported_seq":1046,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.374765+0000","last_change":"2023-10-18T11:38:14.374816+0000","last_active":"2023-10-18T11:38:14.374765+0000","last_peered":"2023-10-18T11:38:14.374765+0000","last_clean":"2023-10-18T11:38:14.374765+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:38:14.374765+0000","last_undegraded":"2023-10-18T11:38:14.374765+0000","last_fullsized":"2023-10-18T11:38:14.374765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1004","last_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_deep_scrub":"31'1004","last_deep_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.374705+0000","objects_scrubbed":4,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:02:58.873481+0000","scrub_duration":0.027697919000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":4702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'374","reported_seq":448,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415991+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:37:46.415991+0000","last_peered":"2023-10-18T11:37:46.415991+0000","last_clean":"2023-10-18T11:37:46.415991+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:37:46.415991+0000","last_undegraded":"2023-10-18T11:37:46.415991+0000","last_fullsized":"2023-10-18T11:37:46.415991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":12454,"num_write":279,"num_write_kb":12302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.988607+0000","last_change":"2023-10-18T11:38:12.988796+0000","last_active":"2023-10-18T11:38:12.988607+0000","last_peered":"2023-10-18T11:38:12.988607+0000","last_clean":"2023-10-18T11:38:12.988607+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:38:12.988607+0000","last_undegraded":"2023-10-18T11:38:12.988607+0000","last_fullsized":"2023-10-18T11:38:12.988607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.988423+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:04.605203+0000","scrub_duration":0.002583765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'410","reported_seq":843,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:10.019288+0000","last_change":"2023-10-18T11:38:10.019370+0000","last_active":"2023-10-18T11:38:10.019288+0000","last_peered":"2023-10-18T11:38:10.019288+0000","last_clean":"2023-10-18T11:38:10.019288+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:38:10.019288+0000","last_undegraded":"2023-10-18T11:38:10.019288+0000","last_fullsized":"2023-10-18T11:38:10.019288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'410","last_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_deep_scrub":"31'410","last_deep_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_clean_scrub_stamp":"2023-10-18T11:38:10.019192+0000","objects_scrubbed":7,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:01:36.193379+0000","scrub_duration":0.0084515079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":443,"num_write":404,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'508","reported_seq":638,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.143670+0000","last_change":"2023-10-18T11:09:46.114944+0000","last_active":"2023-10-18T11:37:05.143670+0000","last_peered":"2023-10-18T11:37:05.143670+0000","last_clean":"2023-10-18T11:37:05.143670+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:37:05.143670+0000","last_undegraded":"2023-10-18T11:37:05.143670+0000","last_fullsized":"2023-10-18T11:37:05.143670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":22458,"num_write":413,"num_write_kb":26305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'141","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.942837+0000","last_change":"2023-10-18T11:09:39.420430+0000","last_active":"2023-10-18T11:38:02.942837+0000","last_peered":"2023-10-18T11:38:02.942837+0000","last_clean":"2023-10-18T11:38:02.942837+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:38:02.942837+0000","last_undegraded":"2023-10-18T11:38:02.942837+0000","last_fullsized":"2023-10-18T11:38:02.942837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:12.994704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1124","reported_seq":1157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.963360+0000","last_change":"2023-10-18T11:09:36.904648+0000","last_active":"2023-10-18T11:37:53.963360+0000","last_peered":"2023-10-18T11:37:53.963360+0000","last_clean":"2023-10-18T11:37:53.963360+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:37:53.963360+0000","last_undegraded":"2023-10-18T11:37:53.963360+0000","last_fullsized":"2023-10-18T11:37:53.963360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:04:50.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'423","reported_seq":502,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.268334+0000","last_change":"2023-10-18T11:09:46.101866+0000","last_active":"2023-10-18T11:37:46.268334+0000","last_peered":"2023-10-18T11:37:46.268334+0000","last_clean":"2023-10-18T11:37:46.268334+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:37:46.268334+0000","last_undegraded":"2023-10-18T11:37:46.268334+0000","last_fullsized":"2023-10-18T11:37:46.268334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":12954,"num_write":319,"num_write_kb":22076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'121","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.914764+0000","last_change":"2023-10-18T11:09:39.398597+0000","last_active":"2023-10-18T11:38:02.914764+0000","last_peered":"2023-10-18T11:38:02.914764+0000","last_clean":"2023-10-18T11:38:02.914764+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:38:02.914764+0000","last_undegraded":"2023-10-18T11:38:02.914764+0000","last_fullsized":"2023-10-18T11:38:02.914764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'280","reported_seq":313,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:58.355155+0000","last_change":"2023-10-18T11:09:36.913285+0000","last_active":"2023-10-18T11:37:58.355155+0000","last_peered":"2023-10-18T11:37:58.355155+0000","last_clean":"2023-10-18T11:37:58.355155+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:37:58.355155+0000","last_undegraded":"2023-10-18T11:37:58.355155+0000","last_fullsized":"2023-10-18T11:37:58.355155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'511","reported_seq":601,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.085162+0000","last_change":"2023-10-18T11:09:46.094205+0000","last_active":"2023-10-18T11:37:46.085162+0000","last_peered":"2023-10-18T11:37:46.085162+0000","last_clean":"2023-10-18T11:37:46.085162+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:37:46.085162+0000","last_undegraded":"2023-10-18T11:37:46.085162+0000","last_fullsized":"2023-10-18T11:37:46.085162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":22028,"num_write":389,"num_write_kb":39504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'154","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.185994+0000","last_change":"2023-10-18T11:09:39.363739+0000","last_active":"2023-10-18T11:38:03.185994+0000","last_peered":"2023-10-18T11:38:03.185994+0000","last_clean":"2023-10-18T11:38:03.185994+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:38:03.185994+0000","last_undegraded":"2023-10-18T11:38:03.185994+0000","last_fullsized":"2023-10-18T11:38:03.185994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'403","reported_seq":834,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.336237+0000","last_change":"2023-10-18T11:38:15.336342+0000","last_active":"2023-10-18T11:38:15.336237+0000","last_peered":"2023-10-18T11:38:15.336237+0000","last_clean":"2023-10-18T11:38:15.336237+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:38:15.336237+0000","last_undegraded":"2023-10-18T11:38:15.336237+0000","last_fullsized":"2023-10-18T11:38:15.336237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'403","last_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_deep_scrub":"31'403","last_deep_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.336169+0000","objects_scrubbed":3,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:31.244376+0000","scrub_duration":0.0066715740000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180134,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":390,"num_read_kb":469,"num_write":396,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'442","reported_seq":538,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415763+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:37:46.415763+0000","last_peered":"2023-10-18T11:37:46.415763+0000","last_clean":"2023-10-18T11:37:46.415763+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:37:46.415763+0000","last_undegraded":"2023-10-18T11:37:46.415763+0000","last_fullsized":"2023-10-18T11:37:46.415763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17404,"num_write":347,"num_write_kb":27808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'153","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.062327+0000","last_change":"2023-10-18T11:09:39.351468+0000","last_active":"2023-10-18T11:38:03.062327+0000","last_peered":"2023-10-18T11:38:03.062327+0000","last_clean":"2023-10-18T11:38:03.062327+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:38:03.062327+0000","last_undegraded":"2023-10-18T11:38:03.062327+0000","last_fullsized":"2023-10-18T11:38:03.062327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'187","reported_seq":219,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:51.002464+0000","last_change":"2023-10-18T11:09:36.896596+0000","last_active":"2023-10-18T11:37:51.002464+0000","last_peered":"2023-10-18T11:37:51.002464+0000","last_clean":"2023-10-18T11:37:51.002464+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:37:51.002464+0000","last_undegraded":"2023-10-18T11:37:51.002464+0000","last_fullsized":"2023-10-18T11:37:51.002464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:15:34.901112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'380","reported_seq":474,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415877+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:37:46.415877+0000","last_peered":"2023-10-18T11:37:46.415877+0000","last_clean":"2023-10-18T11:37:46.415877+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:37:46.415877+0000","last_undegraded":"2023-10-18T11:37:46.415877+0000","last_fullsized":"2023-10-18T11:37:46.415877+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":277,"num_write_kb":11173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'503","reported_seq":586,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:51.201918+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:37:51.201918+0000","last_peered":"2023-10-18T11:37:51.201918+0000","last_clean":"2023-10-18T11:37:51.201918+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:37:51.201918+0000","last_undegraded":"2023-10-18T11:37:51.201918+0000","last_fullsized":"2023-10-18T11:37:51.201918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":392,"num_write_kb":15493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'157","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.080691+0000","last_change":"2023-10-18T11:09:39.418416+0000","last_active":"2023-10-18T11:38:03.080691+0000","last_peered":"2023-10-18T11:38:03.080691+0000","last_clean":"2023-10-18T11:38:03.080691+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:38:03.080691+0000","last_undegraded":"2023-10-18T11:38:03.080691+0000","last_fullsized":"2023-10-18T11:38:03.080691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'1035","reported_seq":1068,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.287009+0000","last_change":"2023-10-18T11:09:36.893158+0000","last_active":"2023-10-18T11:38:03.287009+0000","last_peered":"2023-10-18T11:38:03.287009+0000","last_clean":"2023-10-18T11:38:03.287009+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:38:03.287009+0000","last_undegraded":"2023-10-18T11:38:03.287009+0000","last_fullsized":"2023-10-18T11:38:03.287009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":6522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'495","reported_seq":600,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.153166+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:37:05.153166+0000","last_peered":"2023-10-18T11:37:05.153166+0000","last_clean":"2023-10-18T11:37:05.153166+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:37:05.153166+0000","last_undegraded":"2023-10-18T11:37:05.153166+0000","last_fullsized":"2023-10-18T11:37:05.153166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:45.362738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":22638,"num_write":397,"num_write_kb":22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'163","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.056071+0000","last_change":"2023-10-18T11:09:39.421160+0000","last_active":"2023-10-18T11:38:03.056071+0000","last_peered":"2023-10-18T11:38:03.056071+0000","last_clean":"2023-10-18T11:38:03.056071+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:38:03.056071+0000","last_undegraded":"2023-10-18T11:38:03.056071+0000","last_fullsized":"2023-10-18T11:38:03.056071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'472","reported_seq":969,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:47.827856+0000","last_change":"2023-10-18T11:09:36.911629+0000","last_active":"2023-10-18T11:37:47.827856+0000","last_peered":"2023-10-18T11:37:47.827856+0000","last_clean":"2023-10-18T11:37:47.827856+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:37:47.827856+0000","last_undegraded":"2023-10-18T11:37:47.827856+0000","last_fullsized":"2023-10-18T11:37:47.827856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":464,"num_read_kb":507,"num_write":469,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'1258","reported_seq":1759,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:57.546699+0000","last_change":"2023-10-18T11:09:36.894351+0000","last_active":"2023-10-18T11:37:57.546699+0000","last_peered":"2023-10-18T11:37:57.546699+0000","last_clean":"2023-10-18T11:37:57.546699+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:37:57.546699+0000","last_undegraded":"2023-10-18T11:37:57.546699+0000","last_fullsized":"2023-10-18T11:37:57.546699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:42:11.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4346422,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":505,"num_write":1257,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'154","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:09.051185+0000","last_change":"2023-10-18T11:38:09.051296+0000","last_active":"2023-10-18T11:38:09.051185+0000","last_peered":"2023-10-18T11:38:09.051185+0000","last_clean":"2023-10-18T11:38:09.051185+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:38:09.051185+0000","last_undegraded":"2023-10-18T11:38:09.051185+0000","last_fullsized":"2023-10-18T11:38:09.051185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_clean_scrub_stamp":"2023-10-18T11:38:09.051022+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:26.016569+0000","scrub_duration":0.003629073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'380","reported_seq":477,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.385287+0000","last_change":"2023-10-18T11:09:46.117246+0000","last_active":"2023-10-18T11:37:16.385287+0000","last_peered":"2023-10-18T11:37:16.385287+0000","last_clean":"2023-10-18T11:37:16.385287+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:37:16.385287+0000","last_undegraded":"2023-10-18T11:37:16.385287+0000","last_fullsized":"2023-10-18T11:37:16.385287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":9856,"num_write":276,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2733","reported_seq":2766,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:53.313623+0000","last_change":"2023-10-18T11:09:36.912013+0000","last_active":"2023-10-18T11:37:53.313623+0000","last_peered":"2023-10-18T11:37:53.313623+0000","last_clean":"2023-10-18T11:37:53.313623+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:37:53.313623+0000","last_undegraded":"2023-10-18T11:37:53.313623+0000","last_fullsized":"2023-10-18T11:37:53.313623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":2733,"log_dups_size":0,"ondisk_log_size":2733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2726,"num_write_kb":13571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'169","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.602939+0000","last_change":"2023-10-18T11:38:15.602980+0000","last_active":"2023-10-18T11:38:15.602939+0000","last_peered":"2023-10-18T11:38:15.602939+0000","last_clean":"2023-10-18T11:38:15.602939+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:38:15.602939+0000","last_undegraded":"2023-10-18T11:38:15.602939+0000","last_fullsized":"2023-10-18T11:38:15.602939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'169","last_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_deep_scrub":"31'169","last_deep_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.602878+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:15:22.593515+0000","scrub_duration":0.0020891960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'415","reported_seq":491,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.410397+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:37:16.410397+0000","last_peered":"2023-10-18T11:37:16.410397+0000","last_clean":"2023-10-18T11:37:16.410397+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:37:16.410397+0000","last_undegraded":"2023-10-18T11:37:16.410397+0000","last_fullsized":"2023-10-18T11:37:16.410397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":317,"num_write_kb":9906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'168","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.138407+0000","last_change":"2023-10-18T11:09:39.359747+0000","last_active":"2023-10-18T11:38:03.138407+0000","last_peered":"2023-10-18T11:38:03.138407+0000","last_clean":"2023-10-18T11:38:03.138407+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:38:03.138407+0000","last_undegraded":"2023-10-18T11:38:03.138407+0000","last_fullsized":"2023-10-18T11:38:03.138407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:08:20.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'156","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.981786+0000","last_change":"2023-10-18T11:09:39.242600+0000","last_active":"2023-10-18T11:38:02.981786+0000","last_peered":"2023-10-18T11:38:02.981786+0000","last_clean":"2023-10-18T11:38:02.981786+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:38:02.981786+0000","last_undegraded":"2023-10-18T11:38:02.981786+0000","last_fullsized":"2023-10-18T11:38:02.981786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'163","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.994106+0000","last_change":"2023-10-18T11:10:10.416758+0000","last_active":"2023-10-18T11:38:02.994106+0000","last_peered":"2023-10-18T11:38:02.994106+0000","last_clean":"2023-10-18T11:38:02.994106+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:38:02.994106+0000","last_undegraded":"2023-10-18T11:38:02.994106+0000","last_fullsized":"2023-10-18T11:38:02.994106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"31'146","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.084535+0000","last_change":"2023-10-18T11:38:16.084653+0000","last_active":"2023-10-18T11:38:16.084535+0000","last_peered":"2023-10-18T11:38:16.084535+0000","last_clean":"2023-10-18T11:38:16.084535+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:38:16.084535+0000","last_undegraded":"2023-10-18T11:38:16.084535+0000","last_fullsized":"2023-10-18T11:38:16.084535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.084368+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:45.312981+0000","scrub_duration":0.0039813269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'131","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.024992+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:38:03.024992+0000","last_peered":"2023-10-18T11:38:03.024992+0000","last_clean":"2023-10-18T11:38:03.024992+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:38:03.024992+0000","last_undegraded":"2023-10-18T11:38:03.024992+0000","last_fullsized":"2023-10-18T11:38:03.024992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'151","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.075631+0000","last_change":"2023-10-18T11:09:39.423043+0000","last_active":"2023-10-18T11:38:03.075631+0000","last_peered":"2023-10-18T11:38:03.075631+0000","last_clean":"2023-10-18T11:38:03.075631+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:38:03.075631+0000","last_undegraded":"2023-10-18T11:38:03.075631+0000","last_fullsized":"2023-10-18T11:38:03.075631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'152","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.137339+0000","last_change":"2023-10-18T11:09:39.351604+0000","last_active":"2023-10-18T11:38:03.137339+0000","last_peered":"2023-10-18T11:38:03.137339+0000","last_clean":"2023-10-18T11:38:03.137339+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:38:03.137339+0000","last_undegraded":"2023-10-18T11:38:03.137339+0000","last_fullsized":"2023-10-18T11:38:03.137339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:22:34.707245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'128","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.052206+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:38:03.052206+0000","last_peered":"2023-10-18T11:38:03.052206+0000","last_clean":"2023-10-18T11:38:03.052206+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:38:03.052206+0000","last_undegraded":"2023-10-18T11:38:03.052206+0000","last_fullsized":"2023-10-18T11:38:03.052206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'145","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.050664+0000","last_change":"2023-10-18T11:09:39.419909+0000","last_active":"2023-10-18T11:38:03.050664+0000","last_peered":"2023-10-18T11:38:03.050664+0000","last_clean":"2023-10-18T11:38:03.050664+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:38:03.050664+0000","last_undegraded":"2023-10-18T11:38:03.050664+0000","last_fullsized":"2023-10-18T11:38:03.050664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'162","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.032277+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:38:03.032277+0000","last_peered":"2023-10-18T11:38:03.032277+0000","last_clean":"2023-10-18T11:38:03.032277+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:38:03.032277+0000","last_undegraded":"2023-10-18T11:38:03.032277+0000","last_fullsized":"2023-10-18T11:38:03.032277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'149","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.061073+0000","last_change":"2023-10-18T11:09:39.349250+0000","last_active":"2023-10-18T11:38:03.061073+0000","last_peered":"2023-10-18T11:38:03.061073+0000","last_clean":"2023-10-18T11:38:03.061073+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:38:03.061073+0000","last_undegraded":"2023-10-18T11:38:03.061073+0000","last_fullsized":"2023-10-18T11:38:03.061073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'153","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.186667+0000","last_change":"2023-10-18T11:09:39.361414+0000","last_active":"2023-10-18T11:38:03.186667+0000","last_peered":"2023-10-18T11:38:03.186667+0000","last_clean":"2023-10-18T11:38:03.186667+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:38:03.186667+0000","last_undegraded":"2023-10-18T11:38:03.186667+0000","last_fullsized":"2023-10-18T11:38:03.186667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'152","reported_seq":182,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.137391+0000","last_change":"2023-10-18T11:09:39.399067+0000","last_active":"2023-10-18T11:38:03.137391+0000","last_peered":"2023-10-18T11:38:03.137391+0000","last_clean":"2023-10-18T11:38:03.137391+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:38:03.137391+0000","last_undegraded":"2023-10-18T11:38:03.137391+0000","last_fullsized":"2023-10-18T11:38:03.137391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:05:19.893374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'153","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.943373+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:38:02.943373+0000","last_peered":"2023-10-18T11:38:02.943373+0000","last_clean":"2023-10-18T11:38:02.943373+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:38:02.943373+0000","last_undegraded":"2023-10-18T11:38:02.943373+0000","last_fullsized":"2023-10-18T11:38:02.943373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:55:04.730798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'167","reported_seq":198,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.993498+0000","last_change":"2023-10-18T11:09:39.320727+0000","last_active":"2023-10-18T11:38:02.993498+0000","last_peered":"2023-10-18T11:38:02.993498+0000","last_clean":"2023-10-18T11:38:02.993498+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:38:02.993498+0000","last_undegraded":"2023-10-18T11:38:02.993498+0000","last_fullsized":"2023-10-18T11:38:02.993498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'146","reported_seq":169,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:11.030948+0000","last_change":"2023-10-18T11:10:10.401580+0000","last_active":"2023-10-18T11:38:11.030948+0000","last_peered":"2023-10-18T11:38:11.030948+0000","last_clean":"2023-10-18T11:38:11.030948+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:38:11.030948+0000","last_undegraded":"2023-10-18T11:38:11.030948+0000","last_fullsized":"2023-10-18T11:38:11.030948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'144","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.055822+0000","last_change":"2023-10-18T11:09:39.354336+0000","last_active":"2023-10-18T11:38:03.055822+0000","last_peered":"2023-10-18T11:38:03.055822+0000","last_clean":"2023-10-18T11:38:03.055822+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:38:03.055822+0000","last_undegraded":"2023-10-18T11:38:03.055822+0000","last_fullsized":"2023-10-18T11:38:03.055822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'154","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.079372+0000","last_change":"2023-10-18T11:09:39.401976+0000","last_active":"2023-10-18T11:38:03.079372+0000","last_peered":"2023-10-18T11:38:03.079372+0000","last_clean":"2023-10-18T11:38:03.079372+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:38:03.079372+0000","last_undegraded":"2023-10-18T11:38:03.079372+0000","last_fullsized":"2023-10-18T11:38:03.079372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'135","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.187466+0000","last_change":"2023-10-18T11:09:39.366222+0000","last_active":"2023-10-18T11:38:03.187466+0000","last_peered":"2023-10-18T11:38:03.187466+0000","last_clean":"2023-10-18T11:38:03.187466+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:38:03.187466+0000","last_undegraded":"2023-10-18T11:38:03.187466+0000","last_fullsized":"2023-10-18T11:38:03.187466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'173","reported_seq":195,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.072979+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:38:03.072979+0000","last_peered":"2023-10-18T11:38:03.072979+0000","last_clean":"2023-10-18T11:38:03.072979+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:38:03.072979+0000","last_undegraded":"2023-10-18T11:38:03.072979+0000","last_fullsized":"2023-10-18T11:38:03.072979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'137","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.914624+0000","last_change":"2023-10-18T11:09:39.400563+0000","last_active":"2023-10-18T11:38:02.914624+0000","last_peered":"2023-10-18T11:38:02.914624+0000","last_clean":"2023-10-18T11:38:02.914624+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:38:02.914624+0000","last_undegraded":"2023-10-18T11:38:02.914624+0000","last_fullsized":"2023-10-18T11:38:02.914624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'153","reported_seq":182,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.133289+0000","last_change":"2023-10-18T11:09:39.320580+0000","last_active":"2023-10-18T11:38:03.133289+0000","last_peered":"2023-10-18T11:38:03.133289+0000","last_clean":"2023-10-18T11:38:03.133289+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:38:03.133289+0000","last_undegraded":"2023-10-18T11:38:03.133289+0000","last_fullsized":"2023-10-18T11:38:03.133289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:11:02.225724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'147","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.137597+0000","last_change":"2023-10-18T11:09:39.320508+0000","last_active":"2023-10-18T11:38:03.137597+0000","last_peered":"2023-10-18T11:38:03.137597+0000","last_clean":"2023-10-18T11:38:03.137597+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:38:03.137597+0000","last_undegraded":"2023-10-18T11:38:03.137597+0000","last_fullsized":"2023-10-18T11:38:03.137597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:03:36.378414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'145","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.943559+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:38:02.943559+0000","last_peered":"2023-10-18T11:38:02.943559+0000","last_clean":"2023-10-18T11:38:02.943559+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:38:02.943559+0000","last_undegraded":"2023-10-18T11:38:02.943559+0000","last_fullsized":"2023-10-18T11:38:02.943559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:47:11.432343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'150","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.945550+0000","last_change":"2023-10-18T11:38:13.945663+0000","last_active":"2023-10-18T11:38:13.945550+0000","last_peered":"2023-10-18T11:38:13.945550+0000","last_clean":"2023-10-18T11:38:13.945550+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:38:13.945550+0000","last_undegraded":"2023-10-18T11:38:13.945550+0000","last_fullsized":"2023-10-18T11:38:13.945550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.945379+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.853585+0000","scrub_duration":0.0032551009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'134","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.941753+0000","last_change":"2023-10-18T11:09:39.360846+0000","last_active":"2023-10-18T11:38:02.941753+0000","last_peered":"2023-10-18T11:38:02.941753+0000","last_clean":"2023-10-18T11:38:02.941753+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:38:02.941753+0000","last_undegraded":"2023-10-18T11:38:02.941753+0000","last_fullsized":"2023-10-18T11:38:02.941753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:45:02.892636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'143","reported_seq":165,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.983137+0000","last_change":"2023-10-18T11:10:10.413563+0000","last_active":"2023-10-18T11:38:02.983137+0000","last_peered":"2023-10-18T11:38:02.983137+0000","last_clean":"2023-10-18T11:38:02.983137+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:38:02.983137+0000","last_undegraded":"2023-10-18T11:38:02.983137+0000","last_fullsized":"2023-10-18T11:38:02.983137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'127","reported_seq":156,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.941703+0000","last_change":"2023-10-18T11:09:39.355047+0000","last_active":"2023-10-18T11:38:02.941703+0000","last_peered":"2023-10-18T11:38:02.941703+0000","last_clean":"2023-10-18T11:38:02.941703+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:38:02.941703+0000","last_undegraded":"2023-10-18T11:38:02.941703+0000","last_fullsized":"2023-10-18T11:38:02.941703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:57:38.284163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'137","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.061703+0000","last_change":"2023-10-18T11:09:39.418362+0000","last_active":"2023-10-18T11:38:03.061703+0000","last_peered":"2023-10-18T11:38:03.061703+0000","last_clean":"2023-10-18T11:38:03.061703+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:38:03.061703+0000","last_undegraded":"2023-10-18T11:38:03.061703+0000","last_fullsized":"2023-10-18T11:38:03.061703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'142","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.179165+0000","last_change":"2023-10-18T11:09:39.363750+0000","last_active":"2023-10-18T11:38:03.179165+0000","last_peered":"2023-10-18T11:38:03.179165+0000","last_clean":"2023-10-18T11:38:03.179165+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:38:03.179165+0000","last_undegraded":"2023-10-18T11:38:03.179165+0000","last_fullsized":"2023-10-18T11:38:03.179165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'165","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:11.775476+0000","last_change":"2023-10-18T11:38:11.775586+0000","last_active":"2023-10-18T11:38:11.775476+0000","last_peered":"2023-10-18T11:38:11.775476+0000","last_clean":"2023-10-18T11:38:11.775476+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:38:11.775476+0000","last_undegraded":"2023-10-18T11:38:11.775476+0000","last_fullsized":"2023-10-18T11:38:11.775476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:11.775315+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:28.740862+0000","scrub_duration":0.0041709950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'146","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.941942+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:38:02.941942+0000","last_peered":"2023-10-18T11:38:02.941942+0000","last_clean":"2023-10-18T11:38:02.941942+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:38:02.941942+0000","last_undegraded":"2023-10-18T11:38:02.941942+0000","last_fullsized":"2023-10-18T11:38:02.941942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:29:34.071910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2017,"num_read_kb":484709,"num_write":10619,"num_write_kb":576779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13929,"ondisk_log_size":13929,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9424,"ondisk_log_size":9424,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":100007018,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":2171,"num_read_kb":2416,"num_write":26219,"num_write_kb":112209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159006720,"data_stored":200014036,"data_compressed":12429396,"data_compressed_allocated":19357696,"data_compressed_original":60612608,"omap_allocated":0,"internal_metadata":0},"log_size":24287,"ondisk_log_size":24287,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509794,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113708,"kb_used_data":24228,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94258132,"statfs":{"total":96636764160,"available":96520327168,"internally_reserved":0,"allocated":24809472,"data_stored":31797443,"data_compressed":2010206,"data_compressed_allocated":3112960,"data_compressed_original":10338304,"omap_allocated":1588,"internal_metadata":91617740},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.45100000000000001,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.85799999999999998,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.69699999999999995},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":19.158000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.91900000000000004,"15min":0.72999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":19.673999999999999,"15min":19.673999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.88100000000000001,"15min":0.74299999999999999},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.36099999999999999},"max":{"1min":1.01,"5min":15.692,"15min":15.692},"last":0.629}]},{"osd":2,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.224,"5min":1.27,"15min":1.9239999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.71499999999999997,"15min":0.68700000000000006},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95999999999999996,"5min":5.444,"15min":5.444},"last":0.50600000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.93000000000000005,"15min":0.82099999999999995},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0660000000000001,"5min":12.368,"15min":12.368},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.67400000000000004,"15min":0.71799999999999997},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":1.353,"5min":1.3899999999999999,"15min":13.1},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.439,"5min":1.895,"15min":1.895},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47099999999999997,"5min":1.321,"15min":1.321},"last":0.34599999999999997}]},{"osd":5,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53600000000000003,"5min":0.85099999999999998,"15min":1.081},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.438,"15min":0.40899999999999997},"min":{"1min":0.30099999999999999,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.505,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.439,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":0.55100000000000005,"5min":3.4409999999999998,"15min":3.4409999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54100000000000004,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.46800000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509792,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93740,"kb_used_data":18148,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278100,"statfs":{"total":96636764160,"available":96540774400,"internally_reserved":0,"allocated":18583552,"data_stored":23213882,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.64400000000000002},"min":{"1min":0.435,"5min":0.33600000000000002,"15min":0.31},"max":{"1min":0.82399999999999995,"5min":1.0740000000000001,"15min":9.3190000000000008},"last":0.439},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59699999999999998,"15min":0.66700000000000004},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.28899999999999998},"max":{"1min":1.046,"5min":1.1699999999999999,"15min":15.282999999999999},"last":0.59199999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61199999999999999,"15min":0.65100000000000002},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.0880000000000001,"5min":1.202,"15min":6.6429999999999998},"last":0.875},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97999999999999998,"5min":1.153,"15min":1.748},"last":0.54500000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.35799999999999998,"15min":0.33300000000000002},"max":{"1min":1.05,"5min":1.355,"15min":1.839},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34499999999999997},"max":{"1min":1.153,"5min":1.468,"15min":1.954},"last":0.57699999999999996}]},{"osd":3,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68000000000000005,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":1.2410000000000001,"15min":13.840999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.77400000000000002},"min":{"1min":0.45700000000000002,"5min":0.36199999999999999,"15min":0.35099999999999998},"max":{"1min":1.0109999999999999,"5min":1.1950000000000001,"15min":23.155999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25600000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52300000000000002,"5min":0.54100000000000004,"15min":0.88},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.46800000000000003,"5min":0.53500000000000003,"15min":1.0469999999999999},"last":0.29799999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38700000000000001,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.23300000000000001},"max":{"1min":0.501,"5min":0.54300000000000004,"15min":0.56799999999999995},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.56100000000000005,"5min":0.624,"15min":0.624},"last":0.32000000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.40100000000000002},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.77600000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41599999999999998,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57299999999999995,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.311}]}]},{"osd":4,"up_from":15,"seq":64424509793,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87864,"kb_used_data":20592,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94283976,"statfs":{"total":96636764160,"available":96546791424,"internally_reserved":0,"allocated":21086208,"data_stored":26657639,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.32200000000000001,"15min":0.29599999999999999},"max":{"1min":0.92300000000000004,"5min":1.21,"15min":1.663},"last":0.502},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68600000000000005,"15min":0.623},"min":{"1min":0.45500000000000002,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":0.98699999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.33700000000000002,"15min":0.32500000000000001},"max":{"1min":0.94799999999999995,"5min":1.246,"15min":1.8620000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.45500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.056,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.629}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1180000000000001,"5min":1.1990000000000001,"15min":1.248},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.38700000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.2350000000000001,"15min":3.5579999999999998},"last":0.51500000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.373},"max":{"1min":1.119,"5min":1.4930000000000001,"15min":1.5049999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":1.0840000000000001,"5min":1.4019999999999999,"15min":1.8779999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.223},"max":{"1min":0.504,"5min":0.51500000000000001,"15min":0.72699999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.32100000000000001,"5min":0.248,"15min":0.24399999999999999},"max":{"1min":0.53600000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40899999999999997}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.24299999999999999,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.57799999999999996,"15min":0.622},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.41099999999999998,"15min":0.40200000000000002},"min":{"1min":0.36599999999999999,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.54600000000000004,"5min":0.65900000000000003,"15min":0.67400000000000004},"last":0.47099999999999997}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.377},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.56299999999999994,"5min":0.67300000000000004,"15min":0.68999999999999995},"last":0.439}]}]},{"osd":3,"up_from":15,"seq":64424509792,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144544,"kb_used_data":27288,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94227296,"statfs":{"total":96636764160,"available":96488751104,"internally_reserved":0,"allocated":27942912,"data_stored":33976532,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":1591,"internal_metadata":120060361},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.3260000000000001,"15min":1.129},"min":{"1min":0.70999999999999996,"5min":0.40899999999999997,"15min":0.314},"max":{"1min":2.673,"5min":24.654,"15min":24.654},"last":1.087},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.3380000000000001,"15min":1.159},"min":{"1min":0.42699999999999999,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":2.1589999999999998,"5min":18.518000000000001,"15min":18.518000000000001},"last":1.169}]},{"osd":1,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3759999999999999,"15min":1.25},"min":{"1min":0.64500000000000002,"5min":0.441,"15min":0.35399999999999998},"max":{"1min":2.7869999999999999,"5min":16.361999999999998,"15min":16.361999999999998},"last":0.75},{"interface":"front","average":{"1min":1.2,"5min":1.5189999999999999,"15min":1.3620000000000001},"min":{"1min":0.72299999999999998,"5min":0.56200000000000006,"15min":0.43099999999999999},"max":{"1min":1.7769999999999999,"5min":24.611000000000001,"15min":24.611000000000001},"last":1.222}]},{"osd":2,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5029999999999999,"15min":1.395},"min":{"1min":0.49099999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.7269999999999999,"5min":16.576000000000001,"15min":16.576000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.6419999999999999,"15min":1.484},"min":{"1min":0.83199999999999996,"5min":0.46500000000000002,"15min":0.45100000000000001},"max":{"1min":2.04,"5min":24.553000000000001,"15min":24.553000000000001},"last":1.3460000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.4339999999999999,"15min":1.224},"min":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.432},"max":{"1min":2.3170000000000002,"5min":18.721,"15min":18.721},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3560000000000001,"15min":1.26},"min":{"1min":0.66800000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2189999999999999,"5min":16.481000000000002,"15min":16.481000000000002},"last":1.2769999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.5589999999999999,"15min":1.377},"min":{"1min":0.73299999999999998,"5min":0.59799999999999998,"15min":0.44700000000000001},"max":{"1min":2.2519999999999998,"5min":24.786999999999999,"15min":24.786999999999999},"last":1.7050000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.6080000000000001,"15min":1.355},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.49199999999999999},"max":{"1min":2.464,"5min":18.681999999999999,"15min":18.681999999999999},"last":1.121}]},{"osd":6,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4870000000000001,"15min":1.3959999999999999},"min":{"1min":0.67800000000000005,"5min":0.56100000000000005,"15min":0.52900000000000003},"max":{"1min":2.0129999999999999,"5min":16.513999999999999,"15min":16.513999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.665,"15min":1.496},"min":{"1min":0.79300000000000004,"5min":0.65600000000000003,"15min":0.54300000000000004},"max":{"1min":2.3580000000000001,"5min":24.834,"15min":24.834},"last":1.7769999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.681,"15min":1.4670000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.298,"5min":18.800000000000001,"15min":18.800000000000001},"last":1.069},{"interface":"front","average":{"1min":1.607,"5min":1.6200000000000001,"15min":1.5169999999999999},"min":{"1min":0.84399999999999997,"5min":0.496,"15min":0.496},"max":{"1min":2.5510000000000002,"5min":16.544,"15min":16.544},"last":1.5880000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509792,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94552,"kb_used_data":13456,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94277288,"statfs":{"total":96636764160,"available":96539942912,"internally_reserved":0,"allocated":13778944,"data_stored":17047576,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.66600000000000004,"5min":0.378,"15min":0.308},"max":{"1min":2.1139999999999999,"5min":2.5830000000000002,"15min":2.9249999999999998},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.1200000000000001,"15min":1.1259999999999999},"min":{"1min":0.436,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":3.2919999999999998,"5min":3.2919999999999998,"15min":3.964},"last":1.3080000000000001}]},{"osd":1,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.2410000000000001,"15min":1.214},"min":{"1min":0.628,"5min":0.45300000000000001,"15min":0.40200000000000002},"max":{"1min":2.4060000000000001,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.369,"15min":1.3},"min":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":5.2629999999999999,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.448,"15min":1.379},"min":{"1min":0.61499999999999999,"5min":0.44,"15min":0.44},"max":{"1min":4.1459999999999999,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":1.048},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.5049999999999999,"15min":1.3999999999999999},"min":{"1min":0.90200000000000002,"5min":0.55400000000000005,"15min":0.53900000000000003},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.2050000000000001,"15min":1.1419999999999999},"min":{"1min":0.55600000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.3759999999999999,"5min":3.3759999999999999,"15min":3.3759999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2729999999999999,"15min":1.2170000000000001},"min":{"1min":0.63200000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.82099999999999995}]},{"osd":5,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.3759999999999999,"15min":1.2609999999999999},"min":{"1min":0.752,"5min":0.58399999999999996,"15min":0.46200000000000002},"max":{"1min":5.0529999999999999,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.532,"5min":1.3640000000000001,"15min":1.27},"min":{"1min":0.65900000000000003,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":3.4529999999999998,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.57899999999999996}]},{"osd":6,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.407,"15min":1.333},"min":{"1min":0.80000000000000004,"5min":0.60199999999999998,"15min":0.49399999999999999},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.4850000000000001,"15min":1.371},"min":{"1min":1.01,"5min":0.68100000000000005,"15min":0.50700000000000001},"max":{"1min":5.133,"5min":5.133,"15min":5.133},"last":1.0209999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:37:13 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.4690000000000001,"15min":1.3879999999999999},"min":{"1min":0.72899999999999998,"5min":0.52500000000000002,"15min":0.48599999999999999},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.544,"15min":1.456},"min":{"1min":0.84899999999999998,"5min":0.629,"15min":0.55900000000000005},"max":{"1min":4.0430000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":1.147}]}]},{"osd":1,"up_from":15,"seq":64424509793,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153264,"kb_used_data":23592,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94218576,"statfs":{"total":96636764160,"available":96479821824,"internally_reserved":0,"allocated":24158208,"data_stored":30584690,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.056,"15min":1.0980000000000001},"min":{"1min":0.66700000000000004,"5min":0.38400000000000001,"15min":0.313},"max":{"1min":1.4670000000000001,"5min":2.5649999999999999,"15min":10.836},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.169,"15min":1.1319999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":3.8410000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1919999999999999,"15min":1.1890000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.32900000000000001},"max":{"1min":1.931,"5min":3.2389999999999999,"15min":4.4199999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.385,"15min":1.335},"min":{"1min":0.50900000000000001,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":8.6229999999999993,"5min":8.6229999999999993,"15min":10.782},"last":0.92400000000000004}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.343,"15min":1.405},"min":{"1min":0.70599999999999996,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":1.9330000000000001,"5min":2.8420000000000001,"15min":6.8150000000000004},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.234,"5min":1.2929999999999999,"15min":1.319},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.0609999999999999,"5min":3.1200000000000001,"15min":3.79},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.1990000000000001,"15min":1.1870000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.376},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":4.3890000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.65700000000000003,"5min":0.63300000000000001,"15min":0.60899999999999999},"max":{"1min":2.2919999999999998,"5min":2.6349999999999998,"15min":6.9950000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.288,"15min":1.248},"min":{"1min":0.64700000000000002,"5min":0.58599999999999997,"15min":0.495},"max":{"1min":4.2939999999999996,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3100000000000001,"15min":1.3029999999999999},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52900000000000003},"max":{"1min":2.1320000000000001,"5min":2.294,"15min":4.3419999999999996},"last":0.73399999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.407,"15min":1.405},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9059999999999999,"5min":2.7400000000000002,"15min":6.944},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.353},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55300000000000005},"max":{"1min":2.2130000000000001,"5min":3.3849999999999998,"15min":3.657},"last":0.79100000000000004}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4399999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":2.3100000000000001,"5min":3.27,"15min":3.722},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.45,"15min":1.4430000000000001},"min":{"1min":0.72399999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2589999999999999,"5min":2.6309999999999998,"15min":4.2919999999999998},"last":0.88200000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509793,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106768,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94265072,"statfs":{"total":96636764160,"available":96527433728,"internally_reserved":0,"allocated":17768448,"data_stored":22732859,"data_compressed":1487303,"data_compressed_allocated":2297856,"data_compressed_original":7491584,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.0209999999999999,"15min":1.044},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":5.2450000000000001,"5min":5.2450000000000001,"15min":5.7380000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.0780000000000001,"15min":1.1779999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.738,"5min":1.9830000000000001,"15min":20.128},"last":1.216}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.133,"15min":1.1990000000000001},"min":{"1min":0.68700000000000006,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":2.1200000000000001,"5min":2.8039999999999998,"15min":3.2839999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.728,"5min":1.2809999999999999,"15min":1.2949999999999999},"min":{"1min":0.52400000000000002,"5min":0.38900000000000001,"15min":0.31900000000000001},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":0.52400000000000002}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.28,"15min":1.272},"min":{"1min":0.72899999999999998,"5min":0.47699999999999998,"15min":0.44600000000000001},"max":{"1min":2.1499999999999999,"5min":4.0510000000000002,"15min":8.9879999999999995},"last":1.3},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.3600000000000001,"15min":1.4139999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.1480000000000001,"5min":2.7639999999999998,"15min":5.6219999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.252,"15min":1.2150000000000001},"min":{"1min":0.59699999999999998,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1599999999999999,"15min":1.161},"min":{"1min":0.80700000000000005,"5min":0.53800000000000003,"15min":0.51800000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":3.6219999999999999},"last":1.149}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.2689999999999999,"15min":1.2529999999999999},"min":{"1min":0.88,"5min":0.61899999999999999,"15min":0.49099999999999999},"max":{"1min":2.323,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.3140000000000001,"15min":1.3},"min":{"1min":0.91200000000000003,"5min":0.59299999999999997,"15min":0.56200000000000006},"max":{"1min":2.0289999999999999,"5min":2.2349999999999999,"15min":2.8140000000000001},"last":0.95199999999999996}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.3779999999999999,"15min":1.369},"min":{"1min":0.84699999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2360000000000002,"5min":2.274,"15min":2.7669999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.542,"5min":1.391,"15min":1.3620000000000001},"min":{"1min":0.89900000000000002,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.7669999999999999},"last":1.101}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.47,"15min":1.444},"min":{"1min":0.80700000000000005,"5min":0.56599999999999995,"15min":0.49199999999999999},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.915},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.3939999999999999,"15min":1.375},"min":{"1min":0.77500000000000002,"5min":0.66500000000000004,"15min":0.59999999999999998},"max":{"1min":2.2829999999999999,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1.5469999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542496,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98600,"kb_used_data":13344,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273240,"statfs":{"total":96636764160,"available":96535797760,"internally_reserved":0,"allocated":13664256,"data_stored":16262951,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.27300000000000002},"max":{"1min":1.1459999999999999,"5min":3.387,"15min":3.387},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.40999999999999998,"5min":0.33300000000000002,"15min":0.31},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.25},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.53000000000000003,"5min":0.38200000000000001,"15min":0.312},"max":{"1min":1.081,"5min":1.554,"15min":1.669},"last":0.627}]},{"osd":2,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.64400000000000002},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.34999999999999998},"max":{"1min":1.1850000000000001,"5min":1.2070000000000001,"15min":1.712},"last":0.443},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94299999999999995,"5min":1.1000000000000001,"15min":1.1950000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3200000000000001,"5min":1.427,"15min":2.694},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":1.0680000000000001,"5min":1.7929999999999999,"15min":2.1459999999999999},"last":0.54300000000000004}]},{"osd":4,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.503,"5min":0.55600000000000005,"15min":0.63700000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26500000000000001},"max":{"1min":0.45900000000000002,"5min":0.57599999999999996,"15min":0.68600000000000005},"last":0.33900000000000002}]},{"osd":5,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.252},"max":{"1min":0.47699999999999998,"5min":0.65700000000000003,"15min":0.85199999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39200000000000002,"15min":0.39700000000000002},"min":{"1min":0.316,"5min":0.28899999999999998,"15min":0.26300000000000001},"max":{"1min":0.49199999999999999,"5min":0.65800000000000003,"15min":0.67000000000000004},"last":0.35999999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41399999999999998,"15min":0.41499999999999998},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.26700000000000002},"max":{"1min":0.54200000000000004,"5min":0.63600000000000001,"15min":0.77600000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52300000000000002,"5min":0.68300000000000005,"15min":0.80000000000000004},"last":0.374}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17371136,"data_stored":22007641,"data_compressed":1454768,"data_compressed_allocated":2252800,"data_compressed_original":6918144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23826432,"data_stored":30449840,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13447168,"data_stored":16912726,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27611136,"data_stored":33841682,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20754432,"data_stored":26522789,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":23079032,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13332480,"data_stored":16128101,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24412160,"data_stored":31072225,"data_compressed":1977671,"data_compressed_allocated":3067904,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:38:17.176 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.177 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.177 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.177 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.177 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.178 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.178 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.178 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.179 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.179 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.179 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.180 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.180 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.180 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.180 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.181 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.181 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.181 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.182 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.182 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.182 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.182 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.183 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.183 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.183 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.184 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.184 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.185 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.185 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.185 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.185 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.186 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.186 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.186 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.187 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.187 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.187 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.187 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.188 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.188 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.188 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.189 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.189 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.189 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-18T11:09:17.711667+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=17, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.189 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.190 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.190 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.190 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.191 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.191 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.191 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.192 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.192 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.192 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.192 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.193 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.193 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.193 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.194 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.194 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.194 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.194 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.195 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.195 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.195 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.196 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.196 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.196 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.196 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.197 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.197 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.197 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.198 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.198 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.198 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.198 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.199 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.199 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.199 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.200 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.200 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.200 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.200 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.201 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.201 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.201 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.202 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.202 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.202 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.203 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.203 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.203 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.204 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.204 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.204 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.204 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.205 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.205 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.205 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.206 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.206 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.206 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.207 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.207 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.207 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.207 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.208 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.208 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.208 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.209 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.209 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.209 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.210 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.210 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.210 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:17.210 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-18T11:38:37.211 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:38:37.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.424+0000 7f3348f3c640 1 Processor -- start 2023-10-18T11:38:37.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.424+0000 7f3348f3c640 1 -- start start 2023-10-18T11:38:37.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.426+0000 7f3348f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3344150ec0 0x7f3344157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:37.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.426+0000 7f3348f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33440c57a0 0x7f334406d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:37.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.426+0000 7f3348f3c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f33440c5080 0x7f334406dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:37.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.426+0000 7f3348f3c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33440c3b00 con 0x7f33440c5080 2023-10-18T11:38:37.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.426+0000 7f3348f3c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33440c6820 con 0x7f3344150ec0 2023-10-18T11:38:37.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.426+0000 7f3348f3c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c6b00 con 0x7f33440c57a0 2023-10-18T11:38:37.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.426+0000 7f334259c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3344150ec0 0x7f3344157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:37.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.427+0000 7f3339d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33440c57a0 0x7f334406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:37.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.427+0000 7f334259c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3344150ec0 0x7f3344157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:42708/0 (socket says 172.21.15.151:42708) 2023-10-18T11:38:37.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.427+0000 7f334259c640 1 -- 172.21.15.151:0/2709274023 learned_addr learned my addr 172.21.15.151:0/2709274023 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:37.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.429+0000 7f3339d9b640 1 -- 172.21.15.151:0/2709274023 >> v2:172.21.15.169:3300/0 conn(0x7f3344150ec0 msgr2=0x7f3344157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:37.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.429+0000 7f3339d9b640 1 --2- 172.21.15.151:0/2709274023 >> v2:172.21.15.169:3300/0 conn(0x7f3344150ec0 0x7f3344157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.429+0000 7f3339d9b640 1 -- 172.21.15.151:0/2709274023 >> v2:172.21.15.151:3300/0 conn(0x7f33440c5080 msgr2=0x7f334406dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:37.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.429+0000 7f3339d9b640 1 --2- 172.21.15.151:0/2709274023 >> v2:172.21.15.151:3300/0 conn(0x7f33440c5080 0x7f334406dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.429+0000 7f3339d9b640 1 -- 172.21.15.151:0/2709274023 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440c1ab0 con 0x7f33440c57a0 2023-10-18T11:38:37.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.431+0000 7f3339d9b640 1 --2- 172.21.15.151:0/2709274023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33440c57a0 0x7f334406d760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f334406c2f0 tx=0x7f332c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf887eb2367ecb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:37.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.435+0000 7f3341d9b640 1 -- 172.21.15.151:0/2709274023 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c02e070 con 0x7f33440c57a0 2023-10-18T11:38:37.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.435+0000 7f3341d9b640 1 -- 172.21.15.151:0/2709274023 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c0315a0 con 0x7f33440c57a0 2023-10-18T11:38:37.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.435+0000 7f3341d9b640 1 -- 172.21.15.151:0/2709274023 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c031930 con 0x7f33440c57a0 2023-10-18T11:38:37.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.436+0000 7f3348f3c640 1 -- 172.21.15.151:0/2709274023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33440c57a0 msgr2=0x7f334406d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:37.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.436+0000 7f3348f3c640 1 --2- 172.21.15.151:0/2709274023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33440c57a0 0x7f334406d760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f334406c2f0 tx=0x7f332c02b840 comp rx=0 tx=0).stop 2023-10-18T11:38:37.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.436+0000 7f3348f3c640 1 -- 172.21.15.151:0/2709274023 shutdown_connections 2023-10-18T11:38:37.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.436+0000 7f3348f3c640 1 --2- 172.21.15.151:0/2709274023 >> v2:172.21.15.151:3300/0 conn(0x7f33440c5080 0x7f334406dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.436+0000 7f3348f3c640 1 --2- 172.21.15.151:0/2709274023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33440c57a0 0x7f334406d760 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.436+0000 7f3348f3c640 1 --2- 172.21.15.151:0/2709274023 >> v2:172.21.15.169:3300/0 conn(0x7f3344150ec0 0x7f3344157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.436+0000 7f3348f3c640 1 -- 172.21.15.151:0/2709274023 >> 172.21.15.151:0/2709274023 conn(0x7f33440c6f10 msgr2=0x7f33440c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:37.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.436+0000 7f3348f3c640 1 -- 172.21.15.151:0/2709274023 shutdown_connections 2023-10-18T11:38:37.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.436+0000 7f3348f3c640 1 -- 172.21.15.151:0/2709274023 wait complete. 2023-10-18T11:38:37.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.438+0000 7f3348f3c640 1 Processor -- start 2023-10-18T11:38:37.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.439+0000 7f3348f3c640 1 -- start start 2023-10-18T11:38:37.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.440+0000 7f3348f3c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33440c5080 0x7f3344157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:37.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.440+0000 7f3348f3c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33440c57a0 0x7f33441e2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:37.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.440+0000 7f3348f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3344150ec0 0x7f3344071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:37.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.440+0000 7f3348f3c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3344156c30 con 0x7f33440c5080 2023-10-18T11:38:37.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.440+0000 7f3348f3c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33441e3080 con 0x7f33440c57a0 2023-10-18T11:38:37.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.440+0000 7f3348f3c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33441e05b0 con 0x7f3344150ec0 2023-10-18T11:38:37.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.440+0000 7f3339d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33440c57a0 0x7f33441e2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:37.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.440+0000 7f3342d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3344150ec0 0x7f3344071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:37.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.441+0000 7f3339d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33440c57a0 0x7f33441e2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:42724/0 (socket says 172.21.15.151:42724) 2023-10-18T11:38:37.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.441+0000 7f3339d9b640 1 -- 172.21.15.151:0/1089838590 learned_addr learned my addr 172.21.15.151:0/1089838590 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:37.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.443+0000 7f334259c640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33440c5080 0x7f3344157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:37.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.444+0000 7f3339d9b640 1 -- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3344150ec0 msgr2=0x7f3344071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:37.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.444+0000 7f3339d9b640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3344150ec0 0x7f3344071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.444+0000 7f3339d9b640 1 -- 172.21.15.151:0/1089838590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33440c5080 msgr2=0x7f3344157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:37.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.444+0000 7f3339d9b640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33440c5080 0x7f3344157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.444+0000 7f3339d9b640 1 -- 172.21.15.151:0/1089838590 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c009400 con 0x7f33440c57a0 2023-10-18T11:38:37.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.444+0000 7f3342d9d640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3344150ec0 0x7f3344071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:38:37.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.447+0000 7f3339d9b640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33440c57a0 0x7f33441e2040 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f332c000c00 tx=0x7f332c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:37.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.451+0000 7f333b7fe640 1 -- 172.21.15.151:0/1089838590 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c031f10 con 0x7f33440c57a0 2023-10-18T11:38:37.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.451+0000 7f333b7fe640 1 -- 172.21.15.151:0/1089838590 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c032860 con 0x7f33440c57a0 2023-10-18T11:38:37.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.451+0000 7f333b7fe640 1 -- 172.21.15.151:0/1089838590 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c032c10 con 0x7f33440c57a0 2023-10-18T11:38:37.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.451+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334414a700 con 0x7f33440c57a0 2023-10-18T11:38:37.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.451+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33441e0850 con 0x7f33440c57a0 2023-10-18T11:38:37.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.452+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33440c62c0 con 0x7f33440c57a0 2023-10-18T11:38:37.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.705+0000 7f333b7fe640 1 -- 172.21.15.151:0/1089838590 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f332c0453f0 con 0x7f33440c57a0 2023-10-18T11:38:37.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.706+0000 7f333b7fe640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f332406aef0 0x7f332406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:37.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.707+0000 7f333b7fe640 1 -- 172.21.15.151:0/1089838590 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f332c076fa0 con 0x7f33440c57a0 2023-10-18T11:38:37.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.707+0000 7f334259c640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f332406aef0 0x7f332406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:37.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.708+0000 7f334259c640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f332406aef0 0x7f332406d3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3334009ce0 tx=0x7f333400b040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:37.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.717+0000 7f333b7fe640 1 -- 172.21.15.151:0/1089838590 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f332c07a660 con 0x7f33440c57a0 2023-10-18T11:38:37.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.917+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33440c2070 con 0x7f332406aef0 2023-10-18T11:38:37.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.928+0000 7f333b7fe640 1 -- 172.21.15.151:0/1089838590 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369902 (secure 0 0 0) 0x7f333400f040 con 0x7f332406aef0 2023-10-18T11:38:37.933 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:38:37.939 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:38:37.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f332406aef0 msgr2=0x7f332406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:37.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f332406aef0 0x7f332406d3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3334009ce0 tx=0x7f333400b040 comp rx=0 tx=0).stop 2023-10-18T11:38:37.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33440c57a0 msgr2=0x7f33441e2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:37.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33440c57a0 0x7f33441e2040 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f332c000c00 tx=0x7f332c0046c0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 shutdown_connections 2023-10-18T11:38:37.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3344150ec0 0x7f3344071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f332406aef0 0x7f332406d3b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33440c57a0 0x7f33441e2040 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 --2- 172.21.15.151:0/1089838590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33440c5080 0x7f3344157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:37.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 >> 172.21.15.151:0/1089838590 conn(0x7f33440c6f10 msgr2=0x7f33440ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:37.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.938+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 shutdown_connections 2023-10-18T11:38:37.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:37.939+0000 7f3348f3c640 1 -- 172.21.15.151:0/1089838590 wait complete. 2023-10-18T11:38:37.963 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":904,"stamp":"2023-10-18T11:38:36.615087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":100597386,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":4304,"num_read_kb":487225,"num_write":36997,"num_write_kb":691404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47842,"ondisk_log_size":47842,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":893040,"kb_used_data":158000,"kb_used_omap":12,"kb_used_meta":734963,"kb_avail":754081680,"statfs":{"total":773094113280,"available":772179640320,"internally_reserved":0,"allocated":161792000,"data_stored":202273572,"data_compressed":12494466,"data_compressed_allocated":19447808,"data_compressed_original":61759488,"omap_allocated":12742,"internal_metadata":752602682},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003132"},"pg_stats":[{"pgid":"2.1f","version":"31'1794","reported_seq":1837,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.079350+0000","last_change":"2023-10-18T11:38:12.079438+0000","last_active":"2023-10-18T11:38:12.079350+0000","last_peered":"2023-10-18T11:38:12.079350+0000","last_clean":"2023-10-18T11:38:12.079350+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:38:12.079350+0000","last_undegraded":"2023-10-18T11:38:12.079350+0000","last_fullsized":"2023-10-18T11:38:12.079350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1794","last_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_deep_scrub":"31'1794","last_deep_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.079262+0000","objects_scrubbed":9,"log_size":1794,"log_dups_size":0,"ondisk_log_size":1794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:20:44.669761+0000","scrub_duration":0.099044419999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9277295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":10015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'142","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.955490+0000","last_change":"2023-10-18T11:38:16.955575+0000","last_active":"2023-10-18T11:38:16.955490+0000","last_peered":"2023-10-18T11:38:16.955490+0000","last_clean":"2023-10-18T11:38:16.955490+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:38:16.955490+0000","last_undegraded":"2023-10-18T11:38:16.955490+0000","last_fullsized":"2023-10-18T11:38:16.955490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:16.955379+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:16.955379+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.955379+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:19.773706+0000","scrub_duration":0.0027257150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'384","reported_seq":458,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.555199+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:37:03.555199+0000","last_peered":"2023-10-18T11:37:03.555199+0000","last_clean":"2023-10-18T11:37:03.555199+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:37:03.555199+0000","last_undegraded":"2023-10-18T11:37:03.555199+0000","last_fullsized":"2023-10-18T11:37:03.555199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":285,"num_write_kb":10314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'1439","reported_seq":1483,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.051027+0000","last_change":"2023-10-18T11:38:23.051102+0000","last_active":"2023-10-18T11:38:23.051027+0000","last_peered":"2023-10-18T11:38:23.051027+0000","last_clean":"2023-10-18T11:38:23.051027+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:38:23.051027+0000","last_undegraded":"2023-10-18T11:38:23.051027+0000","last_fullsized":"2023-10-18T11:38:23.051027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1439","last_scrub_stamp":"2023-10-18T11:38:23.050919+0000","last_deep_scrub":"31'1439","last_deep_scrub_stamp":"2023-10-18T11:38:23.050919+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.050919+0000","objects_scrubbed":2,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:37.205626+0000","scrub_duration":0.089910790000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1431,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'165","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.966533+0000","last_change":"2023-10-18T11:38:31.966648+0000","last_active":"2023-10-18T11:38:31.966533+0000","last_peered":"2023-10-18T11:38:31.966533+0000","last_clean":"2023-10-18T11:38:31.966533+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:38:31.966533+0000","last_undegraded":"2023-10-18T11:38:31.966533+0000","last_fullsized":"2023-10-18T11:38:31.966533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2023-10-18T11:38:31.966374+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2023-10-18T11:38:31.966374+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.966374+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:57:30.180571+0000","scrub_duration":0.0039781039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'453","reported_seq":593,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:08.771594+0000","last_change":"2023-10-18T11:09:46.109981+0000","last_active":"2023-10-18T11:37:08.771594+0000","last_peered":"2023-10-18T11:37:08.771594+0000","last_clean":"2023-10-18T11:37:08.771594+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:37:08.771594+0000","last_undegraded":"2023-10-18T11:37:08.771594+0000","last_fullsized":"2023-10-18T11:37:08.771594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":14204,"num_write":357,"num_write_kb":21017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'825","reported_seq":866,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:34.615568+0000","last_change":"2023-10-18T11:38:34.615623+0000","last_active":"2023-10-18T11:38:34.615568+0000","last_peered":"2023-10-18T11:38:34.615568+0000","last_clean":"2023-10-18T11:38:34.615568+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:38:34.615568+0000","last_undegraded":"2023-10-18T11:38:34.615568+0000","last_fullsized":"2023-10-18T11:38:34.615568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'825","last_scrub_stamp":"2023-10-18T11:38:34.615490+0000","last_deep_scrub":"31'825","last_deep_scrub_stamp":"2023-10-18T11:38:34.615490+0000","last_clean_scrub_stamp":"2023-10-18T11:38:34.615490+0000","objects_scrubbed":8,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:39.655863+0000","scrub_duration":0.025506078000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3060357,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'145","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.046942+0000","last_change":"2023-10-18T11:09:39.397225+0000","last_active":"2023-10-18T11:38:03.046942+0000","last_peered":"2023-10-18T11:38:03.046942+0000","last_clean":"2023-10-18T11:38:03.046942+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:38:03.046942+0000","last_undegraded":"2023-10-18T11:38:03.046942+0000","last_fullsized":"2023-10-18T11:38:03.046942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'331","reported_seq":404,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.082012+0000","last_change":"2023-10-18T11:09:46.114798+0000","last_active":"2023-10-18T11:37:16.082012+0000","last_peered":"2023-10-18T11:37:16.082012+0000","last_clean":"2023-10-18T11:37:16.082012+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:37:16.082012+0000","last_undegraded":"2023-10-18T11:37:16.082012+0000","last_fullsized":"2023-10-18T11:37:16.082012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":213,"num_write_kb":9865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'10","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.523461+0000","last_change":"2023-10-18T11:38:21.523502+0000","last_active":"2023-10-18T11:38:21.523461+0000","last_peered":"2023-10-18T11:38:21.523461+0000","last_clean":"2023-10-18T11:38:21.523461+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:38:21.523461+0000","last_undegraded":"2023-10-18T11:38:21.523461+0000","last_fullsized":"2023-10-18T11:38:21.523461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-10-18T11:38:21.523393+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-10-18T11:38:21.523393+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.523393+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:57:54.359212+0000","scrub_duration":0.008442148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'167","reported_seq":197,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.046852+0000","last_change":"2023-10-18T11:09:39.398621+0000","last_active":"2023-10-18T11:38:03.046852+0000","last_peered":"2023-10-18T11:38:03.046852+0000","last_clean":"2023-10-18T11:38:03.046852+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:38:03.046852+0000","last_undegraded":"2023-10-18T11:38:03.046852+0000","last_fullsized":"2023-10-18T11:38:03.046852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'461","reported_seq":544,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.081984+0000","last_change":"2023-10-18T11:09:46.115280+0000","last_active":"2023-10-18T11:37:16.081984+0000","last_peered":"2023-10-18T11:37:16.081984+0000","last_clean":"2023-10-18T11:37:16.081984+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:37:16.081984+0000","last_undegraded":"2023-10-18T11:37:16.081984+0000","last_fullsized":"2023-10-18T11:37:16.081984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":15764,"num_write":351,"num_write_kb":32860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'140","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.567551+0000","last_change":"2023-10-18T11:38:31.567593+0000","last_active":"2023-10-18T11:38:31.567551+0000","last_peered":"2023-10-18T11:38:31.567551+0000","last_clean":"2023-10-18T11:38:31.567551+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:38:31.567551+0000","last_undegraded":"2023-10-18T11:38:31.567551+0000","last_fullsized":"2023-10-18T11:38:31.567551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'140","last_scrub_stamp":"2023-10-18T11:38:31.567485+0000","last_deep_scrub":"31'140","last_deep_scrub_stamp":"2023-10-18T11:38:31.567485+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.567485+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:17.382614+0000","scrub_duration":0.0011892719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'770","reported_seq":812,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.579918+0000","last_change":"2023-10-18T11:38:20.579965+0000","last_active":"2023-10-18T11:38:20.579918+0000","last_peered":"2023-10-18T11:38:20.579918+0000","last_clean":"2023-10-18T11:38:20.579918+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:38:20.579918+0000","last_undegraded":"2023-10-18T11:38:20.579918+0000","last_fullsized":"2023-10-18T11:38:20.579918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'770","last_scrub_stamp":"2023-10-18T11:38:20.579828+0000","last_deep_scrub":"31'770","last_deep_scrub_stamp":"2023-10-18T11:38:20.579828+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.579828+0000","objects_scrubbed":3,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:49.808441+0000","scrub_duration":0.018364789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'437","reported_seq":510,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.557498+0000","last_change":"2023-10-18T11:09:46.096113+0000","last_active":"2023-10-18T11:37:03.557498+0000","last_peered":"2023-10-18T11:37:03.557498+0000","last_clean":"2023-10-18T11:37:03.557498+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:37:03.557498+0000","last_undegraded":"2023-10-18T11:37:03.557498+0000","last_fullsized":"2023-10-18T11:37:03.557498+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":11430,"num_write":325,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'139","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.093720+0000","last_change":"2023-10-18T11:38:30.093847+0000","last_active":"2023-10-18T11:38:30.093720+0000","last_peered":"2023-10-18T11:38:30.093720+0000","last_clean":"2023-10-18T11:38:30.093720+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:38:30.093720+0000","last_undegraded":"2023-10-18T11:38:30.093720+0000","last_fullsized":"2023-10-18T11:38:30.093720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'139","last_scrub_stamp":"2023-10-18T11:38:30.093539+0000","last_deep_scrub":"31'139","last_deep_scrub_stamp":"2023-10-18T11:38:30.093539+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.093539+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:04.126814+0000","scrub_duration":0.0040762330000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'486","reported_seq":529,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.714481+0000","last_change":"2023-10-18T11:38:15.714604+0000","last_active":"2023-10-18T11:38:15.714481+0000","last_peered":"2023-10-18T11:38:15.714481+0000","last_clean":"2023-10-18T11:38:15.714481+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:38:15.714481+0000","last_undegraded":"2023-10-18T11:38:15.714481+0000","last_fullsized":"2023-10-18T11:38:15.714481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'486","last_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_deep_scrub":"31'486","last_deep_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.714323+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:22:01.854784+0000","scrub_duration":0.005976121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'427","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.755728+0000","last_change":"2023-10-18T11:09:46.114729+0000","last_active":"2023-10-18T11:37:07.755728+0000","last_peered":"2023-10-18T11:37:07.755728+0000","last_clean":"2023-10-18T11:37:07.755728+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:37:07.755728+0000","last_undegraded":"2023-10-18T11:37:07.755728+0000","last_fullsized":"2023-10-18T11:37:07.755728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":327,"num_write_kb":17650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'148","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.949313+0000","last_change":"2023-10-18T11:38:14.949444+0000","last_active":"2023-10-18T11:38:14.949313+0000","last_peered":"2023-10-18T11:38:14.949313+0000","last_clean":"2023-10-18T11:38:14.949313+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:38:14.949313+0000","last_undegraded":"2023-10-18T11:38:14.949313+0000","last_fullsized":"2023-10-18T11:38:14.949313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.949157+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:41:56.369387+0000","scrub_duration":0.0041327179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'284","reported_seq":327,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.832954+0000","last_change":"2023-10-18T11:38:21.833085+0000","last_active":"2023-10-18T11:38:21.832954+0000","last_peered":"2023-10-18T11:38:21.832954+0000","last_clean":"2023-10-18T11:38:21.832954+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:38:21.832954+0000","last_undegraded":"2023-10-18T11:38:21.832954+0000","last_fullsized":"2023-10-18T11:38:21.832954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'284","last_scrub_stamp":"2023-10-18T11:38:21.832756+0000","last_deep_scrub":"31'284","last_deep_scrub_stamp":"2023-10-18T11:38:21.832756+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.832756+0000","objects_scrubbed":4,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:25.405192+0000","scrub_duration":0.011219165,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'423","reported_seq":481,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:11.384453+0000","last_change":"2023-10-18T11:10:10.413988+0000","last_active":"2023-10-18T11:37:11.384453+0000","last_peered":"2023-10-18T11:37:11.384453+0000","last_clean":"2023-10-18T11:37:11.384453+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:37:11.384453+0000","last_undegraded":"2023-10-18T11:37:11.384453+0000","last_fullsized":"2023-10-18T11:37:11.384453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":324,"num_write_kb":16893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'124","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.596521+0000","last_change":"2023-10-18T11:38:16.596581+0000","last_active":"2023-10-18T11:38:16.596521+0000","last_peered":"2023-10-18T11:38:16.596521+0000","last_clean":"2023-10-18T11:38:16.596521+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:38:16.596521+0000","last_undegraded":"2023-10-18T11:38:16.596521+0000","last_fullsized":"2023-10-18T11:38:16.596521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'124","last_scrub_stamp":"2023-10-18T11:38:16.596449+0000","last_deep_scrub":"31'124","last_deep_scrub_stamp":"2023-10-18T11:38:16.596449+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.596449+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:46:57.233493+0000","scrub_duration":0.001755993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.273583+0000","last_change":"2023-10-18T11:09:36.797637+0000","last_active":"2023-10-18T11:37:46.273583+0000","last_peered":"2023-10-18T11:37:46.273583+0000","last_clean":"2023-10-18T11:37:46.273583+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:37:46.273583+0000","last_undegraded":"2023-10-18T11:37:46.273583+0000","last_fullsized":"2023-10-18T11:37:46.273583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'432","reported_seq":624,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:33.632992+0000","last_change":"2023-10-18T11:38:33.633067+0000","last_active":"2023-10-18T11:38:33.632992+0000","last_peered":"2023-10-18T11:38:33.632992+0000","last_clean":"2023-10-18T11:38:33.632992+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:38:33.632992+0000","last_undegraded":"2023-10-18T11:38:33.632992+0000","last_fullsized":"2023-10-18T11:38:33.632992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'432","last_scrub_stamp":"2023-10-18T11:38:33.632896+0000","last_deep_scrub":"31'432","last_deep_scrub_stamp":"2023-10-18T11:38:33.632896+0000","last_clean_scrub_stamp":"2023-10-18T11:38:33.632896+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:47.787602+0000","scrub_duration":0.0053552069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":19825,"num_write":333,"num_write_kb":19445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'132","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:28.012524+0000","last_change":"2023-10-18T11:38:28.012708+0000","last_active":"2023-10-18T11:38:28.012524+0000","last_peered":"2023-10-18T11:38:28.012524+0000","last_clean":"2023-10-18T11:38:28.012524+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:38:28.012524+0000","last_undegraded":"2023-10-18T11:38:28.012524+0000","last_fullsized":"2023-10-18T11:38:28.012524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2023-10-18T11:38:28.012283+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2023-10-18T11:38:28.012283+0000","last_clean_scrub_stamp":"2023-10-18T11:38:28.012283+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:02.045557+0000","scrub_duration":0.0049242060000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'17","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.715097+0000","last_change":"2023-10-18T11:38:18.715180+0000","last_active":"2023-10-18T11:38:18.715097+0000","last_peered":"2023-10-18T11:38:18.715097+0000","last_clean":"2023-10-18T11:38:18.715097+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:38:18.715097+0000","last_undegraded":"2023-10-18T11:38:18.715097+0000","last_fullsized":"2023-10-18T11:38:18.715097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'17","last_scrub_stamp":"2023-10-18T11:38:18.715002+0000","last_deep_scrub":"31'17","last_deep_scrub_stamp":"2023-10-18T11:38:18.715002+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.715002+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:34.623209+0000","scrub_duration":0.0046622959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'438","reported_seq":529,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.621990+0000","last_change":"2023-10-18T11:38:30.622058+0000","last_active":"2023-10-18T11:38:30.621990+0000","last_peered":"2023-10-18T11:38:30.621990+0000","last_clean":"2023-10-18T11:38:30.621990+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:38:30.621990+0000","last_undegraded":"2023-10-18T11:38:30.621990+0000","last_fullsized":"2023-10-18T11:38:30.621990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'438","last_scrub_stamp":"2023-10-18T11:38:30.621913+0000","last_deep_scrub":"31'438","last_deep_scrub_stamp":"2023-10-18T11:38:30.621913+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.621913+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:04.843486+0000","scrub_duration":0.0026375550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":16856,"num_write":335,"num_write_kb":23716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'142","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.052072+0000","last_change":"2023-10-18T11:09:39.420016+0000","last_active":"2023-10-18T11:38:03.052072+0000","last_peered":"2023-10-18T11:38:03.052072+0000","last_clean":"2023-10-18T11:38:03.052072+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:38:03.052072+0000","last_undegraded":"2023-10-18T11:38:03.052072+0000","last_fullsized":"2023-10-18T11:38:03.052072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'292","reported_seq":335,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:22.871865+0000","last_change":"2023-10-18T11:38:22.872065+0000","last_active":"2023-10-18T11:38:22.871865+0000","last_peered":"2023-10-18T11:38:22.871865+0000","last_clean":"2023-10-18T11:38:22.871865+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:38:22.871865+0000","last_undegraded":"2023-10-18T11:38:22.871865+0000","last_fullsized":"2023-10-18T11:38:22.871865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'292","last_scrub_stamp":"2023-10-18T11:38:22.871678+0000","last_deep_scrub":"31'292","last_deep_scrub_stamp":"2023-10-18T11:38:22.871678+0000","last_clean_scrub_stamp":"2023-10-18T11:38:22.871678+0000","objects_scrubbed":4,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:37.026385+0000","scrub_duration":0.014122981999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'450","reported_seq":536,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415835+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:37:46.415835+0000","last_peered":"2023-10-18T11:37:46.415835+0000","last_clean":"2023-10-18T11:37:46.415835+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:37:46.415835+0000","last_undegraded":"2023-10-18T11:37:46.415835+0000","last_fullsized":"2023-10-18T11:37:46.415835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":337,"num_write_kb":25264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'150","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.964607+0000","last_change":"2023-10-18T11:38:30.964725+0000","last_active":"2023-10-18T11:38:30.964607+0000","last_peered":"2023-10-18T11:38:30.964607+0000","last_clean":"2023-10-18T11:38:30.964607+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:38:30.964607+0000","last_undegraded":"2023-10-18T11:38:30.964607+0000","last_fullsized":"2023-10-18T11:38:30.964607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2023-10-18T11:38:30.964435+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2023-10-18T11:38:30.964435+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.964435+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:36.004808+0000","scrub_duration":0.0040942510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'245","reported_seq":288,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.473609+0000","last_change":"2023-10-18T11:38:29.473647+0000","last_active":"2023-10-18T11:38:29.473609+0000","last_peered":"2023-10-18T11:38:29.473609+0000","last_clean":"2023-10-18T11:38:29.473609+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:38:29.473609+0000","last_undegraded":"2023-10-18T11:38:29.473609+0000","last_fullsized":"2023-10-18T11:38:29.473609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'245","last_scrub_stamp":"2023-10-18T11:38:29.473550+0000","last_deep_scrub":"31'245","last_deep_scrub_stamp":"2023-10-18T11:38:29.473550+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.473550+0000","objects_scrubbed":3,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:43.628257+0000","scrub_duration":0.0080227579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'490","reported_seq":563,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.793255+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:36:58.793255+0000","last_peered":"2023-10-18T11:36:58.793255+0000","last_clean":"2023-10-18T11:36:58.793255+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:36:58.793255+0000","last_undegraded":"2023-10-18T11:36:58.793255+0000","last_fullsized":"2023-10-18T11:36:58.793255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":390,"num_write_kb":31170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'172","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.062602+0000","last_change":"2023-10-18T11:09:39.417304+0000","last_active":"2023-10-18T11:38:03.062602+0000","last_peered":"2023-10-18T11:38:03.062602+0000","last_clean":"2023-10-18T11:38:03.062602+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:38:03.062602+0000","last_undegraded":"2023-10-18T11:38:03.062602+0000","last_fullsized":"2023-10-18T11:38:03.062602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'791","reported_seq":834,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.776459+0000","last_change":"2023-10-18T11:38:13.776538+0000","last_active":"2023-10-18T11:38:13.776459+0000","last_peered":"2023-10-18T11:38:13.776459+0000","last_clean":"2023-10-18T11:38:13.776459+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:38:13.776459+0000","last_undegraded":"2023-10-18T11:38:13.776459+0000","last_fullsized":"2023-10-18T11:38:13.776459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'791","last_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_deep_scrub":"31'791","last_deep_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.776362+0000","objects_scrubbed":1,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.684568+0000","scrub_duration":0.035930087999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'468","reported_seq":528,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:03.545596+0000","last_change":"2023-10-18T11:09:46.100735+0000","last_active":"2023-10-18T11:37:03.545596+0000","last_peered":"2023-10-18T11:37:03.545596+0000","last_clean":"2023-10-18T11:37:03.545596+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:37:03.545596+0000","last_undegraded":"2023-10-18T11:37:03.545596+0000","last_fullsized":"2023-10-18T11:37:03.545596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":9414,"num_write":343,"num_write_kb":17104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'148","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:24.579324+0000","last_change":"2023-10-18T11:38:24.579369+0000","last_active":"2023-10-18T11:38:24.579324+0000","last_peered":"2023-10-18T11:38:24.579324+0000","last_clean":"2023-10-18T11:38:24.579324+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:38:24.579324+0000","last_undegraded":"2023-10-18T11:38:24.579324+0000","last_fullsized":"2023-10-18T11:38:24.579324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-10-18T11:38:24.579245+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-10-18T11:38:24.579245+0000","last_clean_scrub_stamp":"2023-10-18T11:38:24.579245+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:05.999475+0000","scrub_duration":0.00254185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1651","reported_seq":1694,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.284759+0000","last_change":"2023-10-18T11:38:26.284837+0000","last_active":"2023-10-18T11:38:26.284759+0000","last_peered":"2023-10-18T11:38:26.284759+0000","last_clean":"2023-10-18T11:38:26.284759+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:38:26.284759+0000","last_undegraded":"2023-10-18T11:38:26.284759+0000","last_fullsized":"2023-10-18T11:38:26.284759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1651","last_scrub_stamp":"2023-10-18T11:38:26.284633+0000","last_deep_scrub":"31'1651","last_deep_scrub_stamp":"2023-10-18T11:38:26.284633+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.284633+0000","objects_scrubbed":3,"log_size":1651,"log_dups_size":0,"ondisk_log_size":1651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:00.506206+0000","scrub_duration":0.080692793999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1639,"num_write_kb":9112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'412","reported_seq":498,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.245534+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:37:05.245534+0000","last_peered":"2023-10-18T11:37:05.245534+0000","last_clean":"2023-10-18T11:37:05.245534+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:37:05.245534+0000","last_undegraded":"2023-10-18T11:37:05.245534+0000","last_fullsized":"2023-10-18T11:37:05.245534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":14478,"num_write":303,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'145","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.079388+0000","last_change":"2023-10-18T11:09:39.243829+0000","last_active":"2023-10-18T11:38:03.079388+0000","last_peered":"2023-10-18T11:38:03.079388+0000","last_clean":"2023-10-18T11:38:03.079388+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:38:03.079388+0000","last_undegraded":"2023-10-18T11:38:03.079388+0000","last_fullsized":"2023-10-18T11:38:03.079388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'1267","reported_seq":1767,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.829516+0000","last_change":"2023-10-18T11:38:18.829671+0000","last_active":"2023-10-18T11:38:18.829516+0000","last_peered":"2023-10-18T11:38:18.829516+0000","last_clean":"2023-10-18T11:38:18.829516+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:38:18.829516+0000","last_undegraded":"2023-10-18T11:38:18.829516+0000","last_fullsized":"2023-10-18T11:38:18.829516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1267","last_scrub_stamp":"2023-10-18T11:38:18.829387+0000","last_deep_scrub":"31'1267","last_deep_scrub_stamp":"2023-10-18T11:38:18.829387+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.829387+0000","objects_scrubbed":5,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:33:56.899504+0000","scrub_duration":0.050335492000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4329052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":492,"num_write":1258,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'421","reported_seq":528,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.270146+0000","last_change":"2023-10-18T11:09:46.114610+0000","last_active":"2023-10-18T11:37:56.270146+0000","last_peered":"2023-10-18T11:37:56.270146+0000","last_clean":"2023-10-18T11:37:56.270146+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:37:56.270146+0000","last_undegraded":"2023-10-18T11:37:56.270146+0000","last_fullsized":"2023-10-18T11:37:56.270146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":19812,"num_write":327,"num_write_kb":12739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'143","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.055385+0000","last_change":"2023-10-18T11:38:18.055509+0000","last_active":"2023-10-18T11:38:18.055385+0000","last_peered":"2023-10-18T11:38:18.055385+0000","last_clean":"2023-10-18T11:38:18.055385+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:38:18.055385+0000","last_undegraded":"2023-10-18T11:38:18.055385+0000","last_fullsized":"2023-10-18T11:38:18.055385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'143","last_scrub_stamp":"2023-10-18T11:38:18.055229+0000","last_deep_scrub":"31'143","last_deep_scrub_stamp":"2023-10-18T11:38:18.055229+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.055229+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:21.627664+0000","scrub_duration":0.0029786410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'375","reported_seq":411,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.078087+0000","last_change":"2023-10-18T11:09:36.913804+0000","last_active":"2023-10-18T11:38:03.078087+0000","last_peered":"2023-10-18T11:38:03.078087+0000","last_clean":"2023-10-18T11:38:03.078087+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:38:03.078087+0000","last_undegraded":"2023-10-18T11:38:03.078087+0000","last_fullsized":"2023-10-18T11:38:03.078087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:35.568058+0000","last_clean_scrub_stamp":"2023-10-18T11:09:35.568058+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956517,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'424","reported_seq":517,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.202696+0000","last_change":"2023-10-18T11:09:46.092566+0000","last_active":"2023-10-18T11:37:56.202696+0000","last_peered":"2023-10-18T11:37:56.202696+0000","last_clean":"2023-10-18T11:37:56.202696+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:37:56.202696+0000","last_undegraded":"2023-10-18T11:37:56.202696+0000","last_fullsized":"2023-10-18T11:37:56.202696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":329,"num_write_kb":22819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'140","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.033705+0000","last_change":"2023-10-18T11:09:39.422507+0000","last_active":"2023-10-18T11:38:03.033705+0000","last_peered":"2023-10-18T11:38:03.033705+0000","last_clean":"2023-10-18T11:38:03.033705+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:38:03.033705+0000","last_undegraded":"2023-10-18T11:38:03.033705+0000","last_fullsized":"2023-10-18T11:38:03.033705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'14","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.202354+0000","last_change":"2023-10-18T11:38:29.202419+0000","last_active":"2023-10-18T11:38:29.202354+0000","last_peered":"2023-10-18T11:38:29.202354+0000","last_clean":"2023-10-18T11:38:29.202354+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:38:29.202354+0000","last_undegraded":"2023-10-18T11:38:29.202354+0000","last_fullsized":"2023-10-18T11:38:29.202354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-10-18T11:38:29.202254+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-10-18T11:38:29.202254+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.202254+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:32.774689+0000","scrub_duration":0.011167610999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":198,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:19.573886+0000","last_change":"2023-10-18T11:38:19.573937+0000","last_active":"2023-10-18T11:38:19.573886+0000","last_peered":"2023-10-18T11:38:19.573886+0000","last_clean":"2023-10-18T11:38:19.573886+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:38:19.573886+0000","last_undegraded":"2023-10-18T11:38:19.573886+0000","last_fullsized":"2023-10-18T11:38:19.573886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-10-18T11:38:19.573815+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-10-18T11:38:19.573815+0000","last_clean_scrub_stamp":"2023-10-18T11:38:19.573815+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:22.392143+0000","scrub_duration":0.0092019140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'526","reported_seq":632,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.748943+0000","last_change":"2023-10-18T11:09:46.118571+0000","last_active":"2023-10-18T11:37:07.748943+0000","last_peered":"2023-10-18T11:37:07.748943+0000","last_clean":"2023-10-18T11:37:07.748943+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:37:07.748943+0000","last_undegraded":"2023-10-18T11:37:07.748943+0000","last_fullsized":"2023-10-18T11:37:07.748943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":19822,"num_write":415,"num_write_kb":19524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'153","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.944468+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:38:02.944468+0000","last_peered":"2023-10-18T11:38:02.944468+0000","last_clean":"2023-10-18T11:38:02.944468+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:38:02.944468+0000","last_undegraded":"2023-10-18T11:38:02.944468+0000","last_fullsized":"2023-10-18T11:38:02.944468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'902","reported_seq":944,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.776760+0000","last_change":"2023-10-18T11:38:21.776996+0000","last_active":"2023-10-18T11:38:21.776760+0000","last_peered":"2023-10-18T11:38:21.776760+0000","last_clean":"2023-10-18T11:38:21.776760+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:38:21.776760+0000","last_undegraded":"2023-10-18T11:38:21.776760+0000","last_fullsized":"2023-10-18T11:38:21.776760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'902","last_scrub_stamp":"2023-10-18T11:38:21.776574+0000","last_deep_scrub":"31'902","last_deep_scrub_stamp":"2023-10-18T11:38:21.776574+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.776574+0000","objects_scrubbed":3,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:47:08.842481+0000","scrub_duration":0.042635698999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'411","reported_seq":523,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:00.120634+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:38:00.120634+0000","last_peered":"2023-10-18T11:38:00.120634+0000","last_clean":"2023-10-18T11:38:00.120634+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:38:00.120634+0000","last_undegraded":"2023-10-18T11:38:00.120634+0000","last_fullsized":"2023-10-18T11:38:00.120634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":18796,"num_write":308,"num_write_kb":13390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'137","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.062605+0000","last_change":"2023-10-18T11:09:39.419862+0000","last_active":"2023-10-18T11:38:03.062605+0000","last_peered":"2023-10-18T11:38:03.062605+0000","last_clean":"2023-10-18T11:38:03.062605+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:38:03.062605+0000","last_undegraded":"2023-10-18T11:38:03.062605+0000","last_fullsized":"2023-10-18T11:38:03.062605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'1294","reported_seq":1336,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.833569+0000","last_change":"2023-10-18T11:38:16.833782+0000","last_active":"2023-10-18T11:38:16.833569+0000","last_peered":"2023-10-18T11:38:16.833569+0000","last_clean":"2023-10-18T11:38:16.833569+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:38:16.833569+0000","last_undegraded":"2023-10-18T11:38:16.833569+0000","last_fullsized":"2023-10-18T11:38:16.833569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1294","last_scrub_stamp":"2023-10-18T11:38:16.833369+0000","last_deep_scrub":"31'1294","last_deep_scrub_stamp":"2023-10-18T11:38:16.833369+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.833369+0000","objects_scrubbed":3,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:19.651697+0000","scrub_duration":0.079856599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7520929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1284,"num_write_kb":8040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'435","reported_seq":549,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:04.999963+0000","last_change":"2023-10-18T11:09:46.097744+0000","last_active":"2023-10-18T11:37:04.999963+0000","last_peered":"2023-10-18T11:37:04.999963+0000","last_clean":"2023-10-18T11:37:04.999963+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:37:04.999963+0000","last_undegraded":"2023-10-18T11:37:04.999963+0000","last_fullsized":"2023-10-18T11:37:04.999963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":340,"num_write_kb":14424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'136","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.947329+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:38:02.947329+0000","last_peered":"2023-10-18T11:38:02.947329+0000","last_clean":"2023-10-18T11:38:02.947329+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:38:02.947329+0000","last_undegraded":"2023-10-18T11:38:02.947329+0000","last_fullsized":"2023-10-18T11:38:02.947329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'9","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.700731+0000","last_change":"2023-10-18T11:38:23.700844+0000","last_active":"2023-10-18T11:38:23.700731+0000","last_peered":"2023-10-18T11:38:23.700731+0000","last_clean":"2023-10-18T11:38:23.700731+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:38:23.700731+0000","last_undegraded":"2023-10-18T11:38:23.700731+0000","last_fullsized":"2023-10-18T11:38:23.700731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-10-18T11:38:23.700596+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-10-18T11:38:23.700596+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.700596+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:47:43.822850+0000","scrub_duration":0.0075550569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'409","reported_seq":499,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:56.157684+0000","last_change":"2023-10-18T11:09:46.096894+0000","last_active":"2023-10-18T11:37:56.157684+0000","last_peered":"2023-10-18T11:37:56.157684+0000","last_clean":"2023-10-18T11:37:56.157684+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:37:56.157684+0000","last_undegraded":"2023-10-18T11:37:56.157684+0000","last_fullsized":"2023-10-18T11:37:56.157684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":17064,"num_write":295,"num_write_kb":17834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'136","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.942581+0000","last_change":"2023-10-18T11:09:39.399750+0000","last_active":"2023-10-18T11:38:02.942581+0000","last_peered":"2023-10-18T11:38:02.942581+0000","last_clean":"2023-10-18T11:38:02.942581+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:38:02.942581+0000","last_undegraded":"2023-10-18T11:38:02.942581+0000","last_fullsized":"2023-10-18T11:38:02.942581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'255","reported_seq":297,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.648441+0000","last_change":"2023-10-18T11:38:13.648486+0000","last_active":"2023-10-18T11:38:13.648441+0000","last_peered":"2023-10-18T11:38:13.648441+0000","last_clean":"2023-10-18T11:38:13.648441+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:38:13.648441+0000","last_undegraded":"2023-10-18T11:38:13.648441+0000","last_fullsized":"2023-10-18T11:38:13.648441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'255","last_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_deep_scrub":"31'255","last_deep_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.648347+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:37.829270+0000","scrub_duration":0.0050540170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'390","reported_seq":467,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.598810+0000","last_change":"2023-10-18T11:38:31.598864+0000","last_active":"2023-10-18T11:38:31.598810+0000","last_peered":"2023-10-18T11:38:31.598810+0000","last_clean":"2023-10-18T11:38:31.598810+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:38:31.598810+0000","last_undegraded":"2023-10-18T11:38:31.598810+0000","last_fullsized":"2023-10-18T11:38:31.598810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'390","last_scrub_stamp":"2023-10-18T11:38:31.598740+0000","last_deep_scrub":"31'390","last_deep_scrub_stamp":"2023-10-18T11:38:31.598740+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.598740+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:35.171175+0000","scrub_duration":0.0040497909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":302,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'129","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.944542+0000","last_change":"2023-10-18T11:09:39.397483+0000","last_active":"2023-10-18T11:38:02.944542+0000","last_peered":"2023-10-18T11:38:02.944542+0000","last_clean":"2023-10-18T11:38:02.944542+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:38:02.944542+0000","last_undegraded":"2023-10-18T11:38:02.944542+0000","last_fullsized":"2023-10-18T11:38:02.944542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'1801","reported_seq":1843,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.945745+0000","last_change":"2023-10-18T11:38:16.945923+0000","last_active":"2023-10-18T11:38:16.945745+0000","last_peered":"2023-10-18T11:38:16.945745+0000","last_clean":"2023-10-18T11:38:16.945745+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:38:16.945745+0000","last_undegraded":"2023-10-18T11:38:16.945745+0000","last_fullsized":"2023-10-18T11:38:16.945745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1801","last_scrub_stamp":"2023-10-18T11:38:16.945606+0000","last_deep_scrub":"31'1801","last_deep_scrub_stamp":"2023-10-18T11:38:16.945606+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.945606+0000","objects_scrubbed":10,"log_size":1801,"log_dups_size":0,"ondisk_log_size":1801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:06:47.403273+0000","scrub_duration":0.099502073999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":9197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'468","reported_seq":551,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:36:58.715256+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:36:58.715256+0000","last_peered":"2023-10-18T11:36:58.715256+0000","last_clean":"2023-10-18T11:36:58.715256+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:36:58.715256+0000","last_undegraded":"2023-10-18T11:36:58.715256+0000","last_fullsized":"2023-10-18T11:36:58.715256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":372,"num_write_kb":11119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'118","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:27.563554+0000","last_change":"2023-10-18T11:38:27.563591+0000","last_active":"2023-10-18T11:38:27.563554+0000","last_peered":"2023-10-18T11:38:27.563554+0000","last_clean":"2023-10-18T11:38:27.563554+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:38:27.563554+0000","last_undegraded":"2023-10-18T11:38:27.563554+0000","last_fullsized":"2023-10-18T11:38:27.563554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'118","last_scrub_stamp":"2023-10-18T11:38:27.563488+0000","last_deep_scrub":"31'118","last_deep_scrub_stamp":"2023-10-18T11:38:27.563488+0000","last_clean_scrub_stamp":"2023-10-18T11:38:27.563488+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:31:20.292085+0000","scrub_duration":0.0024232849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'912","reported_seq":954,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.721666+0000","last_change":"2023-10-18T11:38:15.721730+0000","last_active":"2023-10-18T11:38:15.721666+0000","last_peered":"2023-10-18T11:38:15.721666+0000","last_clean":"2023-10-18T11:38:15.721666+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:38:15.721666+0000","last_undegraded":"2023-10-18T11:38:15.721666+0000","last_fullsized":"2023-10-18T11:38:15.721666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'912","last_scrub_stamp":"2023-10-18T11:38:15.721600+0000","last_deep_scrub":"31'912","last_deep_scrub_stamp":"2023-10-18T11:38:15.721600+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.721600+0000","objects_scrubbed":3,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:47:35.843854+0000","scrub_duration":0.019590776000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'408","reported_seq":478,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.237329+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:37:05.237329+0000","last_peered":"2023-10-18T11:37:05.237329+0000","last_clean":"2023-10-18T11:37:05.237329+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:37:05.237329+0000","last_undegraded":"2023-10-18T11:37:05.237329+0000","last_fullsized":"2023-10-18T11:37:05.237329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":10922,"num_write":302,"num_write_kb":9791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.639879+0000","last_change":"2023-10-18T11:38:16.639919+0000","last_active":"2023-10-18T11:38:16.639879+0000","last_peered":"2023-10-18T11:38:16.639879+0000","last_clean":"2023-10-18T11:38:16.639879+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:38:16.639879+0000","last_undegraded":"2023-10-18T11:38:16.639879+0000","last_fullsized":"2023-10-18T11:38:16.639879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:16.639807+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:16.639807+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.639807+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:32.548013+0000","scrub_duration":0.00137429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'1004","reported_seq":1046,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.374765+0000","last_change":"2023-10-18T11:38:14.374816+0000","last_active":"2023-10-18T11:38:14.374765+0000","last_peered":"2023-10-18T11:38:14.374765+0000","last_clean":"2023-10-18T11:38:14.374765+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:38:14.374765+0000","last_undegraded":"2023-10-18T11:38:14.374765+0000","last_fullsized":"2023-10-18T11:38:14.374765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1004","last_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_deep_scrub":"31'1004","last_deep_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.374705+0000","objects_scrubbed":4,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:02:58.873481+0000","scrub_duration":0.027697919000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":4702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'374","reported_seq":448,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415991+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:37:46.415991+0000","last_peered":"2023-10-18T11:37:46.415991+0000","last_clean":"2023-10-18T11:37:46.415991+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:37:46.415991+0000","last_undegraded":"2023-10-18T11:37:46.415991+0000","last_fullsized":"2023-10-18T11:37:46.415991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":12454,"num_write":279,"num_write_kb":12302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.988607+0000","last_change":"2023-10-18T11:38:12.988796+0000","last_active":"2023-10-18T11:38:12.988607+0000","last_peered":"2023-10-18T11:38:12.988607+0000","last_clean":"2023-10-18T11:38:12.988607+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:38:12.988607+0000","last_undegraded":"2023-10-18T11:38:12.988607+0000","last_fullsized":"2023-10-18T11:38:12.988607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.988423+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:04.605203+0000","scrub_duration":0.002583765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'410","reported_seq":843,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:10.019288+0000","last_change":"2023-10-18T11:38:10.019370+0000","last_active":"2023-10-18T11:38:10.019288+0000","last_peered":"2023-10-18T11:38:10.019288+0000","last_clean":"2023-10-18T11:38:10.019288+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:38:10.019288+0000","last_undegraded":"2023-10-18T11:38:10.019288+0000","last_fullsized":"2023-10-18T11:38:10.019288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'410","last_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_deep_scrub":"31'410","last_deep_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_clean_scrub_stamp":"2023-10-18T11:38:10.019192+0000","objects_scrubbed":7,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:01:36.193379+0000","scrub_duration":0.0084515079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":443,"num_write":404,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'508","reported_seq":638,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:05.143670+0000","last_change":"2023-10-18T11:09:46.114944+0000","last_active":"2023-10-18T11:37:05.143670+0000","last_peered":"2023-10-18T11:37:05.143670+0000","last_clean":"2023-10-18T11:37:05.143670+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:37:05.143670+0000","last_undegraded":"2023-10-18T11:37:05.143670+0000","last_fullsized":"2023-10-18T11:37:05.143670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":22458,"num_write":413,"num_write_kb":26305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'141","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.943316+0000","last_change":"2023-10-18T11:09:39.420430+0000","last_active":"2023-10-18T11:38:02.943316+0000","last_peered":"2023-10-18T11:38:02.943316+0000","last_clean":"2023-10-18T11:38:02.943316+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:38:02.943316+0000","last_undegraded":"2023-10-18T11:38:02.943316+0000","last_fullsized":"2023-10-18T11:38:02.943316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1129","reported_seq":1171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.788264+0000","last_change":"2023-10-18T11:38:17.788313+0000","last_active":"2023-10-18T11:38:17.788264+0000","last_peered":"2023-10-18T11:38:17.788264+0000","last_clean":"2023-10-18T11:38:17.788264+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:38:17.788264+0000","last_undegraded":"2023-10-18T11:38:17.788264+0000","last_fullsized":"2023-10-18T11:38:17.788264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1129","last_scrub_stamp":"2023-10-18T11:38:17.788204+0000","last_deep_scrub":"31'1129","last_deep_scrub_stamp":"2023-10-18T11:38:17.788204+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.788204+0000","objects_scrubbed":6,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:02.286980+0000","scrub_duration":0.060761811999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'423","reported_seq":502,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.268334+0000","last_change":"2023-10-18T11:09:46.101866+0000","last_active":"2023-10-18T11:37:46.268334+0000","last_peered":"2023-10-18T11:37:46.268334+0000","last_clean":"2023-10-18T11:37:46.268334+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:37:46.268334+0000","last_undegraded":"2023-10-18T11:37:46.268334+0000","last_fullsized":"2023-10-18T11:37:46.268334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":12954,"num_write":319,"num_write_kb":22076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'121","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.567855+0000","last_change":"2023-10-18T11:38:17.567915+0000","last_active":"2023-10-18T11:38:17.567855+0000","last_peered":"2023-10-18T11:38:17.567855+0000","last_clean":"2023-10-18T11:38:17.567855+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:38:17.567855+0000","last_undegraded":"2023-10-18T11:38:17.567855+0000","last_fullsized":"2023-10-18T11:38:17.567855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'121","last_scrub_stamp":"2023-10-18T11:38:17.567782+0000","last_deep_scrub":"31'121","last_deep_scrub_stamp":"2023-10-18T11:38:17.567782+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.567782+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:02.066559+0000","scrub_duration":0.001187249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'283","reported_seq":325,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.826508+0000","last_change":"2023-10-18T11:38:18.826508+0000","last_active":"2023-10-18T11:38:18.826508+0000","last_peered":"2023-10-18T11:38:18.826508+0000","last_clean":"2023-10-18T11:38:18.826508+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:38:18.826508+0000","last_undegraded":"2023-10-18T11:38:18.826508+0000","last_fullsized":"2023-10-18T11:38:18.826508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'283","last_scrub_stamp":"2023-10-18T11:38:18.826303+0000","last_deep_scrub":"31'283","last_deep_scrub_stamp":"2023-10-18T11:38:18.826303+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.826303+0000","objects_scrubbed":4,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:48.054916+0000","scrub_duration":0.0084837070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'511","reported_seq":601,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.085162+0000","last_change":"2023-10-18T11:09:46.094205+0000","last_active":"2023-10-18T11:37:46.085162+0000","last_peered":"2023-10-18T11:37:46.085162+0000","last_clean":"2023-10-18T11:37:46.085162+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:37:46.085162+0000","last_undegraded":"2023-10-18T11:37:46.085162+0000","last_fullsized":"2023-10-18T11:37:46.085162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":22028,"num_write":389,"num_write_kb":39504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'154","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.935322+0000","last_change":"2023-10-18T11:38:32.935436+0000","last_active":"2023-10-18T11:38:32.935322+0000","last_peered":"2023-10-18T11:38:32.935322+0000","last_clean":"2023-10-18T11:38:32.935322+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:38:32.935322+0000","last_undegraded":"2023-10-18T11:38:32.935322+0000","last_fullsized":"2023-10-18T11:38:32.935322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:32.935169+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:32.935169+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.935169+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:09.549069+0000","scrub_duration":0.0036182440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'403","reported_seq":835,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.336342+0000","last_change":"2023-10-18T11:38:15.336342+0000","last_active":"2023-10-18T11:38:15.336342+0000","last_peered":"2023-10-18T11:38:15.336342+0000","last_clean":"2023-10-18T11:38:15.336342+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:38:15.336342+0000","last_undegraded":"2023-10-18T11:38:15.336342+0000","last_fullsized":"2023-10-18T11:38:15.336342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'403","last_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_deep_scrub":"31'403","last_deep_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.336169+0000","objects_scrubbed":3,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:31.244376+0000","scrub_duration":0.0066715740000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180134,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":390,"num_read_kb":469,"num_write":396,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'442","reported_seq":538,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415763+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:37:46.415763+0000","last_peered":"2023-10-18T11:37:46.415763+0000","last_clean":"2023-10-18T11:37:46.415763+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:37:46.415763+0000","last_undegraded":"2023-10-18T11:37:46.415763+0000","last_fullsized":"2023-10-18T11:37:46.415763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17404,"num_write":347,"num_write_kb":27808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'153","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.062327+0000","last_change":"2023-10-18T11:09:39.351468+0000","last_active":"2023-10-18T11:38:03.062327+0000","last_peered":"2023-10-18T11:38:03.062327+0000","last_clean":"2023-10-18T11:38:03.062327+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:38:03.062327+0000","last_undegraded":"2023-10-18T11:38:03.062327+0000","last_fullsized":"2023-10-18T11:38:03.062327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'189","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:22.612373+0000","last_change":"2023-10-18T11:38:22.612412+0000","last_active":"2023-10-18T11:38:22.612373+0000","last_peered":"2023-10-18T11:38:22.612373+0000","last_clean":"2023-10-18T11:38:22.612373+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:38:22.612373+0000","last_undegraded":"2023-10-18T11:38:22.612373+0000","last_fullsized":"2023-10-18T11:38:22.612373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'189","last_scrub_stamp":"2023-10-18T11:38:22.612315+0000","last_deep_scrub":"31'189","last_deep_scrub_stamp":"2023-10-18T11:38:22.612315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:22.612315+0000","objects_scrubbed":3,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:22:08.752776+0000","scrub_duration":0.0028915519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'380","reported_seq":474,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415877+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:37:46.415877+0000","last_peered":"2023-10-18T11:37:46.415877+0000","last_clean":"2023-10-18T11:37:46.415877+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:37:46.415877+0000","last_undegraded":"2023-10-18T11:37:46.415877+0000","last_fullsized":"2023-10-18T11:37:46.415877+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":277,"num_write_kb":11173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'503","reported_seq":586,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:51.201918+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:37:51.201918+0000","last_peered":"2023-10-18T11:37:51.201918+0000","last_clean":"2023-10-18T11:37:51.201918+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:37:51.201918+0000","last_undegraded":"2023-10-18T11:37:51.201918+0000","last_fullsized":"2023-10-18T11:37:51.201918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":392,"num_write_kb":15493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'157","reported_seq":195,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.999849+0000","last_change":"2023-10-18T11:38:32.000066+0000","last_active":"2023-10-18T11:38:31.999849+0000","last_peered":"2023-10-18T11:38:31.999849+0000","last_clean":"2023-10-18T11:38:31.999849+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:38:31.999849+0000","last_undegraded":"2023-10-18T11:38:31.999849+0000","last_fullsized":"2023-10-18T11:38:31.999849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'157","last_scrub_stamp":"2023-10-18T11:38:31.999671+0000","last_deep_scrub":"31'157","last_deep_scrub_stamp":"2023-10-18T11:38:31.999671+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.999671+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:06.032945+0000","scrub_duration":0.0041825050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'1037","reported_seq":1079,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.385086+0000","last_change":"2023-10-18T11:38:20.385086+0000","last_active":"2023-10-18T11:38:20.385086+0000","last_peered":"2023-10-18T11:38:20.385086+0000","last_clean":"2023-10-18T11:38:20.385086+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:38:20.385086+0000","last_undegraded":"2023-10-18T11:38:20.385086+0000","last_fullsized":"2023-10-18T11:38:20.385086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1037","last_scrub_stamp":"2023-10-18T11:38:20.384953+0000","last_deep_scrub":"31'1037","last_deep_scrub_stamp":"2023-10-18T11:38:20.384953+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.384953+0000","objects_scrubbed":3,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:12.001733+0000","scrub_duration":0.020741213000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":6522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'495","reported_seq":601,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.705169+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:37:07.705169+0000","last_peered":"2023-10-18T11:37:07.705169+0000","last_clean":"2023-10-18T11:37:07.705169+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:37:07.705169+0000","last_undegraded":"2023-10-18T11:37:07.705169+0000","last_fullsized":"2023-10-18T11:37:07.705169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":22638,"num_write":397,"num_write_kb":22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'163","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.936300+0000","last_change":"2023-10-18T11:38:17.936414+0000","last_active":"2023-10-18T11:38:17.936300+0000","last_peered":"2023-10-18T11:38:17.936300+0000","last_clean":"2023-10-18T11:38:17.936300+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:38:17.936300+0000","last_undegraded":"2023-10-18T11:38:17.936300+0000","last_fullsized":"2023-10-18T11:38:17.936300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-10-18T11:38:17.936124+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-10-18T11:38:17.936124+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.936124+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:47.164737+0000","scrub_duration":0.0040074359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'475","reported_seq":981,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.113430+0000","last_change":"2023-10-18T11:38:26.113430+0000","last_active":"2023-10-18T11:38:26.113430+0000","last_peered":"2023-10-18T11:38:26.113430+0000","last_clean":"2023-10-18T11:38:26.113430+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:38:26.113430+0000","last_undegraded":"2023-10-18T11:38:26.113430+0000","last_fullsized":"2023-10-18T11:38:26.113430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'475","last_scrub_stamp":"2023-10-18T11:38:26.113149+0000","last_deep_scrub":"31'475","last_deep_scrub_stamp":"2023-10-18T11:38:26.113149+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.113149+0000","objects_scrubbed":3,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:11.928277+0000","scrub_duration":0.010428636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":464,"num_read_kb":507,"num_write":469,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'1262","reported_seq":1772,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.769789+0000","last_change":"2023-10-18T11:38:16.769841+0000","last_active":"2023-10-18T11:38:16.769789+0000","last_peered":"2023-10-18T11:38:16.769789+0000","last_clean":"2023-10-18T11:38:16.769789+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:38:16.769789+0000","last_undegraded":"2023-10-18T11:38:16.769789+0000","last_fullsized":"2023-10-18T11:38:16.769789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1262","last_scrub_stamp":"2023-10-18T11:38:16.769713+0000","last_deep_scrub":"31'1262","last_deep_scrub_stamp":"2023-10-18T11:38:16.769713+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.769713+0000","objects_scrubbed":5,"log_size":1262,"log_dups_size":0,"ondisk_log_size":1262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:46:57.406757+0000","scrub_duration":0.022924356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4346422,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":505,"num_write":1257,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'154","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:09.051185+0000","last_change":"2023-10-18T11:38:09.051296+0000","last_active":"2023-10-18T11:38:09.051185+0000","last_peered":"2023-10-18T11:38:09.051185+0000","last_clean":"2023-10-18T11:38:09.051185+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:38:09.051185+0000","last_undegraded":"2023-10-18T11:38:09.051185+0000","last_fullsized":"2023-10-18T11:38:09.051185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_clean_scrub_stamp":"2023-10-18T11:38:09.051022+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:26.016569+0000","scrub_duration":0.003629073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'380","reported_seq":485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.730424+0000","last_change":"2023-10-18T11:38:32.730605+0000","last_active":"2023-10-18T11:38:32.730424+0000","last_peered":"2023-10-18T11:38:32.730424+0000","last_clean":"2023-10-18T11:38:32.730424+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:38:32.730424+0000","last_undegraded":"2023-10-18T11:38:32.730424+0000","last_fullsized":"2023-10-18T11:38:32.730424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'380","last_scrub_stamp":"2023-10-18T11:38:32.730250+0000","last_deep_scrub":"31'380","last_deep_scrub_stamp":"2023-10-18T11:38:32.730250+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.730250+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:14.150480+0000","scrub_duration":0.0065888780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":9856,"num_write":276,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2737","reported_seq":2778,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.081157+0000","last_change":"2023-10-18T11:38:20.081285+0000","last_active":"2023-10-18T11:38:20.081157+0000","last_peered":"2023-10-18T11:38:20.081157+0000","last_clean":"2023-10-18T11:38:20.081157+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:38:20.081157+0000","last_undegraded":"2023-10-18T11:38:20.081157+0000","last_fullsized":"2023-10-18T11:38:20.081157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2737","last_scrub_stamp":"2023-10-18T11:38:20.080991+0000","last_deep_scrub":"31'2737","last_deep_scrub_stamp":"2023-10-18T11:38:20.080991+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.080991+0000","objects_scrubbed":4,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:23.653427+0000","scrub_duration":0.118224197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2726,"num_write_kb":13571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'169","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.602939+0000","last_change":"2023-10-18T11:38:15.602980+0000","last_active":"2023-10-18T11:38:15.602939+0000","last_peered":"2023-10-18T11:38:15.602939+0000","last_clean":"2023-10-18T11:38:15.602939+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:38:15.602939+0000","last_undegraded":"2023-10-18T11:38:15.602939+0000","last_fullsized":"2023-10-18T11:38:15.602939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'169","last_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_deep_scrub":"31'169","last_deep_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.602878+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:15:22.593515+0000","scrub_duration":0.0020891960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'415","reported_seq":491,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.410397+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:37:16.410397+0000","last_peered":"2023-10-18T11:37:16.410397+0000","last_clean":"2023-10-18T11:37:16.410397+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:37:16.410397+0000","last_undegraded":"2023-10-18T11:37:16.410397+0000","last_fullsized":"2023-10-18T11:37:16.410397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":317,"num_write_kb":9906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'168","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.138466+0000","last_change":"2023-10-18T11:09:39.359747+0000","last_active":"2023-10-18T11:38:03.138466+0000","last_peered":"2023-10-18T11:38:03.138466+0000","last_clean":"2023-10-18T11:38:03.138466+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:38:03.138466+0000","last_undegraded":"2023-10-18T11:38:03.138466+0000","last_fullsized":"2023-10-18T11:38:03.138466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'156","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:25.678209+0000","last_change":"2023-10-18T11:38:25.678385+0000","last_active":"2023-10-18T11:38:25.678209+0000","last_peered":"2023-10-18T11:38:25.678209+0000","last_clean":"2023-10-18T11:38:25.678209+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:38:25.678209+0000","last_undegraded":"2023-10-18T11:38:25.678209+0000","last_fullsized":"2023-10-18T11:38:25.678209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2023-10-18T11:38:25.677969+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2023-10-18T11:38:25.677969+0000","last_clean_scrub_stamp":"2023-10-18T11:38:25.677969+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:47:06.315013+0000","scrub_duration":0.0040068400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'163","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.994106+0000","last_change":"2023-10-18T11:10:10.416758+0000","last_active":"2023-10-18T11:38:02.994106+0000","last_peered":"2023-10-18T11:38:02.994106+0000","last_clean":"2023-10-18T11:38:02.994106+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:38:02.994106+0000","last_undegraded":"2023-10-18T11:38:02.994106+0000","last_fullsized":"2023-10-18T11:38:02.994106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"31'146","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.084535+0000","last_change":"2023-10-18T11:38:16.084653+0000","last_active":"2023-10-18T11:38:16.084535+0000","last_peered":"2023-10-18T11:38:16.084535+0000","last_clean":"2023-10-18T11:38:16.084535+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:38:16.084535+0000","last_undegraded":"2023-10-18T11:38:16.084535+0000","last_fullsized":"2023-10-18T11:38:16.084535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.084368+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:45.312981+0000","scrub_duration":0.0039813269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'131","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.024992+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:38:03.024992+0000","last_peered":"2023-10-18T11:38:03.024992+0000","last_clean":"2023-10-18T11:38:03.024992+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:38:03.024992+0000","last_undegraded":"2023-10-18T11:38:03.024992+0000","last_fullsized":"2023-10-18T11:38:03.024992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'151","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.075631+0000","last_change":"2023-10-18T11:09:39.423043+0000","last_active":"2023-10-18T11:38:03.075631+0000","last_peered":"2023-10-18T11:38:03.075631+0000","last_clean":"2023-10-18T11:38:03.075631+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:38:03.075631+0000","last_undegraded":"2023-10-18T11:38:03.075631+0000","last_fullsized":"2023-10-18T11:38:03.075631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'152","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:24.563866+0000","last_change":"2023-10-18T11:38:24.563908+0000","last_active":"2023-10-18T11:38:24.563866+0000","last_peered":"2023-10-18T11:38:24.563866+0000","last_clean":"2023-10-18T11:38:24.563866+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:38:24.563866+0000","last_undegraded":"2023-10-18T11:38:24.563866+0000","last_fullsized":"2023-10-18T11:38:24.563866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'152","last_scrub_stamp":"2023-10-18T11:38:24.563782+0000","last_deep_scrub":"31'152","last_deep_scrub_stamp":"2023-10-18T11:38:24.563782+0000","last_clean_scrub_stamp":"2023-10-18T11:38:24.563782+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:53.792395+0000","scrub_duration":0.001529683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'128","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.052206+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:38:03.052206+0000","last_peered":"2023-10-18T11:38:03.052206+0000","last_clean":"2023-10-18T11:38:03.052206+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:38:03.052206+0000","last_undegraded":"2023-10-18T11:38:03.052206+0000","last_fullsized":"2023-10-18T11:38:03.052206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'145","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:34.309838+0000","last_change":"2023-10-18T11:38:34.309877+0000","last_active":"2023-10-18T11:38:34.309838+0000","last_peered":"2023-10-18T11:38:34.309838+0000","last_clean":"2023-10-18T11:38:34.309838+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:38:34.309838+0000","last_undegraded":"2023-10-18T11:38:34.309838+0000","last_fullsized":"2023-10-18T11:38:34.309838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:34.309736+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:34.309736+0000","last_clean_scrub_stamp":"2023-10-18T11:38:34.309736+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:20.124864+0000","scrub_duration":0.0026226790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'162","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.032277+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:38:03.032277+0000","last_peered":"2023-10-18T11:38:03.032277+0000","last_clean":"2023-10-18T11:38:03.032277+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:38:03.032277+0000","last_undegraded":"2023-10-18T11:38:03.032277+0000","last_fullsized":"2023-10-18T11:38:03.032277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'149","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.215417+0000","last_change":"2023-10-18T11:38:32.215456+0000","last_active":"2023-10-18T11:38:32.215417+0000","last_peered":"2023-10-18T11:38:32.215417+0000","last_clean":"2023-10-18T11:38:32.215417+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:38:32.215417+0000","last_undegraded":"2023-10-18T11:38:32.215417+0000","last_fullsized":"2023-10-18T11:38:32.215417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'149","last_scrub_stamp":"2023-10-18T11:38:32.215344+0000","last_deep_scrub":"31'149","last_deep_scrub_stamp":"2023-10-18T11:38:32.215344+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.215344+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:46.370051+0000","scrub_duration":0.0012886499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:25.111370+0000","last_change":"2023-10-18T11:38:25.111474+0000","last_active":"2023-10-18T11:38:25.111370+0000","last_peered":"2023-10-18T11:38:25.111370+0000","last_clean":"2023-10-18T11:38:25.111370+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:38:25.111370+0000","last_undegraded":"2023-10-18T11:38:25.111370+0000","last_fullsized":"2023-10-18T11:38:25.111370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:25.111222+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:25.111222+0000","last_clean_scrub_stamp":"2023-10-18T11:38:25.111222+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:30.151595+0000","scrub_duration":0.0029533910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'152","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.587573+0000","last_change":"2023-10-18T11:38:23.587609+0000","last_active":"2023-10-18T11:38:23.587573+0000","last_peered":"2023-10-18T11:38:23.587573+0000","last_clean":"2023-10-18T11:38:23.587573+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:38:23.587573+0000","last_undegraded":"2023-10-18T11:38:23.587573+0000","last_fullsized":"2023-10-18T11:38:23.587573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'152","last_scrub_stamp":"2023-10-18T11:38:23.587505+0000","last_deep_scrub":"31'152","last_deep_scrub_stamp":"2023-10-18T11:38:23.587505+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.587505+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:26.405832+0000","scrub_duration":0.0012722530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'153","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.945560+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:38:02.945560+0000","last_peered":"2023-10-18T11:38:02.945560+0000","last_clean":"2023-10-18T11:38:02.945560+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:38:02.945560+0000","last_undegraded":"2023-10-18T11:38:02.945560+0000","last_fullsized":"2023-10-18T11:38:02.945560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'167","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.660058+0000","last_change":"2023-10-18T11:38:26.660178+0000","last_active":"2023-10-18T11:38:26.660058+0000","last_peered":"2023-10-18T11:38:26.660058+0000","last_clean":"2023-10-18T11:38:26.660058+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:38:26.660058+0000","last_undegraded":"2023-10-18T11:38:26.660058+0000","last_fullsized":"2023-10-18T11:38:26.660058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-10-18T11:38:26.659882+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-10-18T11:38:26.659882+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.659882+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:11.158659+0000","scrub_duration":0.0030154539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'146","reported_seq":169,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:11.030948+0000","last_change":"2023-10-18T11:10:10.401580+0000","last_active":"2023-10-18T11:38:11.030948+0000","last_peered":"2023-10-18T11:38:11.030948+0000","last_clean":"2023-10-18T11:38:11.030948+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:38:11.030948+0000","last_undegraded":"2023-10-18T11:38:11.030948+0000","last_fullsized":"2023-10-18T11:38:11.030948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'144","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.055822+0000","last_change":"2023-10-18T11:09:39.354336+0000","last_active":"2023-10-18T11:38:03.055822+0000","last_peered":"2023-10-18T11:38:03.055822+0000","last_clean":"2023-10-18T11:38:03.055822+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:38:03.055822+0000","last_undegraded":"2023-10-18T11:38:03.055822+0000","last_fullsized":"2023-10-18T11:38:03.055822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'154","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.079372+0000","last_change":"2023-10-18T11:09:39.401976+0000","last_active":"2023-10-18T11:38:03.079372+0000","last_peered":"2023-10-18T11:38:03.079372+0000","last_clean":"2023-10-18T11:38:03.079372+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:38:03.079372+0000","last_undegraded":"2023-10-18T11:38:03.079372+0000","last_fullsized":"2023-10-18T11:38:03.079372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'135","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.107478+0000","last_change":"2023-10-18T11:38:20.107589+0000","last_active":"2023-10-18T11:38:20.107478+0000","last_peered":"2023-10-18T11:38:20.107478+0000","last_clean":"2023-10-18T11:38:20.107478+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:38:20.107478+0000","last_undegraded":"2023-10-18T11:38:20.107478+0000","last_fullsized":"2023-10-18T11:38:20.107478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2023-10-18T11:38:20.107315+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2023-10-18T11:38:20.107315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.107315+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:23:15.323035+0000","scrub_duration":0.004575244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'173","reported_seq":195,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.072979+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:38:03.072979+0000","last_peered":"2023-10-18T11:38:03.072979+0000","last_clean":"2023-10-18T11:38:03.072979+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:38:03.072979+0000","last_undegraded":"2023-10-18T11:38:03.072979+0000","last_fullsized":"2023-10-18T11:38:03.072979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'137","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.600492+0000","last_change":"2023-10-18T11:38:29.600525+0000","last_active":"2023-10-18T11:38:29.600492+0000","last_peered":"2023-10-18T11:38:29.600492+0000","last_clean":"2023-10-18T11:38:29.600492+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:38:29.600492+0000","last_undegraded":"2023-10-18T11:38:29.600492+0000","last_fullsized":"2023-10-18T11:38:29.600492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:29.600430+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:29.600430+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.600430+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:12:23.713131+0000","scrub_duration":0.0012082449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'153","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.137256+0000","last_change":"2023-10-18T11:09:39.320580+0000","last_active":"2023-10-18T11:38:03.137256+0000","last_peered":"2023-10-18T11:38:03.137256+0000","last_clean":"2023-10-18T11:38:03.137256+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:38:03.137256+0000","last_undegraded":"2023-10-18T11:38:03.137256+0000","last_fullsized":"2023-10-18T11:38:03.137256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'147","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.137659+0000","last_change":"2023-10-18T11:09:39.320508+0000","last_active":"2023-10-18T11:38:03.137659+0000","last_peered":"2023-10-18T11:38:03.137659+0000","last_clean":"2023-10-18T11:38:03.137659+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:38:03.137659+0000","last_undegraded":"2023-10-18T11:38:03.137659+0000","last_fullsized":"2023-10-18T11:38:03.137659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'145","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.944489+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:38:02.944489+0000","last_peered":"2023-10-18T11:38:02.944489+0000","last_clean":"2023-10-18T11:38:02.944489+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:38:02.944489+0000","last_undegraded":"2023-10-18T11:38:02.944489+0000","last_fullsized":"2023-10-18T11:38:02.944489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'150","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.945550+0000","last_change":"2023-10-18T11:38:13.945663+0000","last_active":"2023-10-18T11:38:13.945550+0000","last_peered":"2023-10-18T11:38:13.945550+0000","last_clean":"2023-10-18T11:38:13.945550+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:38:13.945550+0000","last_undegraded":"2023-10-18T11:38:13.945550+0000","last_fullsized":"2023-10-18T11:38:13.945550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.945379+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.853585+0000","scrub_duration":0.0032551009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'134","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.943157+0000","last_change":"2023-10-18T11:09:39.360846+0000","last_active":"2023-10-18T11:38:02.943157+0000","last_peered":"2023-10-18T11:38:02.943157+0000","last_clean":"2023-10-18T11:38:02.943157+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:38:02.943157+0000","last_undegraded":"2023-10-18T11:38:02.943157+0000","last_fullsized":"2023-10-18T11:38:02.943157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'143","reported_seq":165,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.983137+0000","last_change":"2023-10-18T11:10:10.413563+0000","last_active":"2023-10-18T11:38:02.983137+0000","last_peered":"2023-10-18T11:38:02.983137+0000","last_clean":"2023-10-18T11:38:02.983137+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:38:02.983137+0000","last_undegraded":"2023-10-18T11:38:02.983137+0000","last_fullsized":"2023-10-18T11:38:02.983137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'127","reported_seq":165,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.587489+0000","last_change":"2023-10-18T11:38:18.587542+0000","last_active":"2023-10-18T11:38:18.587489+0000","last_peered":"2023-10-18T11:38:18.587489+0000","last_clean":"2023-10-18T11:38:18.587489+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:38:18.587489+0000","last_undegraded":"2023-10-18T11:38:18.587489+0000","last_fullsized":"2023-10-18T11:38:18.587489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'127","last_scrub_stamp":"2023-10-18T11:38:18.587414+0000","last_deep_scrub":"31'127","last_deep_scrub_stamp":"2023-10-18T11:38:18.587414+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.587414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:00.007644+0000","scrub_duration":0.0032637949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'137","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:35.338828+0000","last_change":"2023-10-18T11:38:35.338865+0000","last_active":"2023-10-18T11:38:35.338828+0000","last_peered":"2023-10-18T11:38:35.338828+0000","last_clean":"2023-10-18T11:38:35.338828+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:38:35.338828+0000","last_undegraded":"2023-10-18T11:38:35.338828+0000","last_fullsized":"2023-10-18T11:38:35.338828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:35.338757+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:35.338757+0000","last_clean_scrub_stamp":"2023-10-18T11:38:35.338757+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:54:11.626222+0000","scrub_duration":0.0026066140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'142","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.179165+0000","last_change":"2023-10-18T11:09:39.363750+0000","last_active":"2023-10-18T11:38:03.179165+0000","last_peered":"2023-10-18T11:38:03.179165+0000","last_clean":"2023-10-18T11:38:03.179165+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:38:03.179165+0000","last_undegraded":"2023-10-18T11:38:03.179165+0000","last_fullsized":"2023-10-18T11:38:03.179165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'165","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:11.775476+0000","last_change":"2023-10-18T11:38:11.775586+0000","last_active":"2023-10-18T11:38:11.775476+0000","last_peered":"2023-10-18T11:38:11.775476+0000","last_clean":"2023-10-18T11:38:11.775476+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:38:11.775476+0000","last_undegraded":"2023-10-18T11:38:11.775476+0000","last_fullsized":"2023-10-18T11:38:11.775476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:11.775315+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:28.740862+0000","scrub_duration":0.0041709950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'146","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:02.942130+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:38:02.942130+0000","last_peered":"2023-10-18T11:38:02.942130+0000","last_clean":"2023-10-18T11:38:02.942130+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:38:02.942130+0000","last_undegraded":"2023-10-18T11:38:02.942130+0000","last_fullsized":"2023-10-18T11:38:02.942130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2017,"num_read_kb":484709,"num_write":10619,"num_write_kb":576779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13929,"ondisk_log_size":13929,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9424,"ondisk_log_size":9424,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":100007018,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":2171,"num_read_kb":2416,"num_write":26219,"num_write_kb":112209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159006720,"data_stored":200014036,"data_compressed":12429396,"data_compressed_allocated":19357696,"data_compressed_original":60612608,"omap_allocated":0,"internal_metadata":0},"log_size":24370,"ondisk_log_size":24370,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509798,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113708,"kb_used_data":24228,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94258132,"statfs":{"total":96636764160,"available":96520327168,"internally_reserved":0,"allocated":24809472,"data_stored":31797443,"data_compressed":2010206,"data_compressed_allocated":3112960,"data_compressed_original":10338304,"omap_allocated":1588,"internal_metadata":91617740},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.88200000000000001,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":1.046},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0069999999999999,"5min":1.3260000000000001,"15min":19.158000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.73699999999999999},"min":{"1min":0.44400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.075,"5min":19.673999999999999,"15min":19.673999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.878,"15min":0.73399999999999999},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.36099999999999999},"max":{"1min":0.91600000000000004,"5min":15.692,"15min":15.692},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.68300000000000005,"15min":0.65900000000000003},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.9239999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.442,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.528,"5min":1.528,"15min":5.444},"last":0.59599999999999997}]},{"osd":3,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.93999999999999995,"15min":0.81899999999999995},"min":{"1min":0.39400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4319999999999999,"5min":12.368,"15min":12.368},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.68799999999999994,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":13.1},"last":0.67400000000000004}]},{"osd":4,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.35199999999999998},"min":{"1min":0.28599999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48999999999999999,"5min":1.895,"15min":1.895},"last":0.432},{"interface":"front","average":{"1min":0.379,"5min":0.37,"15min":0.371},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.53200000000000003,"5min":1.321,"15min":1.321},"last":0.46999999999999997}]},{"osd":5,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.28000000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47999999999999998,"5min":0.85099999999999998,"15min":1.081},"last":0.505},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.437,"15min":0.41099999999999998},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.52000000000000002,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.49399999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44,"15min":0.42499999999999999},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":0.54600000000000004,"5min":3.4409999999999998,"15min":3.4409999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.35899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55900000000000005,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.52700000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509796,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93740,"kb_used_data":18148,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278100,"statfs":{"total":96636764160,"available":96540774400,"internally_reserved":0,"allocated":18583552,"data_stored":23213882,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60499999999999998,"15min":0.63700000000000001},"min":{"1min":0.439,"5min":0.36199999999999999,"15min":0.31},"max":{"1min":1.0489999999999999,"5min":1.0740000000000001,"15min":9.3190000000000008},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.62,"15min":0.66300000000000003},"min":{"1min":0.46600000000000003,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":1.024,"5min":1.1699999999999999,"15min":15.282999999999999},"last":0.94799999999999995}]},{"osd":1,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.52300000000000002,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.0369999999999999,"5min":1.202,"15min":6.6429999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61799999999999999,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92200000000000004,"5min":1.153,"15min":1.748},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.33300000000000002},"max":{"1min":0.94199999999999995,"5min":1.355,"15min":1.839},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71699999999999997,"15min":0.68200000000000005},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.34499999999999997},"max":{"1min":1.202,"5min":1.468,"15min":1.6819999999999999},"last":0.70799999999999996}]},{"osd":3,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67500000000000004,"15min":0.73299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":1.113,"5min":1.2410000000000001,"15min":13.840999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.69699999999999995,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":1.0800000000000001,"5min":1.1950000000000001,"15min":23.155999999999999},"last":0.76700000000000002}]},{"osd":4,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25700000000000001,"5min":0.23899999999999999,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.52600000000000002,"15min":0.88},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.38200000000000001,"15min":0.371},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.48299999999999998,"5min":0.53500000000000003,"15min":1.0469999999999999},"last":0.33900000000000002}]},{"osd":6,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39200000000000002,"15min":0.373},"min":{"1min":0.27900000000000003,"5min":0.26900000000000002,"15min":0.23300000000000001},"max":{"1min":0.5,"5min":0.54300000000000004,"15min":0.56799999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.316,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.624},"last":0.40300000000000002}]},{"osd":7,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.33400000000000002,"5min":0.27500000000000002,"15min":0.253},"max":{"1min":0.56499999999999995,"5min":0.57899999999999996,"15min":0.77600000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41299999999999998,"15min":0.40699999999999997},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.53500000000000003,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.42999999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509797,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87864,"kb_used_data":20592,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94283976,"statfs":{"total":96636764160,"available":96546791424,"internally_reserved":0,"allocated":21086208,"data_stored":26657639,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.32200000000000001,"15min":0.29599999999999999},"max":{"1min":0.92300000000000004,"5min":1.21,"15min":1.663},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68600000000000005,"15min":0.623},"min":{"1min":0.45500000000000002,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":0.98699999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.70899999999999996}]},{"osd":1,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.33700000000000002,"15min":0.32500000000000001},"max":{"1min":0.94799999999999995,"5min":1.246,"15min":1.8620000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.45500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.056,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1180000000000001,"5min":1.1990000000000001,"15min":1.248},"last":0.874},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.38700000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.2350000000000001,"15min":3.5579999999999998},"last":0.69099999999999995}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.373},"max":{"1min":1.119,"5min":1.4930000000000001,"15min":1.5049999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":1.0840000000000001,"5min":1.4019999999999999,"15min":1.8779999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.223},"max":{"1min":0.504,"5min":0.51500000000000001,"15min":0.72699999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.32100000000000001,"5min":0.248,"15min":0.24399999999999999},"max":{"1min":0.53600000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40899999999999997}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.24299999999999999,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.57799999999999996,"15min":0.622},"last":0.44},{"interface":"front","average":{"1min":0.44,"5min":0.41099999999999998,"15min":0.40200000000000002},"min":{"1min":0.36599999999999999,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.54600000000000004,"5min":0.65900000000000003,"15min":0.67400000000000004},"last":0.38700000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.56299999999999994,"5min":0.67300000000000004,"15min":0.68999999999999995},"last":0.47199999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509796,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144544,"kb_used_data":27288,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94227296,"statfs":{"total":96636764160,"available":96488751104,"internally_reserved":0,"allocated":27942912,"data_stored":33976532,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":1591,"internal_metadata":120060361},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.391,"15min":1.147},"min":{"1min":0.66300000000000003,"5min":0.5,"15min":0.314},"max":{"1min":2.6360000000000001,"5min":24.654,"15min":24.654},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.339,"15min":1.1539999999999999},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.379},"max":{"1min":2.5899999999999999,"5min":18.518000000000001,"15min":18.518000000000001},"last":1.458}]},{"osd":1,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.4059999999999999,"15min":1.2430000000000001},"min":{"1min":0.49299999999999999,"5min":0.441,"15min":0.35399999999999998},"max":{"1min":2.8140000000000001,"5min":16.361999999999998,"15min":16.361999999999998},"last":1.577},{"interface":"front","average":{"1min":1.407,"5min":1.5469999999999999,"15min":1.361},"min":{"1min":0.83799999999999997,"5min":0.57699999999999996,"15min":0.43099999999999999},"max":{"1min":2.278,"5min":24.611000000000001,"15min":24.611000000000001},"last":1.0880000000000001}]},{"osd":2,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.52,"15min":1.3979999999999999},"min":{"1min":0.71199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.8959999999999999,"5min":16.576000000000001,"15min":16.576000000000001},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.452,"5min":1.6739999999999999,"15min":1.4810000000000001},"min":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.45100000000000001},"max":{"1min":2.7290000000000001,"5min":24.553000000000001,"15min":24.553000000000001},"last":0.93500000000000005}]},{"osd":4,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.454,"15min":1.2290000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.432},"max":{"1min":2.2679999999999998,"5min":18.721,"15min":18.721},"last":1.302},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.379,"15min":1.266},"min":{"1min":0.77000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.5099999999999998,"5min":16.481000000000002,"15min":16.481000000000002},"last":1.341}]},{"osd":5,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.6160000000000001,"15min":1.3959999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.44700000000000001},"max":{"1min":2.569,"5min":24.786999999999999,"15min":24.786999999999999},"last":1.198},{"interface":"front","average":{"1min":1.397,"5min":1.6279999999999999,"15min":1.365},"min":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.49199999999999999},"max":{"1min":2.6120000000000001,"5min":18.681999999999999,"15min":18.681999999999999},"last":1.1599999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.518,"15min":1.397},"min":{"1min":0.82099999999999995,"5min":0.59899999999999998,"15min":0.52900000000000003},"max":{"1min":2.3370000000000002,"5min":16.513999999999999,"15min":16.513999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.625,"5min":1.7150000000000001,"15min":1.508},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.54300000000000004},"max":{"1min":2.3940000000000001,"5min":24.834,"15min":24.834},"last":1.399}]},{"osd":7,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5740000000000001,"5min":1.718,"15min":1.4730000000000001},"min":{"1min":0.64700000000000002,"5min":0.499,"15min":0.499},"max":{"1min":2.847,"5min":18.800000000000001,"15min":18.800000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.645,"5min":1.6599999999999999,"15min":1.5209999999999999},"min":{"1min":0.86499999999999999,"5min":0.64100000000000001,"15min":0.496},"max":{"1min":2.6899999999999999,"5min":16.544,"15min":16.544},"last":1.6319999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509796,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94552,"kb_used_data":13456,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94277288,"statfs":{"total":96636764160,"available":96539942912,"internally_reserved":0,"allocated":13778944,"data_stored":17047576,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.141,"15min":1.0549999999999999},"min":{"1min":0.72199999999999998,"5min":0.40600000000000003,"15min":0.308},"max":{"1min":1.829,"5min":2.5830000000000002,"15min":2.9249999999999998},"last":1.242},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1659999999999999,"15min":1.1140000000000001},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":1.732,"5min":3.2919999999999998,"15min":3.964},"last":1.0920000000000001}]},{"osd":1,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.264,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.53700000000000003,"15min":0.40200000000000002},"max":{"1min":2.5409999999999999,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3520000000000001,"15min":1.2849999999999999},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.056,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.4950000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4610000000000001,"15min":1.3680000000000001},"min":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.44},"max":{"1min":2.7250000000000001,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.538,"15min":1.391},"min":{"1min":0.61099999999999999,"5min":0.55400000000000005,"15min":0.53900000000000003},"max":{"1min":2.157,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.712}]},{"osd":4,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2230000000000001,"15min":1.1439999999999999},"min":{"1min":0.66700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.9870000000000001,"5min":3.3759999999999999,"15min":3.3759999999999999},"last":1.327},{"interface":"front","average":{"1min":1.248,"5min":1.29,"15min":1.2150000000000001},"min":{"1min":0.70499999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.0449999999999999,"5min":3.831,"15min":3.831},"last":1.1459999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.4199999999999999,"15min":1.254},"min":{"1min":0.76000000000000001,"5min":0.58399999999999996,"15min":0.46200000000000002},"max":{"1min":2.6640000000000001,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3740000000000001,"15min":1.27},"min":{"1min":0.57899999999999996,"5min":0.51200000000000001,"15min":0.441},"max":{"1min":2.1150000000000002,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.454}]},{"osd":6,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.431,"15min":1.329},"min":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.49399999999999999},"max":{"1min":2.1099999999999999,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.997},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5409999999999999,"15min":1.363},"min":{"1min":0.91200000000000003,"5min":0.68100000000000005,"15min":0.50700000000000001},"max":{"1min":2.7989999999999999,"5min":5.133,"15min":5.133},"last":1.855}]},{"osd":7,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.498,"15min":1.385},"min":{"1min":0.89300000000000002,"5min":0.68100000000000005,"15min":0.48599999999999999},"max":{"1min":2.206,"5min":3.597,"15min":3.597},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.571,"15min":1.448},"min":{"1min":0.73999999999999999,"5min":0.65100000000000002,"15min":0.55900000000000005},"max":{"1min":2.3860000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":1.071}]}]},{"osd":1,"up_from":15,"seq":64424509797,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153264,"kb_used_data":23592,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94218576,"statfs":{"total":96636764160,"available":96479821824,"internally_reserved":0,"allocated":24158208,"data_stored":30584690,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.056,"15min":1.0980000000000001},"min":{"1min":0.66700000000000004,"5min":0.38400000000000001,"15min":0.313},"max":{"1min":1.4670000000000001,"5min":2.5649999999999999,"15min":10.836},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.169,"15min":1.1319999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":3.8410000000000002},"last":1.621}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1919999999999999,"15min":1.1890000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.32900000000000001},"max":{"1min":1.931,"5min":3.2389999999999999,"15min":4.4199999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.649,"5min":1.385,"15min":1.335},"min":{"1min":0.50900000000000001,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":8.6229999999999993,"5min":8.6229999999999993,"15min":10.782},"last":1.538}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.343,"15min":1.405},"min":{"1min":0.70599999999999996,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":1.9330000000000001,"5min":2.8420000000000001,"15min":6.8150000000000004},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.2929999999999999,"15min":1.319},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.0609999999999999,"5min":3.1200000000000001,"15min":3.79},"last":1.2210000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.1990000000000001,"15min":1.1870000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.376},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":4.3890000000000002},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.339,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.65700000000000003,"5min":0.63300000000000001,"15min":0.60899999999999999},"max":{"1min":2.2919999999999998,"5min":2.6349999999999998,"15min":6.9950000000000001},"last":1.109}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.288,"15min":1.248},"min":{"1min":0.64700000000000002,"5min":0.58599999999999997,"15min":0.495},"max":{"1min":4.2939999999999996,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3100000000000001,"15min":1.3029999999999999},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52900000000000003},"max":{"1min":2.1320000000000001,"5min":2.294,"15min":4.3419999999999996},"last":1.079}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.407,"15min":1.405},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9059999999999999,"5min":2.7400000000000002,"15min":6.944},"last":1.462},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.353},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55300000000000005},"max":{"1min":2.2130000000000001,"5min":3.3849999999999998,"15min":3.657},"last":1.4139999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4399999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":2.3100000000000001,"5min":3.27,"15min":3.722},"last":1.502},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.45,"15min":1.4430000000000001},"min":{"1min":0.72399999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2589999999999999,"5min":2.6309999999999998,"15min":4.2919999999999998},"last":1.1719999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509797,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106768,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94265072,"statfs":{"total":96636764160,"available":96527433728,"internally_reserved":0,"allocated":17768448,"data_stored":22732859,"data_compressed":1487303,"data_compressed_allocated":2297856,"data_compressed_original":7491584,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.0209999999999999,"15min":1.044},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":5.2450000000000001,"5min":5.2450000000000001,"15min":5.7380000000000004},"last":1.337},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.0780000000000001,"15min":1.1779999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.738,"5min":1.9830000000000001,"15min":20.128},"last":1.599}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.133,"15min":1.1990000000000001},"min":{"1min":0.68700000000000006,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":2.1200000000000001,"5min":2.8039999999999998,"15min":3.2839999999999998},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.728,"5min":1.2809999999999999,"15min":1.2949999999999999},"min":{"1min":0.52400000000000002,"5min":0.38900000000000001,"15min":0.31900000000000001},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":1.492}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.28,"15min":1.272},"min":{"1min":0.72899999999999998,"5min":0.47699999999999998,"15min":0.44600000000000001},"max":{"1min":2.1499999999999999,"5min":4.0510000000000002,"15min":8.9879999999999995},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.3600000000000001,"15min":1.4139999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.1480000000000001,"5min":2.7639999999999998,"15min":5.6219999999999999},"last":1.661}]},{"osd":4,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.252,"15min":1.2150000000000001},"min":{"1min":0.59699999999999998,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1599999999999999,"15min":1.161},"min":{"1min":0.80700000000000005,"5min":0.53800000000000003,"15min":0.51800000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":3.6219999999999999},"last":1.0640000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.2689999999999999,"15min":1.2529999999999999},"min":{"1min":0.88,"5min":0.61899999999999999,"15min":0.49099999999999999},"max":{"1min":2.323,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.3140000000000001,"15min":1.3},"min":{"1min":0.91200000000000003,"5min":0.59299999999999997,"15min":0.56200000000000006},"max":{"1min":2.0289999999999999,"5min":2.2349999999999999,"15min":2.8140000000000001},"last":1.546}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.3779999999999999,"15min":1.369},"min":{"1min":0.84699999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2360000000000002,"5min":2.274,"15min":2.7669999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.542,"5min":1.391,"15min":1.3620000000000001},"min":{"1min":0.89900000000000002,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.7669999999999999},"last":1.137}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.47,"15min":1.444},"min":{"1min":0.80700000000000005,"5min":0.56599999999999995,"15min":0.49199999999999999},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.915},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.3939999999999999,"15min":1.375},"min":{"1min":0.77500000000000002,"5min":0.66500000000000004,"15min":0.59999999999999998},"max":{"1min":2.2829999999999999,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1.3}]}]},{"osd":6,"up_from":14,"seq":60129542500,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98600,"kb_used_data":13344,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273240,"statfs":{"total":96636764160,"available":96535797760,"internally_reserved":0,"allocated":13664256,"data_stored":16262951,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.60799999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":0.95099999999999996,"5min":3.387,"15min":3.387},"last":0.63},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.33300000000000002,"15min":0.31},"max":{"1min":0.92500000000000004,"5min":1.587,"15min":1.587},"last":0.96499999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65900000000000003,"15min":0.63300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.25},"max":{"1min":1.069,"5min":1.478,"15min":1.478},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":1.0129999999999999,"5min":1.554,"15min":1.669},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.377,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":1.2070000000000001,"15min":1.712},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96299999999999997,"5min":1.1000000000000001,"15min":1.1839999999999999},"last":0.78100000000000003}]},{"osd":3,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.877,"5min":1.3200000000000001,"15min":2.694},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68999999999999995,"15min":0.70499999999999996},"min":{"1min":0.48399999999999999,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.97599999999999998,"5min":1.4159999999999999,"15min":2.1459999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35199999999999998,"15min":0.35899999999999999},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.42599999999999999,"5min":0.55600000000000005,"15min":0.63700000000000001},"last":0.314},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36499999999999999,"15min":0.37},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26500000000000001},"max":{"1min":0.40300000000000002,"5min":0.57599999999999996,"15min":0.68600000000000005},"last":0.34300000000000003}]},{"osd":5,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35699999999999998,"15min":0.36699999999999999},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.252},"max":{"1min":0.43099999999999999,"5min":0.65700000000000003,"15min":0.85199999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38600000000000001,"15min":0.39500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.46600000000000003,"5min":0.65800000000000003,"15min":0.67000000000000004},"last":0.371}]},{"osd":7,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26700000000000002},"max":{"1min":0.432,"5min":0.63600000000000001,"15min":0.77600000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.44800000000000001,"5min":0.68300000000000005,"15min":0.80000000000000004},"last":0.38200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17371136,"data_stored":22007641,"data_compressed":1454768,"data_compressed_allocated":2252800,"data_compressed_original":6918144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23826432,"data_stored":30449840,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13447168,"data_stored":16912726,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27611136,"data_stored":33841682,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20754432,"data_stored":26522789,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":23079032,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13332480,"data_stored":16128101,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24412160,"data_stored":31072225,"data_compressed":1977671,"data_compressed_allocated":3067904,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:38:37.970 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.971 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.971 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.971 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.972 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.972 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.972 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.973 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.973 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.973 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.974 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.974 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.974 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.975 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.975 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.975 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.976 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.976 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.976 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-18T11:09:35.568058+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.976 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.977 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.977 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.977 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.978 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.978 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.978 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.979 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.979 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.979 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.980 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.980 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.980 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.981 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.981 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.981 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.982 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.982 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.982 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.983 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.983 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.983 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.983 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.984 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.984 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.984 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.985 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.985 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.985 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.985 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.986 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.986 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.986 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.987 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.987 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.987 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.987 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.988 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.988 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.988 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.989 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.989 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:37.989 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-18T11:38:41.637 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:38:41.647 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:38:57.990 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:38:58.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.211+0000 7f56a3221640 1 Processor -- start 2023-10-18T11:38:58.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.212+0000 7f56a3221640 1 -- start start 2023-10-18T11:38:58.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.213+0000 7f56a3221640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f569c150ec0 0x7f569c157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:58.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.213+0000 7f56a3221640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f569c0c57a0 0x7f569c06d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:58.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.213+0000 7f56a3221640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c5080 0x7f569c06dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:58.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.213+0000 7f56a3221640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c0c3b00 con 0x7f569c150ec0 2023-10-18T11:38:58.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.213+0000 7f56a3221640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c0c6820 con 0x7f569c0c57a0 2023-10-18T11:38:58.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.213+0000 7f56a3221640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0c6b00 con 0x7f569c0c5080 2023-10-18T11:38:58.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.214+0000 7f56a0fbd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f569c150ec0 0x7f569c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:58.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.214+0000 7f569bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f569c0c57a0 0x7f569c06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:58.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.214+0000 7f56a17be640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c5080 0x7f569c06dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:58.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.214+0000 7f56a0fbd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f569c150ec0 0x7f569c157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56382/0 (socket says 172.21.15.151:56382) 2023-10-18T11:38:58.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.214+0000 7f56a0fbd640 1 -- 172.21.15.151:0/4004436417 learned_addr learned my addr 172.21.15.151:0/4004436417 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:58.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.217+0000 7f569bfff640 1 -- 172.21.15.151:0/4004436417 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c5080 msgr2=0x7f569c06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:58.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.217+0000 7f569bfff640 1 --2- 172.21.15.151:0/4004436417 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c5080 0x7f569c06dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.218+0000 7f569bfff640 1 -- 172.21.15.151:0/4004436417 >> v2:172.21.15.151:3300/0 conn(0x7f569c150ec0 msgr2=0x7f569c157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:38:58.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.218+0000 7f569bfff640 1 --2- 172.21.15.151:0/4004436417 >> v2:172.21.15.151:3300/0 conn(0x7f569c150ec0 0x7f569c157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.218+0000 7f569bfff640 1 -- 172.21.15.151:0/4004436417 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c0c1ab0 con 0x7f569c0c57a0 2023-10-18T11:38:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.218+0000 7f56a0fbd640 1 --2- 172.21.15.151:0/4004436417 >> v2:172.21.15.151:3300/0 conn(0x7f569c150ec0 0x7f569c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:38:58.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.220+0000 7f569bfff640 1 --2- 172.21.15.151:0/4004436417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c0c57a0 0x7f569c06d760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f569c0c1730 tx=0x7f568802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=653ad3395d18e98e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:58.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.224+0000 7f569b7fe640 1 -- 172.21.15.151:0/4004436417 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568802e070 con 0x7f569c0c57a0 2023-10-18T11:38:58.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.224+0000 7f569b7fe640 1 -- 172.21.15.151:0/4004436417 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56880315a0 con 0x7f569c0c57a0 2023-10-18T11:38:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.224+0000 7f569b7fe640 1 -- 172.21.15.151:0/4004436417 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688031930 con 0x7f569c0c57a0 2023-10-18T11:38:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.225+0000 7f56a3221640 1 -- 172.21.15.151:0/4004436417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c0c57a0 msgr2=0x7f569c06d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:58.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.225+0000 7f56a3221640 1 --2- 172.21.15.151:0/4004436417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c0c57a0 0x7f569c06d760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f569c0c1730 tx=0x7f568802b840 comp rx=0 tx=0).stop 2023-10-18T11:38:58.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.225+0000 7f56a3221640 1 -- 172.21.15.151:0/4004436417 shutdown_connections 2023-10-18T11:38:58.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.225+0000 7f56a3221640 1 --2- 172.21.15.151:0/4004436417 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c5080 0x7f569c06dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.225+0000 7f56a3221640 1 --2- 172.21.15.151:0/4004436417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c0c57a0 0x7f569c06d760 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.225+0000 7f56a3221640 1 --2- 172.21.15.151:0/4004436417 >> v2:172.21.15.151:3300/0 conn(0x7f569c150ec0 0x7f569c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.225+0000 7f56a3221640 1 -- 172.21.15.151:0/4004436417 >> 172.21.15.151:0/4004436417 conn(0x7f569c0c6f10 msgr2=0x7f569c0c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:58.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.225+0000 7f56a3221640 1 -- 172.21.15.151:0/4004436417 shutdown_connections 2023-10-18T11:38:58.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.225+0000 7f56a3221640 1 -- 172.21.15.151:0/4004436417 wait complete. 2023-10-18T11:38:58.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.227+0000 7f56a3221640 1 Processor -- start 2023-10-18T11:38:58.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.227+0000 7f56a3221640 1 -- start start 2023-10-18T11:38:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.229+0000 7f56a3221640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569c0c5080 0x7f569c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.229+0000 7f56a3221640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c57a0 0x7f569c152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.229+0000 7f56a3221640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c150ec0 0x7f569c1f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.229+0000 7f56a3221640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c155c50 con 0x7f569c0c5080 2023-10-18T11:38:58.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.229+0000 7f56a3221640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c157910 con 0x7f569c150ec0 2023-10-18T11:38:58.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.229+0000 7f56a3221640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0c9bb0 con 0x7f569c0c57a0 2023-10-18T11:38:58.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.229+0000 7f56a17be640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c150ec0 0x7f569c1f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:58.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.229+0000 7f56a0fbd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569c0c5080 0x7f569c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:58.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.229+0000 7f569bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c57a0 0x7f569c152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:58.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.230+0000 7f569bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c57a0 0x7f569c152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:60340/0 (socket says 172.21.15.151:60340) 2023-10-18T11:38:58.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.230+0000 7f569bfff640 1 -- 172.21.15.151:0/1643149021 learned_addr learned my addr 172.21.15.151:0/1643149021 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:38:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.234+0000 7f56a0fbd640 1 -- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c57a0 msgr2=0x7f569c152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.234+0000 7f56a0fbd640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c57a0 0x7f569c152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.234+0000 7f56a0fbd640 1 -- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c150ec0 msgr2=0x7f569c1f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.234+0000 7f56a0fbd640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c150ec0 0x7f569c1f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.234+0000 7f56a0fbd640 1 -- 172.21.15.151:0/1643149021 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900094d0 con 0x7f569c0c5080 2023-10-18T11:38:58.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.238+0000 7f56a0fbd640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569c0c5080 0x7f569c1593a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f569000e890 tx=0x7f569000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.242+0000 7f56997fa640 1 -- 172.21.15.151:0/1643149021 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690004030 con 0x7f569c0c5080 2023-10-18T11:38:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.242+0000 7f56997fa640 1 -- 172.21.15.151:0/1643149021 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5690004190 con 0x7f569c0c5080 2023-10-18T11:38:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.242+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5688009400 con 0x7f569c0c5080 2023-10-18T11:38:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.242+0000 7f56997fa640 1 -- 172.21.15.151:0/1643149021 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690004520 con 0x7f569c0c5080 2023-10-18T11:38:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.243+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c0c9e50 con 0x7f569c0c5080 2023-10-18T11:38:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.244+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c14f9a0 con 0x7f569c0c5080 2023-10-18T11:38:58.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.269+0000 7f56997fa640 1 -- 172.21.15.151:0/1643149021 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f569000c940 con 0x7f569c0c5080 2023-10-18T11:38:58.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.270+0000 7f56997fa640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f568006aef0 0x7f568006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:38:58.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.271+0000 7f569bfff640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f568006aef0 0x7f568006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:38:58.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.271+0000 7f569bfff640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f568006aef0 0x7f568006d3b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f569c14e3f0 tx=0x7f568803d040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:38:58.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.537+0000 7f56997fa640 1 -- 172.21.15.151:0/1643149021 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5690058a20 con 0x7f569c0c5080 2023-10-18T11:38:58.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.538+0000 7f56997fa640 1 -- 172.21.15.151:0/1643149021 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5690054d60 con 0x7f569c0c5080 2023-10-18T11:38:58.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.730+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f569c0c2070 con 0x7f568006aef0 2023-10-18T11:38:58.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.742+0000 7f56997fa640 1 -- 172.21.15.151:0/1643149021 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372387 (secure 0 0 0) 0x7f5688031a60 con 0x7f568006aef0 2023-10-18T11:38:58.749 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:38:58.752 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:38:58.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f568006aef0 msgr2=0x7f568006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:58.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f568006aef0 0x7f568006d3b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f569c14e3f0 tx=0x7f568803d040 comp rx=0 tx=0).stop 2023-10-18T11:38:58.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569c0c5080 msgr2=0x7f569c1593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:38:58.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569c0c5080 0x7f569c1593a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f569000e890 tx=0x7f569000ed50 comp rx=0 tx=0).stop 2023-10-18T11:38:58.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 shutdown_connections 2023-10-18T11:38:58.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f568006aef0 0x7f568006d3b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f569c150ec0 0x7f569c1f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f569c0c57a0 0x7f569c152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 --2- 172.21.15.151:0/1643149021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569c0c5080 0x7f569c1593a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:38:58.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.749+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 >> 172.21.15.151:0/1643149021 conn(0x7f569c0c6f10 msgr2=0x7f569c14ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:38:58.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.750+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 shutdown_connections 2023-10-18T11:38:58.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:38:58.750+0000 7f56a3221640 1 -- 172.21.15.151:0/1643149021 wait complete. 2023-10-18T11:38:58.771 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":915,"stamp":"2023-10-18T11:38:58.621326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":100597386,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":4304,"num_read_kb":487225,"num_write":36997,"num_write_kb":691404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47845,"ondisk_log_size":47845,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":897200,"kb_used_data":158000,"kb_used_omap":12,"kb_used_meta":739123,"kb_avail":754077520,"statfs":{"total":773094113280,"available":772175380480,"internally_reserved":0,"allocated":161792000,"data_stored":202273572,"data_compressed":12494466,"data_compressed_allocated":19447808,"data_compressed_original":61759488,"omap_allocated":12742,"internal_metadata":756862522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003551"},"pg_stats":[{"pgid":"2.1f","version":"31'1794","reported_seq":1838,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.079438+0000","last_change":"2023-10-18T11:38:12.079438+0000","last_active":"2023-10-18T11:38:12.079438+0000","last_peered":"2023-10-18T11:38:12.079438+0000","last_clean":"2023-10-18T11:38:12.079438+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:38:12.079438+0000","last_undegraded":"2023-10-18T11:38:12.079438+0000","last_fullsized":"2023-10-18T11:38:12.079438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1794","last_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_deep_scrub":"31'1794","last_deep_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.079262+0000","objects_scrubbed":9,"log_size":1794,"log_dups_size":0,"ondisk_log_size":1794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:20:44.669761+0000","scrub_duration":0.099044419999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9277295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":10015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'142","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.955490+0000","last_change":"2023-10-18T11:38:16.955575+0000","last_active":"2023-10-18T11:38:16.955490+0000","last_peered":"2023-10-18T11:38:16.955490+0000","last_clean":"2023-10-18T11:38:16.955490+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:38:16.955490+0000","last_undegraded":"2023-10-18T11:38:16.955490+0000","last_fullsized":"2023-10-18T11:38:16.955490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:16.955379+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:16.955379+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.955379+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:19.773706+0000","scrub_duration":0.0027257150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'384","reported_seq":459,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.115461+0000","last_change":"2023-10-18T11:09:46.110176+0000","last_active":"2023-10-18T11:38:12.115461+0000","last_peered":"2023-10-18T11:38:12.115461+0000","last_clean":"2023-10-18T11:38:12.115461+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:38:12.115461+0000","last_undegraded":"2023-10-18T11:38:12.115461+0000","last_fullsized":"2023-10-18T11:38:12.115461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":285,"num_write_kb":10314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'1439","reported_seq":1483,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.051027+0000","last_change":"2023-10-18T11:38:23.051102+0000","last_active":"2023-10-18T11:38:23.051027+0000","last_peered":"2023-10-18T11:38:23.051027+0000","last_clean":"2023-10-18T11:38:23.051027+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:38:23.051027+0000","last_undegraded":"2023-10-18T11:38:23.051027+0000","last_fullsized":"2023-10-18T11:38:23.051027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1439","last_scrub_stamp":"2023-10-18T11:38:23.050919+0000","last_deep_scrub":"31'1439","last_deep_scrub_stamp":"2023-10-18T11:38:23.050919+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.050919+0000","objects_scrubbed":2,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:37.205626+0000","scrub_duration":0.089910790000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1431,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'165","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.966648+0000","last_change":"2023-10-18T11:38:31.966648+0000","last_active":"2023-10-18T11:38:31.966648+0000","last_peered":"2023-10-18T11:38:31.966648+0000","last_clean":"2023-10-18T11:38:31.966648+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:38:31.966648+0000","last_undegraded":"2023-10-18T11:38:31.966648+0000","last_fullsized":"2023-10-18T11:38:31.966648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2023-10-18T11:38:31.966374+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2023-10-18T11:38:31.966374+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.966374+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:57:30.180571+0000","scrub_duration":0.0039781039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'453","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.642188+0000","last_change":"2023-10-18T11:38:38.642188+0000","last_active":"2023-10-18T11:38:38.642188+0000","last_peered":"2023-10-18T11:38:38.642188+0000","last_clean":"2023-10-18T11:38:38.642188+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:38:38.642188+0000","last_undegraded":"2023-10-18T11:38:38.642188+0000","last_fullsized":"2023-10-18T11:38:38.642188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'453","last_scrub_stamp":"2023-10-18T11:38:38.642006+0000","last_deep_scrub":"31'453","last_deep_scrub_stamp":"2023-10-18T11:38:38.642006+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.642006+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:43.682379+0000","scrub_duration":0.0041783769999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":14204,"num_write":357,"num_write_kb":21017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'825","reported_seq":866,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:34.615568+0000","last_change":"2023-10-18T11:38:34.615623+0000","last_active":"2023-10-18T11:38:34.615568+0000","last_peered":"2023-10-18T11:38:34.615568+0000","last_clean":"2023-10-18T11:38:34.615568+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:38:34.615568+0000","last_undegraded":"2023-10-18T11:38:34.615568+0000","last_fullsized":"2023-10-18T11:38:34.615568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'825","last_scrub_stamp":"2023-10-18T11:38:34.615490+0000","last_deep_scrub":"31'825","last_deep_scrub_stamp":"2023-10-18T11:38:34.615490+0000","last_clean_scrub_stamp":"2023-10-18T11:38:34.615490+0000","objects_scrubbed":8,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:39.655863+0000","scrub_duration":0.025506078000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3060357,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'145","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.303391+0000","last_change":"2023-10-18T11:38:37.303430+0000","last_active":"2023-10-18T11:38:37.303391+0000","last_peered":"2023-10-18T11:38:37.303391+0000","last_clean":"2023-10-18T11:38:37.303391+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:38:37.303391+0000","last_undegraded":"2023-10-18T11:38:37.303391+0000","last_fullsized":"2023-10-18T11:38:37.303391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:37.303321+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:37.303321+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.303321+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:55:06.926563+0000","scrub_duration":0.001256479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'331","reported_seq":412,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:45.741405+0000","last_change":"2023-10-18T11:38:45.741499+0000","last_active":"2023-10-18T11:38:45.741405+0000","last_peered":"2023-10-18T11:38:45.741405+0000","last_clean":"2023-10-18T11:38:45.741405+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:38:45.741405+0000","last_undegraded":"2023-10-18T11:38:45.741405+0000","last_fullsized":"2023-10-18T11:38:45.741405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'331","last_scrub_stamp":"2023-10-18T11:38:45.741329+0000","last_deep_scrub":"31'331","last_deep_scrub_stamp":"2023-10-18T11:38:45.741329+0000","last_clean_scrub_stamp":"2023-10-18T11:38:45.741329+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:50.693803+0000","scrub_duration":0.0043312309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":213,"num_write_kb":9865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'10","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.523461+0000","last_change":"2023-10-18T11:38:21.523502+0000","last_active":"2023-10-18T11:38:21.523461+0000","last_peered":"2023-10-18T11:38:21.523461+0000","last_clean":"2023-10-18T11:38:21.523461+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:38:21.523461+0000","last_undegraded":"2023-10-18T11:38:21.523461+0000","last_fullsized":"2023-10-18T11:38:21.523461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-10-18T11:38:21.523393+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-10-18T11:38:21.523393+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.523393+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:57:54.359212+0000","scrub_duration":0.008442148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'167","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:50.073173+0000","last_change":"2023-10-18T11:38:50.073212+0000","last_active":"2023-10-18T11:38:50.073173+0000","last_peered":"2023-10-18T11:38:50.073173+0000","last_clean":"2023-10-18T11:38:50.073173+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:38:50.073173+0000","last_undegraded":"2023-10-18T11:38:50.073173+0000","last_fullsized":"2023-10-18T11:38:50.073173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-10-18T11:38:50.073100+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-10-18T11:38:50.073100+0000","last_clean_scrub_stamp":"2023-10-18T11:38:50.073100+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:14:40.873775+0000","scrub_duration":0.0014290189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'461","reported_seq":552,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:48.707189+0000","last_change":"2023-10-18T11:38:48.707251+0000","last_active":"2023-10-18T11:38:48.707189+0000","last_peered":"2023-10-18T11:38:48.707189+0000","last_clean":"2023-10-18T11:38:48.707189+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:38:48.707189+0000","last_undegraded":"2023-10-18T11:38:48.707189+0000","last_fullsized":"2023-10-18T11:38:48.707189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'461","last_scrub_stamp":"2023-10-18T11:38:48.707107+0000","last_deep_scrub":"31'461","last_deep_scrub_stamp":"2023-10-18T11:38:48.707107+0000","last_clean_scrub_stamp":"2023-10-18T11:38:48.707107+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:39:13.854788+0000","scrub_duration":0.0044031340000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":15764,"num_write":351,"num_write_kb":32860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'140","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.567551+0000","last_change":"2023-10-18T11:38:31.567593+0000","last_active":"2023-10-18T11:38:31.567551+0000","last_peered":"2023-10-18T11:38:31.567551+0000","last_clean":"2023-10-18T11:38:31.567551+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:38:31.567551+0000","last_undegraded":"2023-10-18T11:38:31.567551+0000","last_fullsized":"2023-10-18T11:38:31.567551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'140","last_scrub_stamp":"2023-10-18T11:38:31.567485+0000","last_deep_scrub":"31'140","last_deep_scrub_stamp":"2023-10-18T11:38:31.567485+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.567485+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:17.382614+0000","scrub_duration":0.0011892719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'770","reported_seq":813,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.579965+0000","last_change":"2023-10-18T11:38:20.579965+0000","last_active":"2023-10-18T11:38:20.579965+0000","last_peered":"2023-10-18T11:38:20.579965+0000","last_clean":"2023-10-18T11:38:20.579965+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:38:20.579965+0000","last_undegraded":"2023-10-18T11:38:20.579965+0000","last_fullsized":"2023-10-18T11:38:20.579965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'770","last_scrub_stamp":"2023-10-18T11:38:20.579828+0000","last_deep_scrub":"31'770","last_deep_scrub_stamp":"2023-10-18T11:38:20.579828+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.579828+0000","objects_scrubbed":3,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:49.808441+0000","scrub_duration":0.018364789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'437","reported_seq":518,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:40.640247+0000","last_change":"2023-10-18T11:38:40.640322+0000","last_active":"2023-10-18T11:38:40.640247+0000","last_peered":"2023-10-18T11:38:40.640247+0000","last_clean":"2023-10-18T11:38:40.640247+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:38:40.640247+0000","last_undegraded":"2023-10-18T11:38:40.640247+0000","last_fullsized":"2023-10-18T11:38:40.640247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'437","last_scrub_stamp":"2023-10-18T11:38:40.640174+0000","last_deep_scrub":"31'437","last_deep_scrub_stamp":"2023-10-18T11:38:40.640174+0000","last_clean_scrub_stamp":"2023-10-18T11:38:40.640174+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:14.673448+0000","scrub_duration":0.0046948529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":11430,"num_write":325,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'139","reported_seq":179,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.093847+0000","last_change":"2023-10-18T11:38:30.093847+0000","last_active":"2023-10-18T11:38:30.093847+0000","last_peered":"2023-10-18T11:38:30.093847+0000","last_clean":"2023-10-18T11:38:30.093847+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:38:30.093847+0000","last_undegraded":"2023-10-18T11:38:30.093847+0000","last_fullsized":"2023-10-18T11:38:30.093847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'139","last_scrub_stamp":"2023-10-18T11:38:30.093539+0000","last_deep_scrub":"31'139","last_deep_scrub_stamp":"2023-10-18T11:38:30.093539+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.093539+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:04.126814+0000","scrub_duration":0.0040762330000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'486","reported_seq":529,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.714481+0000","last_change":"2023-10-18T11:38:15.714604+0000","last_active":"2023-10-18T11:38:15.714481+0000","last_peered":"2023-10-18T11:38:15.714481+0000","last_clean":"2023-10-18T11:38:15.714481+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:38:15.714481+0000","last_undegraded":"2023-10-18T11:38:15.714481+0000","last_fullsized":"2023-10-18T11:38:15.714481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'486","last_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_deep_scrub":"31'486","last_deep_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.714323+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:22:01.854784+0000","scrub_duration":0.005976121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'427","reported_seq":527,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:44.740433+0000","last_change":"2023-10-18T11:38:44.740500+0000","last_active":"2023-10-18T11:38:44.740433+0000","last_peered":"2023-10-18T11:38:44.740433+0000","last_clean":"2023-10-18T11:38:44.740433+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:38:44.740433+0000","last_undegraded":"2023-10-18T11:38:44.740433+0000","last_fullsized":"2023-10-18T11:38:44.740433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'427","last_scrub_stamp":"2023-10-18T11:38:44.740345+0000","last_deep_scrub":"31'427","last_deep_scrub_stamp":"2023-10-18T11:38:44.740345+0000","last_clean_scrub_stamp":"2023-10-18T11:38:44.740345+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:03.076796+0000","scrub_duration":0.0046967049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":327,"num_write_kb":17650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'148","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.949313+0000","last_change":"2023-10-18T11:38:14.949444+0000","last_active":"2023-10-18T11:38:14.949313+0000","last_peered":"2023-10-18T11:38:14.949313+0000","last_clean":"2023-10-18T11:38:14.949313+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:38:14.949313+0000","last_undegraded":"2023-10-18T11:38:14.949313+0000","last_fullsized":"2023-10-18T11:38:14.949313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.949157+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:41:56.369387+0000","scrub_duration":0.0041327179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'284","reported_seq":327,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.832954+0000","last_change":"2023-10-18T11:38:21.833085+0000","last_active":"2023-10-18T11:38:21.832954+0000","last_peered":"2023-10-18T11:38:21.832954+0000","last_clean":"2023-10-18T11:38:21.832954+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:38:21.832954+0000","last_undegraded":"2023-10-18T11:38:21.832954+0000","last_fullsized":"2023-10-18T11:38:21.832954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'284","last_scrub_stamp":"2023-10-18T11:38:21.832756+0000","last_deep_scrub":"31'284","last_deep_scrub_stamp":"2023-10-18T11:38:21.832756+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.832756+0000","objects_scrubbed":4,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:25.405192+0000","scrub_duration":0.011219165,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'423","reported_seq":489,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:44.599182+0000","last_change":"2023-10-18T11:38:44.599463+0000","last_active":"2023-10-18T11:38:44.599182+0000","last_peered":"2023-10-18T11:38:44.599182+0000","last_clean":"2023-10-18T11:38:44.599182+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:38:44.599182+0000","last_undegraded":"2023-10-18T11:38:44.599182+0000","last_fullsized":"2023-10-18T11:38:44.599182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'423","last_scrub_stamp":"2023-10-18T11:38:44.598911+0000","last_deep_scrub":"31'423","last_deep_scrub_stamp":"2023-10-18T11:38:44.598911+0000","last_clean_scrub_stamp":"2023-10-18T11:38:44.598911+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:30.414039+0000","scrub_duration":0.0060615870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":324,"num_write_kb":16893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'124","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.596521+0000","last_change":"2023-10-18T11:38:16.596581+0000","last_active":"2023-10-18T11:38:16.596521+0000","last_peered":"2023-10-18T11:38:16.596521+0000","last_clean":"2023-10-18T11:38:16.596521+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:38:16.596521+0000","last_undegraded":"2023-10-18T11:38:16.596521+0000","last_fullsized":"2023-10-18T11:38:16.596521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'124","last_scrub_stamp":"2023-10-18T11:38:16.596449+0000","last_deep_scrub":"31'124","last_deep_scrub_stamp":"2023-10-18T11:38:16.596449+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.596449+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:46:57.233493+0000","scrub_duration":0.001755993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'9","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:40.590744+0000","last_change":"2023-10-18T11:38:40.590786+0000","last_active":"2023-10-18T11:38:40.590744+0000","last_peered":"2023-10-18T11:38:40.590744+0000","last_clean":"2023-10-18T11:38:40.590744+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:38:40.590744+0000","last_undegraded":"2023-10-18T11:38:40.590744+0000","last_fullsized":"2023-10-18T11:38:40.590744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-10-18T11:38:40.590681+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-10-18T11:38:40.590681+0000","last_clean_scrub_stamp":"2023-10-18T11:38:40.590681+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:12:10.767078+0000","scrub_duration":0.0057985620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'432","reported_seq":624,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:33.632992+0000","last_change":"2023-10-18T11:38:33.633067+0000","last_active":"2023-10-18T11:38:33.632992+0000","last_peered":"2023-10-18T11:38:33.632992+0000","last_clean":"2023-10-18T11:38:33.632992+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:38:33.632992+0000","last_undegraded":"2023-10-18T11:38:33.632992+0000","last_fullsized":"2023-10-18T11:38:33.632992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'432","last_scrub_stamp":"2023-10-18T11:38:33.632896+0000","last_deep_scrub":"31'432","last_deep_scrub_stamp":"2023-10-18T11:38:33.632896+0000","last_clean_scrub_stamp":"2023-10-18T11:38:33.632896+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:47.787602+0000","scrub_duration":0.0053552069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":19825,"num_write":333,"num_write_kb":19445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'132","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:28.012524+0000","last_change":"2023-10-18T11:38:28.012708+0000","last_active":"2023-10-18T11:38:28.012524+0000","last_peered":"2023-10-18T11:38:28.012524+0000","last_clean":"2023-10-18T11:38:28.012524+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:38:28.012524+0000","last_undegraded":"2023-10-18T11:38:28.012524+0000","last_fullsized":"2023-10-18T11:38:28.012524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2023-10-18T11:38:28.012283+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2023-10-18T11:38:28.012283+0000","last_clean_scrub_stamp":"2023-10-18T11:38:28.012283+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:02.045557+0000","scrub_duration":0.0049242060000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'17","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.715097+0000","last_change":"2023-10-18T11:38:18.715180+0000","last_active":"2023-10-18T11:38:18.715097+0000","last_peered":"2023-10-18T11:38:18.715097+0000","last_clean":"2023-10-18T11:38:18.715097+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:38:18.715097+0000","last_undegraded":"2023-10-18T11:38:18.715097+0000","last_fullsized":"2023-10-18T11:38:18.715097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'17","last_scrub_stamp":"2023-10-18T11:38:18.715002+0000","last_deep_scrub":"31'17","last_deep_scrub_stamp":"2023-10-18T11:38:18.715002+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.715002+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:34.623209+0000","scrub_duration":0.0046622959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'438","reported_seq":530,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.622058+0000","last_change":"2023-10-18T11:38:30.622058+0000","last_active":"2023-10-18T11:38:30.622058+0000","last_peered":"2023-10-18T11:38:30.622058+0000","last_clean":"2023-10-18T11:38:30.622058+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:38:30.622058+0000","last_undegraded":"2023-10-18T11:38:30.622058+0000","last_fullsized":"2023-10-18T11:38:30.622058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'438","last_scrub_stamp":"2023-10-18T11:38:30.621913+0000","last_deep_scrub":"31'438","last_deep_scrub_stamp":"2023-10-18T11:38:30.621913+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.621913+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:04.843486+0000","scrub_duration":0.0026375550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":16856,"num_write":335,"num_write_kb":23716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'142","reported_seq":182,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.111901+0000","last_change":"2023-10-18T11:38:38.112111+0000","last_active":"2023-10-18T11:38:38.111901+0000","last_peered":"2023-10-18T11:38:38.111901+0000","last_clean":"2023-10-18T11:38:38.111901+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:38:38.111901+0000","last_undegraded":"2023-10-18T11:38:38.111901+0000","last_fullsized":"2023-10-18T11:38:38.111901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:38.111667+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:38.111667+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.111667+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:12:08.288064+0000","scrub_duration":0.0040221160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'292","reported_seq":335,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:22.871865+0000","last_change":"2023-10-18T11:38:22.872065+0000","last_active":"2023-10-18T11:38:22.871865+0000","last_peered":"2023-10-18T11:38:22.871865+0000","last_clean":"2023-10-18T11:38:22.871865+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:38:22.871865+0000","last_undegraded":"2023-10-18T11:38:22.871865+0000","last_fullsized":"2023-10-18T11:38:22.871865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'292","last_scrub_stamp":"2023-10-18T11:38:22.871678+0000","last_deep_scrub":"31'292","last_deep_scrub_stamp":"2023-10-18T11:38:22.871678+0000","last_clean_scrub_stamp":"2023-10-18T11:38:22.871678+0000","objects_scrubbed":4,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:37.026385+0000","scrub_duration":0.014122981999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'450","reported_seq":536,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415835+0000","last_change":"2023-10-18T11:09:46.112437+0000","last_active":"2023-10-18T11:37:46.415835+0000","last_peered":"2023-10-18T11:37:46.415835+0000","last_clean":"2023-10-18T11:37:46.415835+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:37:46.415835+0000","last_undegraded":"2023-10-18T11:37:46.415835+0000","last_fullsized":"2023-10-18T11:37:46.415835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":337,"num_write_kb":25264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'150","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.964725+0000","last_change":"2023-10-18T11:38:30.964725+0000","last_active":"2023-10-18T11:38:30.964725+0000","last_peered":"2023-10-18T11:38:30.964725+0000","last_clean":"2023-10-18T11:38:30.964725+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:38:30.964725+0000","last_undegraded":"2023-10-18T11:38:30.964725+0000","last_fullsized":"2023-10-18T11:38:30.964725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2023-10-18T11:38:30.964435+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2023-10-18T11:38:30.964435+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.964435+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:36.004808+0000","scrub_duration":0.0040942510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'245","reported_seq":289,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.473647+0000","last_change":"2023-10-18T11:38:29.473647+0000","last_active":"2023-10-18T11:38:29.473647+0000","last_peered":"2023-10-18T11:38:29.473647+0000","last_clean":"2023-10-18T11:38:29.473647+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:38:29.473647+0000","last_undegraded":"2023-10-18T11:38:29.473647+0000","last_fullsized":"2023-10-18T11:38:29.473647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'245","last_scrub_stamp":"2023-10-18T11:38:29.473550+0000","last_deep_scrub":"31'245","last_deep_scrub_stamp":"2023-10-18T11:38:29.473550+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.473550+0000","objects_scrubbed":3,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:43.628257+0000","scrub_duration":0.0080227579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'490","reported_seq":564,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:08.871984+0000","last_change":"2023-10-18T11:09:46.102721+0000","last_active":"2023-10-18T11:38:08.871984+0000","last_peered":"2023-10-18T11:38:08.871984+0000","last_clean":"2023-10-18T11:38:08.871984+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:38:08.871984+0000","last_undegraded":"2023-10-18T11:38:08.871984+0000","last_fullsized":"2023-10-18T11:38:08.871984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":390,"num_write_kb":31170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'172","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:46.168808+0000","last_change":"2023-10-18T11:38:46.168808+0000","last_active":"2023-10-18T11:38:46.168808+0000","last_peered":"2023-10-18T11:38:46.168808+0000","last_clean":"2023-10-18T11:38:46.168808+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:38:46.168808+0000","last_undegraded":"2023-10-18T11:38:46.168808+0000","last_fullsized":"2023-10-18T11:38:46.168808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'172","last_scrub_stamp":"2023-10-18T11:38:46.168705+0000","last_deep_scrub":"31'172","last_deep_scrub_stamp":"2023-10-18T11:38:46.168705+0000","last_clean_scrub_stamp":"2023-10-18T11:38:46.168705+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:43:35.619956+0000","scrub_duration":0.0025812449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'791","reported_seq":835,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.776538+0000","last_change":"2023-10-18T11:38:13.776538+0000","last_active":"2023-10-18T11:38:13.776538+0000","last_peered":"2023-10-18T11:38:13.776538+0000","last_clean":"2023-10-18T11:38:13.776538+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:38:13.776538+0000","last_undegraded":"2023-10-18T11:38:13.776538+0000","last_fullsized":"2023-10-18T11:38:13.776538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'791","last_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_deep_scrub":"31'791","last_deep_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.776362+0000","objects_scrubbed":1,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.684568+0000","scrub_duration":0.035930087999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'468","reported_seq":537,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:48.991355+0000","last_change":"2023-10-18T11:38:48.991355+0000","last_active":"2023-10-18T11:38:48.991355+0000","last_peered":"2023-10-18T11:38:48.991355+0000","last_clean":"2023-10-18T11:38:48.991355+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:38:48.991355+0000","last_undegraded":"2023-10-18T11:38:48.991355+0000","last_fullsized":"2023-10-18T11:38:48.991355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'468","last_scrub_stamp":"2023-10-18T11:38:48.990848+0000","last_deep_scrub":"31'468","last_deep_scrub_stamp":"2023-10-18T11:38:48.990848+0000","last_clean_scrub_stamp":"2023-10-18T11:38:48.990848+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:53.651083+0000","scrub_duration":0.0055479769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":9414,"num_write":343,"num_write_kb":17104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'148","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:24.579369+0000","last_change":"2023-10-18T11:38:24.579369+0000","last_active":"2023-10-18T11:38:24.579369+0000","last_peered":"2023-10-18T11:38:24.579369+0000","last_clean":"2023-10-18T11:38:24.579369+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:38:24.579369+0000","last_undegraded":"2023-10-18T11:38:24.579369+0000","last_fullsized":"2023-10-18T11:38:24.579369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-10-18T11:38:24.579245+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-10-18T11:38:24.579245+0000","last_clean_scrub_stamp":"2023-10-18T11:38:24.579245+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:05.999475+0000","scrub_duration":0.00254185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1651","reported_seq":1695,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.284837+0000","last_change":"2023-10-18T11:38:26.284837+0000","last_active":"2023-10-18T11:38:26.284837+0000","last_peered":"2023-10-18T11:38:26.284837+0000","last_clean":"2023-10-18T11:38:26.284837+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:38:26.284837+0000","last_undegraded":"2023-10-18T11:38:26.284837+0000","last_fullsized":"2023-10-18T11:38:26.284837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1651","last_scrub_stamp":"2023-10-18T11:38:26.284633+0000","last_deep_scrub":"31'1651","last_deep_scrub_stamp":"2023-10-18T11:38:26.284633+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.284633+0000","objects_scrubbed":3,"log_size":1651,"log_dups_size":0,"ondisk_log_size":1651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:00.506206+0000","scrub_duration":0.080692793999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1639,"num_write_kb":9112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'412","reported_seq":499,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:09.933648+0000","last_change":"2023-10-18T11:09:46.112138+0000","last_active":"2023-10-18T11:38:09.933648+0000","last_peered":"2023-10-18T11:38:09.933648+0000","last_clean":"2023-10-18T11:38:09.933648+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:38:09.933648+0000","last_undegraded":"2023-10-18T11:38:09.933648+0000","last_fullsized":"2023-10-18T11:38:09.933648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":14478,"num_write":303,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'145","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:36.940989+0000","last_change":"2023-10-18T11:38:36.941113+0000","last_active":"2023-10-18T11:38:36.940989+0000","last_peered":"2023-10-18T11:38:36.940989+0000","last_clean":"2023-10-18T11:38:36.940989+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:38:36.940989+0000","last_undegraded":"2023-10-18T11:38:36.940989+0000","last_fullsized":"2023-10-18T11:38:36.940989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:36.940776+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:36.940776+0000","last_clean_scrub_stamp":"2023-10-18T11:38:36.940776+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:57:35.154973+0000","scrub_duration":0.0037340989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'1267","reported_seq":1768,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.829671+0000","last_change":"2023-10-18T11:38:18.829671+0000","last_active":"2023-10-18T11:38:18.829671+0000","last_peered":"2023-10-18T11:38:18.829671+0000","last_clean":"2023-10-18T11:38:18.829671+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:38:18.829671+0000","last_undegraded":"2023-10-18T11:38:18.829671+0000","last_fullsized":"2023-10-18T11:38:18.829671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1267","last_scrub_stamp":"2023-10-18T11:38:18.829387+0000","last_deep_scrub":"31'1267","last_deep_scrub_stamp":"2023-10-18T11:38:18.829387+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.829387+0000","objects_scrubbed":5,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:33:56.899504+0000","scrub_duration":0.050335492000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4329052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":492,"num_write":1258,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'421","reported_seq":536,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:54.024248+0000","last_change":"2023-10-18T11:38:54.024444+0000","last_active":"2023-10-18T11:38:54.024248+0000","last_peered":"2023-10-18T11:38:54.024248+0000","last_clean":"2023-10-18T11:38:54.024248+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:38:54.024248+0000","last_undegraded":"2023-10-18T11:38:54.024248+0000","last_fullsized":"2023-10-18T11:38:54.024248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'421","last_scrub_stamp":"2023-10-18T11:38:54.024078+0000","last_deep_scrub":"31'421","last_deep_scrub_stamp":"2023-10-18T11:38:54.024078+0000","last_clean_scrub_stamp":"2023-10-18T11:38:54.024078+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:36.911182+0000","scrub_duration":0.0068162250000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":19812,"num_write":327,"num_write_kb":12739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'143","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.055509+0000","last_change":"2023-10-18T11:38:18.055509+0000","last_active":"2023-10-18T11:38:18.055509+0000","last_peered":"2023-10-18T11:38:18.055509+0000","last_clean":"2023-10-18T11:38:18.055509+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:38:18.055509+0000","last_undegraded":"2023-10-18T11:38:18.055509+0000","last_fullsized":"2023-10-18T11:38:18.055509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'143","last_scrub_stamp":"2023-10-18T11:38:18.055229+0000","last_deep_scrub":"31'143","last_deep_scrub_stamp":"2023-10-18T11:38:18.055229+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.055229+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:21.627664+0000","scrub_duration":0.0029786410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'377","reported_seq":421,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.593054+0000","last_change":"2023-10-18T11:38:37.593095+0000","last_active":"2023-10-18T11:38:37.593054+0000","last_peered":"2023-10-18T11:38:37.593054+0000","last_clean":"2023-10-18T11:38:37.593054+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:38:37.593054+0000","last_undegraded":"2023-10-18T11:38:37.593054+0000","last_fullsized":"2023-10-18T11:38:37.593054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'377","last_scrub_stamp":"2023-10-18T11:38:37.592987+0000","last_deep_scrub":"31'377","last_deep_scrub_stamp":"2023-10-18T11:38:37.592987+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.592987+0000","objects_scrubbed":2,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:03:20.703498+0000","scrub_duration":0.020092005999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956517,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'424","reported_seq":525,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:52.127431+0000","last_change":"2023-10-18T11:38:52.127595+0000","last_active":"2023-10-18T11:38:52.127431+0000","last_peered":"2023-10-18T11:38:52.127431+0000","last_clean":"2023-10-18T11:38:52.127431+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:38:52.127431+0000","last_undegraded":"2023-10-18T11:38:52.127431+0000","last_fullsized":"2023-10-18T11:38:52.127431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'424","last_scrub_stamp":"2023-10-18T11:38:52.127271+0000","last_deep_scrub":"31'424","last_deep_scrub_stamp":"2023-10-18T11:38:52.127271+0000","last_clean_scrub_stamp":"2023-10-18T11:38:52.127271+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:47:05.785782+0000","scrub_duration":0.006042141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":329,"num_write_kb":22819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'140","reported_seq":181,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:53.019020+0000","last_change":"2023-10-18T11:38:53.019150+0000","last_active":"2023-10-18T11:38:53.019020+0000","last_peered":"2023-10-18T11:38:53.019020+0000","last_clean":"2023-10-18T11:38:53.019020+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:38:53.019020+0000","last_undegraded":"2023-10-18T11:38:53.019020+0000","last_fullsized":"2023-10-18T11:38:53.019020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'140","last_scrub_stamp":"2023-10-18T11:38:53.018795+0000","last_deep_scrub":"31'140","last_deep_scrub_stamp":"2023-10-18T11:38:53.018795+0000","last_clean_scrub_stamp":"2023-10-18T11:38:53.018795+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:57.679029+0000","scrub_duration":0.0031559790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.202419+0000","last_change":"2023-10-18T11:38:29.202419+0000","last_active":"2023-10-18T11:38:29.202419+0000","last_peered":"2023-10-18T11:38:29.202419+0000","last_clean":"2023-10-18T11:38:29.202419+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:38:29.202419+0000","last_undegraded":"2023-10-18T11:38:29.202419+0000","last_fullsized":"2023-10-18T11:38:29.202419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-10-18T11:38:29.202254+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-10-18T11:38:29.202254+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.202254+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:32.774689+0000","scrub_duration":0.011167610999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":198,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:19.573886+0000","last_change":"2023-10-18T11:38:19.573937+0000","last_active":"2023-10-18T11:38:19.573886+0000","last_peered":"2023-10-18T11:38:19.573886+0000","last_clean":"2023-10-18T11:38:19.573886+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:38:19.573886+0000","last_undegraded":"2023-10-18T11:38:19.573886+0000","last_fullsized":"2023-10-18T11:38:19.573886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-10-18T11:38:19.573815+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-10-18T11:38:19.573815+0000","last_clean_scrub_stamp":"2023-10-18T11:38:19.573815+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:22.392143+0000","scrub_duration":0.0092019140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'526","reported_seq":640,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.526968+0000","last_change":"2023-10-18T11:38:51.527039+0000","last_active":"2023-10-18T11:38:51.526968+0000","last_peered":"2023-10-18T11:38:51.526968+0000","last_clean":"2023-10-18T11:38:51.526968+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:38:51.526968+0000","last_undegraded":"2023-10-18T11:38:51.526968+0000","last_fullsized":"2023-10-18T11:38:51.526968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'526","last_scrub_stamp":"2023-10-18T11:38:51.526893+0000","last_deep_scrub":"31'526","last_deep_scrub_stamp":"2023-10-18T11:38:51.526893+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.526893+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:39:16.674574+0000","scrub_duration":0.003785755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":19822,"num_write":415,"num_write_kb":19524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'153","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.306422+0000","last_change":"2023-10-18T11:09:39.355627+0000","last_active":"2023-10-18T11:38:16.306422+0000","last_peered":"2023-10-18T11:38:16.306422+0000","last_clean":"2023-10-18T11:38:16.306422+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:38:16.306422+0000","last_undegraded":"2023-10-18T11:38:16.306422+0000","last_fullsized":"2023-10-18T11:38:16.306422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'902","reported_seq":945,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.776996+0000","last_change":"2023-10-18T11:38:21.776996+0000","last_active":"2023-10-18T11:38:21.776996+0000","last_peered":"2023-10-18T11:38:21.776996+0000","last_clean":"2023-10-18T11:38:21.776996+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:38:21.776996+0000","last_undegraded":"2023-10-18T11:38:21.776996+0000","last_fullsized":"2023-10-18T11:38:21.776996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'902","last_scrub_stamp":"2023-10-18T11:38:21.776574+0000","last_deep_scrub":"31'902","last_deep_scrub_stamp":"2023-10-18T11:38:21.776574+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.776574+0000","objects_scrubbed":3,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:47:08.842481+0000","scrub_duration":0.042635698999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'411","reported_seq":523,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:00.120634+0000","last_change":"2023-10-18T11:10:10.418740+0000","last_active":"2023-10-18T11:38:00.120634+0000","last_peered":"2023-10-18T11:38:00.120634+0000","last_clean":"2023-10-18T11:38:00.120634+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:38:00.120634+0000","last_undegraded":"2023-10-18T11:38:00.120634+0000","last_fullsized":"2023-10-18T11:38:00.120634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":18796,"num_write":308,"num_write_kb":13390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'137","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:48.136433+0000","last_change":"2023-10-18T11:38:48.136433+0000","last_active":"2023-10-18T11:38:48.136433+0000","last_peered":"2023-10-18T11:38:48.136433+0000","last_clean":"2023-10-18T11:38:48.136433+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:38:48.136433+0000","last_undegraded":"2023-10-18T11:38:48.136433+0000","last_fullsized":"2023-10-18T11:38:48.136433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:48.136304+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:48.136304+0000","last_clean_scrub_stamp":"2023-10-18T11:38:48.136304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:52.796538+0000","scrub_duration":0.002452236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'1294","reported_seq":1337,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.833782+0000","last_change":"2023-10-18T11:38:16.833782+0000","last_active":"2023-10-18T11:38:16.833782+0000","last_peered":"2023-10-18T11:38:16.833782+0000","last_clean":"2023-10-18T11:38:16.833782+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:38:16.833782+0000","last_undegraded":"2023-10-18T11:38:16.833782+0000","last_fullsized":"2023-10-18T11:38:16.833782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1294","last_scrub_stamp":"2023-10-18T11:38:16.833369+0000","last_deep_scrub":"31'1294","last_deep_scrub_stamp":"2023-10-18T11:38:16.833369+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.833369+0000","objects_scrubbed":3,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:19.651697+0000","scrub_duration":0.079856599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7520929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1284,"num_write_kb":8040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'435","reported_seq":557,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.918247+0000","last_change":"2023-10-18T11:38:38.918512+0000","last_active":"2023-10-18T11:38:38.918247+0000","last_peered":"2023-10-18T11:38:38.918247+0000","last_clean":"2023-10-18T11:38:38.918247+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:38:38.918247+0000","last_undegraded":"2023-10-18T11:38:38.918247+0000","last_fullsized":"2023-10-18T11:38:38.918247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'435","last_scrub_stamp":"2023-10-18T11:38:38.918083+0000","last_deep_scrub":"31'435","last_deep_scrub_stamp":"2023-10-18T11:38:38.918083+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.918083+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:43:28.369335+0000","scrub_duration":0.0060519450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":340,"num_write_kb":14424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'136","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.306481+0000","last_change":"2023-10-18T11:09:39.397480+0000","last_active":"2023-10-18T11:38:16.306481+0000","last_peered":"2023-10-18T11:38:16.306481+0000","last_clean":"2023-10-18T11:38:16.306481+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:38:16.306481+0000","last_undegraded":"2023-10-18T11:38:16.306481+0000","last_fullsized":"2023-10-18T11:38:16.306481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'9","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.700844+0000","last_change":"2023-10-18T11:38:23.700844+0000","last_active":"2023-10-18T11:38:23.700844+0000","last_peered":"2023-10-18T11:38:23.700844+0000","last_clean":"2023-10-18T11:38:23.700844+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:38:23.700844+0000","last_undegraded":"2023-10-18T11:38:23.700844+0000","last_fullsized":"2023-10-18T11:38:23.700844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-10-18T11:38:23.700596+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-10-18T11:38:23.700596+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.700596+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:47:43.822850+0000","scrub_duration":0.0075550569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'409","reported_seq":507,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:54.030278+0000","last_change":"2023-10-18T11:38:54.030372+0000","last_active":"2023-10-18T11:38:54.030278+0000","last_peered":"2023-10-18T11:38:54.030278+0000","last_clean":"2023-10-18T11:38:54.030278+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:38:54.030278+0000","last_undegraded":"2023-10-18T11:38:54.030278+0000","last_fullsized":"2023-10-18T11:38:54.030278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'409","last_scrub_stamp":"2023-10-18T11:38:54.030199+0000","last_deep_scrub":"31'409","last_deep_scrub_stamp":"2023-10-18T11:38:54.030199+0000","last_clean_scrub_stamp":"2023-10-18T11:38:54.030199+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:08:11.779372+0000","scrub_duration":0.0025696439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":17064,"num_write":295,"num_write_kb":17834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'136","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.655098+0000","last_change":"2023-10-18T11:38:51.655098+0000","last_active":"2023-10-18T11:38:51.655098+0000","last_peered":"2023-10-18T11:38:51.655098+0000","last_clean":"2023-10-18T11:38:51.655098+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:38:51.655098+0000","last_undegraded":"2023-10-18T11:38:51.655098+0000","last_fullsized":"2023-10-18T11:38:51.655098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'136","last_scrub_stamp":"2023-10-18T11:38:51.654982+0000","last_deep_scrub":"31'136","last_deep_scrub_stamp":"2023-10-18T11:38:51.654982+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.654982+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:26:13.696712+0000","scrub_duration":0.0012451610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'255","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.648486+0000","last_change":"2023-10-18T11:38:13.648486+0000","last_active":"2023-10-18T11:38:13.648486+0000","last_peered":"2023-10-18T11:38:13.648486+0000","last_clean":"2023-10-18T11:38:13.648486+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:38:13.648486+0000","last_undegraded":"2023-10-18T11:38:13.648486+0000","last_fullsized":"2023-10-18T11:38:13.648486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'255","last_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_deep_scrub":"31'255","last_deep_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.648347+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:37.829270+0000","scrub_duration":0.0050540170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'390","reported_seq":467,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.598810+0000","last_change":"2023-10-18T11:38:31.598864+0000","last_active":"2023-10-18T11:38:31.598810+0000","last_peered":"2023-10-18T11:38:31.598810+0000","last_clean":"2023-10-18T11:38:31.598810+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:38:31.598810+0000","last_undegraded":"2023-10-18T11:38:31.598810+0000","last_fullsized":"2023-10-18T11:38:31.598810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'390","last_scrub_stamp":"2023-10-18T11:38:31.598740+0000","last_deep_scrub":"31'390","last_deep_scrub_stamp":"2023-10-18T11:38:31.598740+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.598740+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:35.171175+0000","scrub_duration":0.0040497909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":302,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'129","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:45.651434+0000","last_change":"2023-10-18T11:38:45.651499+0000","last_active":"2023-10-18T11:38:45.651434+0000","last_peered":"2023-10-18T11:38:45.651434+0000","last_clean":"2023-10-18T11:38:45.651434+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:38:45.651434+0000","last_undegraded":"2023-10-18T11:38:45.651434+0000","last_fullsized":"2023-10-18T11:38:45.651434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2023-10-18T11:38:45.651347+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2023-10-18T11:38:45.651347+0000","last_clean_scrub_stamp":"2023-10-18T11:38:45.651347+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:50.603822+0000","scrub_duration":0.0013624469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'1801","reported_seq":1843,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.945745+0000","last_change":"2023-10-18T11:38:16.945923+0000","last_active":"2023-10-18T11:38:16.945745+0000","last_peered":"2023-10-18T11:38:16.945745+0000","last_clean":"2023-10-18T11:38:16.945745+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:38:16.945745+0000","last_undegraded":"2023-10-18T11:38:16.945745+0000","last_fullsized":"2023-10-18T11:38:16.945745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1801","last_scrub_stamp":"2023-10-18T11:38:16.945606+0000","last_deep_scrub":"31'1801","last_deep_scrub_stamp":"2023-10-18T11:38:16.945606+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.945606+0000","objects_scrubbed":10,"log_size":1801,"log_dups_size":0,"ondisk_log_size":1801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:06:47.403273+0000","scrub_duration":0.099502073999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":9197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'468","reported_seq":552,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:08.871816+0000","last_change":"2023-10-18T11:09:46.106739+0000","last_active":"2023-10-18T11:38:08.871816+0000","last_peered":"2023-10-18T11:38:08.871816+0000","last_clean":"2023-10-18T11:38:08.871816+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:38:08.871816+0000","last_undegraded":"2023-10-18T11:38:08.871816+0000","last_fullsized":"2023-10-18T11:38:08.871816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":372,"num_write_kb":11119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'118","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:27.563554+0000","last_change":"2023-10-18T11:38:27.563591+0000","last_active":"2023-10-18T11:38:27.563554+0000","last_peered":"2023-10-18T11:38:27.563554+0000","last_clean":"2023-10-18T11:38:27.563554+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:38:27.563554+0000","last_undegraded":"2023-10-18T11:38:27.563554+0000","last_fullsized":"2023-10-18T11:38:27.563554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'118","last_scrub_stamp":"2023-10-18T11:38:27.563488+0000","last_deep_scrub":"31'118","last_deep_scrub_stamp":"2023-10-18T11:38:27.563488+0000","last_clean_scrub_stamp":"2023-10-18T11:38:27.563488+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:31:20.292085+0000","scrub_duration":0.0024232849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'912","reported_seq":954,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.721666+0000","last_change":"2023-10-18T11:38:15.721730+0000","last_active":"2023-10-18T11:38:15.721666+0000","last_peered":"2023-10-18T11:38:15.721666+0000","last_clean":"2023-10-18T11:38:15.721666+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:38:15.721666+0000","last_undegraded":"2023-10-18T11:38:15.721666+0000","last_fullsized":"2023-10-18T11:38:15.721666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'912","last_scrub_stamp":"2023-10-18T11:38:15.721600+0000","last_deep_scrub":"31'912","last_deep_scrub_stamp":"2023-10-18T11:38:15.721600+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.721600+0000","objects_scrubbed":3,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:47:35.843854+0000","scrub_duration":0.019590776000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'408","reported_seq":479,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.115417+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:38:12.115417+0000","last_peered":"2023-10-18T11:38:12.115417+0000","last_clean":"2023-10-18T11:38:12.115417+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:38:12.115417+0000","last_undegraded":"2023-10-18T11:38:12.115417+0000","last_fullsized":"2023-10-18T11:38:12.115417+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":10922,"num_write":302,"num_write_kb":9791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.639879+0000","last_change":"2023-10-18T11:38:16.639919+0000","last_active":"2023-10-18T11:38:16.639879+0000","last_peered":"2023-10-18T11:38:16.639879+0000","last_clean":"2023-10-18T11:38:16.639879+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:38:16.639879+0000","last_undegraded":"2023-10-18T11:38:16.639879+0000","last_fullsized":"2023-10-18T11:38:16.639879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:16.639807+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:16.639807+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.639807+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:32.548013+0000","scrub_duration":0.00137429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'1004","reported_seq":1046,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.374765+0000","last_change":"2023-10-18T11:38:14.374816+0000","last_active":"2023-10-18T11:38:14.374765+0000","last_peered":"2023-10-18T11:38:14.374765+0000","last_clean":"2023-10-18T11:38:14.374765+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:38:14.374765+0000","last_undegraded":"2023-10-18T11:38:14.374765+0000","last_fullsized":"2023-10-18T11:38:14.374765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1004","last_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_deep_scrub":"31'1004","last_deep_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.374705+0000","objects_scrubbed":4,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:02:58.873481+0000","scrub_duration":0.027697919000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":4702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'374","reported_seq":448,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415991+0000","last_change":"2023-10-18T11:09:46.110368+0000","last_active":"2023-10-18T11:37:46.415991+0000","last_peered":"2023-10-18T11:37:46.415991+0000","last_clean":"2023-10-18T11:37:46.415991+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:37:46.415991+0000","last_undegraded":"2023-10-18T11:37:46.415991+0000","last_fullsized":"2023-10-18T11:37:46.415991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":12454,"num_write":279,"num_write_kb":12302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.988607+0000","last_change":"2023-10-18T11:38:12.988796+0000","last_active":"2023-10-18T11:38:12.988607+0000","last_peered":"2023-10-18T11:38:12.988607+0000","last_clean":"2023-10-18T11:38:12.988607+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:38:12.988607+0000","last_undegraded":"2023-10-18T11:38:12.988607+0000","last_fullsized":"2023-10-18T11:38:12.988607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.988423+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:04.605203+0000","scrub_duration":0.002583765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'410","reported_seq":843,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:10.019288+0000","last_change":"2023-10-18T11:38:10.019370+0000","last_active":"2023-10-18T11:38:10.019288+0000","last_peered":"2023-10-18T11:38:10.019288+0000","last_clean":"2023-10-18T11:38:10.019288+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:38:10.019288+0000","last_undegraded":"2023-10-18T11:38:10.019288+0000","last_fullsized":"2023-10-18T11:38:10.019288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'410","last_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_deep_scrub":"31'410","last_deep_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_clean_scrub_stamp":"2023-10-18T11:38:10.019192+0000","objects_scrubbed":7,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:01:36.193379+0000","scrub_duration":0.0084515079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":443,"num_write":404,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'508","reported_seq":647,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:55.010298+0000","last_change":"2023-10-18T11:38:55.010367+0000","last_active":"2023-10-18T11:38:55.010298+0000","last_peered":"2023-10-18T11:38:55.010298+0000","last_clean":"2023-10-18T11:38:55.010298+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:38:55.010298+0000","last_undegraded":"2023-10-18T11:38:55.010298+0000","last_fullsized":"2023-10-18T11:38:55.010298+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'508","last_scrub_stamp":"2023-10-18T11:38:55.010215+0000","last_deep_scrub":"31'508","last_deep_scrub_stamp":"2023-10-18T11:38:55.010215+0000","last_clean_scrub_stamp":"2023-10-18T11:38:55.010215+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:41:31.346583+0000","scrub_duration":0.0039544630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":22458,"num_write":413,"num_write_kb":26305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'141","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:46.611066+0000","last_change":"2023-10-18T11:38:46.611114+0000","last_active":"2023-10-18T11:38:46.611066+0000","last_peered":"2023-10-18T11:38:46.611066+0000","last_clean":"2023-10-18T11:38:46.611066+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:38:46.611066+0000","last_undegraded":"2023-10-18T11:38:46.611066+0000","last_fullsized":"2023-10-18T11:38:46.611066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2023-10-18T11:38:46.610979+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2023-10-18T11:38:46.610979+0000","last_clean_scrub_stamp":"2023-10-18T11:38:46.610979+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:43:36.062230+0000","scrub_duration":0.0027168240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1129","reported_seq":1171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.788264+0000","last_change":"2023-10-18T11:38:17.788313+0000","last_active":"2023-10-18T11:38:17.788264+0000","last_peered":"2023-10-18T11:38:17.788264+0000","last_clean":"2023-10-18T11:38:17.788264+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:38:17.788264+0000","last_undegraded":"2023-10-18T11:38:17.788264+0000","last_fullsized":"2023-10-18T11:38:17.788264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1129","last_scrub_stamp":"2023-10-18T11:38:17.788204+0000","last_deep_scrub":"31'1129","last_deep_scrub_stamp":"2023-10-18T11:38:17.788204+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.788204+0000","objects_scrubbed":6,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:02.286980+0000","scrub_duration":0.060761811999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'423","reported_seq":510,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.967827+0000","last_change":"2023-10-18T11:38:51.968035+0000","last_active":"2023-10-18T11:38:51.967827+0000","last_peered":"2023-10-18T11:38:51.967827+0000","last_clean":"2023-10-18T11:38:51.967827+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:38:51.967827+0000","last_undegraded":"2023-10-18T11:38:51.967827+0000","last_fullsized":"2023-10-18T11:38:51.967827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'423","last_scrub_stamp":"2023-10-18T11:38:51.967647+0000","last_deep_scrub":"31'423","last_deep_scrub_stamp":"2023-10-18T11:38:51.967647+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.967647+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:14:42.768322+0000","scrub_duration":0.0062849749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":12954,"num_write":319,"num_write_kb":22076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'121","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.567855+0000","last_change":"2023-10-18T11:38:17.567915+0000","last_active":"2023-10-18T11:38:17.567855+0000","last_peered":"2023-10-18T11:38:17.567855+0000","last_clean":"2023-10-18T11:38:17.567855+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:38:17.567855+0000","last_undegraded":"2023-10-18T11:38:17.567855+0000","last_fullsized":"2023-10-18T11:38:17.567855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'121","last_scrub_stamp":"2023-10-18T11:38:17.567782+0000","last_deep_scrub":"31'121","last_deep_scrub_stamp":"2023-10-18T11:38:17.567782+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.567782+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:02.066559+0000","scrub_duration":0.001187249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'283","reported_seq":325,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.826508+0000","last_change":"2023-10-18T11:38:18.826508+0000","last_active":"2023-10-18T11:38:18.826508+0000","last_peered":"2023-10-18T11:38:18.826508+0000","last_clean":"2023-10-18T11:38:18.826508+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:38:18.826508+0000","last_undegraded":"2023-10-18T11:38:18.826508+0000","last_fullsized":"2023-10-18T11:38:18.826508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'283","last_scrub_stamp":"2023-10-18T11:38:18.826303+0000","last_deep_scrub":"31'283","last_deep_scrub_stamp":"2023-10-18T11:38:18.826303+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.826303+0000","objects_scrubbed":4,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:48.054916+0000","scrub_duration":0.0084837070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'511","reported_seq":609,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:41.657046+0000","last_change":"2023-10-18T11:38:41.657141+0000","last_active":"2023-10-18T11:38:41.657046+0000","last_peered":"2023-10-18T11:38:41.657046+0000","last_clean":"2023-10-18T11:38:41.657046+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:38:41.657046+0000","last_undegraded":"2023-10-18T11:38:41.657046+0000","last_fullsized":"2023-10-18T11:38:41.657046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'511","last_scrub_stamp":"2023-10-18T11:38:41.656966+0000","last_deep_scrub":"31'511","last_deep_scrub_stamp":"2023-10-18T11:38:41.656966+0000","last_clean_scrub_stamp":"2023-10-18T11:38:41.656966+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:55:11.280208+0000","scrub_duration":0.0028387489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":22028,"num_write":389,"num_write_kb":39504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.935436+0000","last_change":"2023-10-18T11:38:32.935436+0000","last_active":"2023-10-18T11:38:32.935436+0000","last_peered":"2023-10-18T11:38:32.935436+0000","last_clean":"2023-10-18T11:38:32.935436+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:38:32.935436+0000","last_undegraded":"2023-10-18T11:38:32.935436+0000","last_fullsized":"2023-10-18T11:38:32.935436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:32.935169+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:32.935169+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.935169+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:09.549069+0000","scrub_duration":0.0036182440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'403","reported_seq":835,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.336342+0000","last_change":"2023-10-18T11:38:15.336342+0000","last_active":"2023-10-18T11:38:15.336342+0000","last_peered":"2023-10-18T11:38:15.336342+0000","last_clean":"2023-10-18T11:38:15.336342+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:38:15.336342+0000","last_undegraded":"2023-10-18T11:38:15.336342+0000","last_fullsized":"2023-10-18T11:38:15.336342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'403","last_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_deep_scrub":"31'403","last_deep_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.336169+0000","objects_scrubbed":3,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:31.244376+0000","scrub_duration":0.0066715740000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180134,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":390,"num_read_kb":469,"num_write":396,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'442","reported_seq":538,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415763+0000","last_change":"2023-10-18T11:09:46.106676+0000","last_active":"2023-10-18T11:37:46.415763+0000","last_peered":"2023-10-18T11:37:46.415763+0000","last_clean":"2023-10-18T11:37:46.415763+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:37:46.415763+0000","last_undegraded":"2023-10-18T11:37:46.415763+0000","last_fullsized":"2023-10-18T11:37:46.415763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17404,"num_write":347,"num_write_kb":27808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.029902+0000","last_change":"2023-10-18T11:38:51.029976+0000","last_active":"2023-10-18T11:38:51.029902+0000","last_peered":"2023-10-18T11:38:51.029902+0000","last_clean":"2023-10-18T11:38:51.029902+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:38:51.029902+0000","last_undegraded":"2023-10-18T11:38:51.029902+0000","last_fullsized":"2023-10-18T11:38:51.029902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:51.029809+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:51.029809+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.029809+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:33.916912+0000","scrub_duration":0.0016098009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'189","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:22.612412+0000","last_change":"2023-10-18T11:38:22.612412+0000","last_active":"2023-10-18T11:38:22.612412+0000","last_peered":"2023-10-18T11:38:22.612412+0000","last_clean":"2023-10-18T11:38:22.612412+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:38:22.612412+0000","last_undegraded":"2023-10-18T11:38:22.612412+0000","last_fullsized":"2023-10-18T11:38:22.612412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'189","last_scrub_stamp":"2023-10-18T11:38:22.612315+0000","last_deep_scrub":"31'189","last_deep_scrub_stamp":"2023-10-18T11:38:22.612315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:22.612315+0000","objects_scrubbed":3,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:22:08.752776+0000","scrub_duration":0.0028915519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'380","reported_seq":474,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:46.415877+0000","last_change":"2023-10-18T11:09:46.107005+0000","last_active":"2023-10-18T11:37:46.415877+0000","last_peered":"2023-10-18T11:37:46.415877+0000","last_clean":"2023-10-18T11:37:46.415877+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:37:46.415877+0000","last_undegraded":"2023-10-18T11:37:46.415877+0000","last_fullsized":"2023-10-18T11:37:46.415877+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":277,"num_write_kb":11173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'503","reported_seq":586,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:51.201918+0000","last_change":"2023-10-18T11:10:10.417214+0000","last_active":"2023-10-18T11:37:51.201918+0000","last_peered":"2023-10-18T11:37:51.201918+0000","last_clean":"2023-10-18T11:37:51.201918+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:37:51.201918+0000","last_undegraded":"2023-10-18T11:37:51.201918+0000","last_fullsized":"2023-10-18T11:37:51.201918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":392,"num_write_kb":15493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'157","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.000066+0000","last_change":"2023-10-18T11:38:32.000066+0000","last_active":"2023-10-18T11:38:32.000066+0000","last_peered":"2023-10-18T11:38:32.000066+0000","last_clean":"2023-10-18T11:38:32.000066+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:38:32.000066+0000","last_undegraded":"2023-10-18T11:38:32.000066+0000","last_fullsized":"2023-10-18T11:38:32.000066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'157","last_scrub_stamp":"2023-10-18T11:38:31.999671+0000","last_deep_scrub":"31'157","last_deep_scrub_stamp":"2023-10-18T11:38:31.999671+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.999671+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:06.032945+0000","scrub_duration":0.0041825050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'1037","reported_seq":1079,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.385086+0000","last_change":"2023-10-18T11:38:20.385086+0000","last_active":"2023-10-18T11:38:20.385086+0000","last_peered":"2023-10-18T11:38:20.385086+0000","last_clean":"2023-10-18T11:38:20.385086+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:38:20.385086+0000","last_undegraded":"2023-10-18T11:38:20.385086+0000","last_fullsized":"2023-10-18T11:38:20.385086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1037","last_scrub_stamp":"2023-10-18T11:38:20.384953+0000","last_deep_scrub":"31'1037","last_deep_scrub_stamp":"2023-10-18T11:38:20.384953+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.384953+0000","objects_scrubbed":3,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:12.001733+0000","scrub_duration":0.020741213000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":6522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'495","reported_seq":601,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:07.705169+0000","last_change":"2023-10-18T11:09:46.095392+0000","last_active":"2023-10-18T11:37:07.705169+0000","last_peered":"2023-10-18T11:37:07.705169+0000","last_clean":"2023-10-18T11:37:07.705169+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:37:07.705169+0000","last_undegraded":"2023-10-18T11:37:07.705169+0000","last_fullsized":"2023-10-18T11:37:07.705169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":22638,"num_write":397,"num_write_kb":22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'163","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.936414+0000","last_change":"2023-10-18T11:38:17.936414+0000","last_active":"2023-10-18T11:38:17.936414+0000","last_peered":"2023-10-18T11:38:17.936414+0000","last_clean":"2023-10-18T11:38:17.936414+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:38:17.936414+0000","last_undegraded":"2023-10-18T11:38:17.936414+0000","last_fullsized":"2023-10-18T11:38:17.936414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-10-18T11:38:17.936124+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-10-18T11:38:17.936124+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.936124+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:47.164737+0000","scrub_duration":0.0040074359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'475","reported_seq":981,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.113430+0000","last_change":"2023-10-18T11:38:26.113430+0000","last_active":"2023-10-18T11:38:26.113430+0000","last_peered":"2023-10-18T11:38:26.113430+0000","last_clean":"2023-10-18T11:38:26.113430+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:38:26.113430+0000","last_undegraded":"2023-10-18T11:38:26.113430+0000","last_fullsized":"2023-10-18T11:38:26.113430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'475","last_scrub_stamp":"2023-10-18T11:38:26.113149+0000","last_deep_scrub":"31'475","last_deep_scrub_stamp":"2023-10-18T11:38:26.113149+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.113149+0000","objects_scrubbed":3,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:11.928277+0000","scrub_duration":0.010428636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":464,"num_read_kb":507,"num_write":469,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'1262","reported_seq":1772,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.769789+0000","last_change":"2023-10-18T11:38:16.769841+0000","last_active":"2023-10-18T11:38:16.769789+0000","last_peered":"2023-10-18T11:38:16.769789+0000","last_clean":"2023-10-18T11:38:16.769789+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:38:16.769789+0000","last_undegraded":"2023-10-18T11:38:16.769789+0000","last_fullsized":"2023-10-18T11:38:16.769789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1262","last_scrub_stamp":"2023-10-18T11:38:16.769713+0000","last_deep_scrub":"31'1262","last_deep_scrub_stamp":"2023-10-18T11:38:16.769713+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.769713+0000","objects_scrubbed":5,"log_size":1262,"log_dups_size":0,"ondisk_log_size":1262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:46:57.406757+0000","scrub_duration":0.022924356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4346422,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":505,"num_write":1257,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'154","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:09.051185+0000","last_change":"2023-10-18T11:38:09.051296+0000","last_active":"2023-10-18T11:38:09.051185+0000","last_peered":"2023-10-18T11:38:09.051185+0000","last_clean":"2023-10-18T11:38:09.051185+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:38:09.051185+0000","last_undegraded":"2023-10-18T11:38:09.051185+0000","last_fullsized":"2023-10-18T11:38:09.051185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_clean_scrub_stamp":"2023-10-18T11:38:09.051022+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:26.016569+0000","scrub_duration":0.003629073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'380","reported_seq":485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.730424+0000","last_change":"2023-10-18T11:38:32.730605+0000","last_active":"2023-10-18T11:38:32.730424+0000","last_peered":"2023-10-18T11:38:32.730424+0000","last_clean":"2023-10-18T11:38:32.730424+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:38:32.730424+0000","last_undegraded":"2023-10-18T11:38:32.730424+0000","last_fullsized":"2023-10-18T11:38:32.730424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'380","last_scrub_stamp":"2023-10-18T11:38:32.730250+0000","last_deep_scrub":"31'380","last_deep_scrub_stamp":"2023-10-18T11:38:32.730250+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.730250+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:14.150480+0000","scrub_duration":0.0065888780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":9856,"num_write":276,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2737","reported_seq":2778,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.081157+0000","last_change":"2023-10-18T11:38:20.081285+0000","last_active":"2023-10-18T11:38:20.081157+0000","last_peered":"2023-10-18T11:38:20.081157+0000","last_clean":"2023-10-18T11:38:20.081157+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:38:20.081157+0000","last_undegraded":"2023-10-18T11:38:20.081157+0000","last_fullsized":"2023-10-18T11:38:20.081157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2737","last_scrub_stamp":"2023-10-18T11:38:20.080991+0000","last_deep_scrub":"31'2737","last_deep_scrub_stamp":"2023-10-18T11:38:20.080991+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.080991+0000","objects_scrubbed":4,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:23.653427+0000","scrub_duration":0.118224197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2726,"num_write_kb":13571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'169","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.602939+0000","last_change":"2023-10-18T11:38:15.602980+0000","last_active":"2023-10-18T11:38:15.602939+0000","last_peered":"2023-10-18T11:38:15.602939+0000","last_clean":"2023-10-18T11:38:15.602939+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:38:15.602939+0000","last_undegraded":"2023-10-18T11:38:15.602939+0000","last_fullsized":"2023-10-18T11:38:15.602939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'169","last_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_deep_scrub":"31'169","last_deep_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.602878+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:15:22.593515+0000","scrub_duration":0.0020891960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'415","reported_seq":491,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.410397+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:37:16.410397+0000","last_peered":"2023-10-18T11:37:16.410397+0000","last_clean":"2023-10-18T11:37:16.410397+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:37:16.410397+0000","last_undegraded":"2023-10-18T11:37:16.410397+0000","last_fullsized":"2023-10-18T11:37:16.410397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":317,"num_write_kb":9906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'168","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:43.499206+0000","last_change":"2023-10-18T11:38:43.499206+0000","last_active":"2023-10-18T11:38:43.499206+0000","last_peered":"2023-10-18T11:38:43.499206+0000","last_clean":"2023-10-18T11:38:43.499206+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:38:43.499206+0000","last_undegraded":"2023-10-18T11:38:43.499206+0000","last_fullsized":"2023-10-18T11:38:43.499206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'168","last_scrub_stamp":"2023-10-18T11:38:43.499098+0000","last_deep_scrub":"31'168","last_deep_scrub_stamp":"2023-10-18T11:38:43.499098+0000","last_clean_scrub_stamp":"2023-10-18T11:38:43.499098+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:48.451573+0000","scrub_duration":0.002558608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'156","reported_seq":197,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:25.678385+0000","last_change":"2023-10-18T11:38:25.678385+0000","last_active":"2023-10-18T11:38:25.678385+0000","last_peered":"2023-10-18T11:38:25.678385+0000","last_clean":"2023-10-18T11:38:25.678385+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:38:25.678385+0000","last_undegraded":"2023-10-18T11:38:25.678385+0000","last_fullsized":"2023-10-18T11:38:25.678385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2023-10-18T11:38:25.677969+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2023-10-18T11:38:25.677969+0000","last_clean_scrub_stamp":"2023-10-18T11:38:25.677969+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:47:06.315013+0000","scrub_duration":0.0040068400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'163","reported_seq":195,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:36.692331+0000","last_change":"2023-10-18T11:38:36.692445+0000","last_active":"2023-10-18T11:38:36.692331+0000","last_peered":"2023-10-18T11:38:36.692331+0000","last_clean":"2023-10-18T11:38:36.692331+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:38:36.692331+0000","last_undegraded":"2023-10-18T11:38:36.692331+0000","last_fullsized":"2023-10-18T11:38:36.692331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-10-18T11:38:36.692173+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-10-18T11:38:36.692173+0000","last_clean_scrub_stamp":"2023-10-18T11:38:36.692173+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:39.510500+0000","scrub_duration":0.0037755890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"31'146","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.084653+0000","last_change":"2023-10-18T11:38:16.084653+0000","last_active":"2023-10-18T11:38:16.084653+0000","last_peered":"2023-10-18T11:38:16.084653+0000","last_clean":"2023-10-18T11:38:16.084653+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:38:16.084653+0000","last_undegraded":"2023-10-18T11:38:16.084653+0000","last_fullsized":"2023-10-18T11:38:16.084653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.084368+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:45.312981+0000","scrub_duration":0.0039813269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'131","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.024992+0000","last_change":"2023-10-18T11:09:39.424605+0000","last_active":"2023-10-18T11:38:03.024992+0000","last_peered":"2023-10-18T11:38:03.024992+0000","last_clean":"2023-10-18T11:38:03.024992+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:38:03.024992+0000","last_undegraded":"2023-10-18T11:38:03.024992+0000","last_fullsized":"2023-10-18T11:38:03.024992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'151","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.950545+0000","last_change":"2023-10-18T11:38:38.950670+0000","last_active":"2023-10-18T11:38:38.950545+0000","last_peered":"2023-10-18T11:38:38.950545+0000","last_clean":"2023-10-18T11:38:38.950545+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:38:38.950545+0000","last_undegraded":"2023-10-18T11:38:38.950545+0000","last_fullsized":"2023-10-18T11:38:38.950545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'151","last_scrub_stamp":"2023-10-18T11:38:38.950368+0000","last_deep_scrub":"31'151","last_deep_scrub_stamp":"2023-10-18T11:38:38.950368+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.950368+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:57.286818+0000","scrub_duration":0.0045621400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'152","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:24.563866+0000","last_change":"2023-10-18T11:38:24.563908+0000","last_active":"2023-10-18T11:38:24.563866+0000","last_peered":"2023-10-18T11:38:24.563866+0000","last_clean":"2023-10-18T11:38:24.563866+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:38:24.563866+0000","last_undegraded":"2023-10-18T11:38:24.563866+0000","last_fullsized":"2023-10-18T11:38:24.563866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'152","last_scrub_stamp":"2023-10-18T11:38:24.563782+0000","last_deep_scrub":"31'152","last_deep_scrub_stamp":"2023-10-18T11:38:24.563782+0000","last_clean_scrub_stamp":"2023-10-18T11:38:24.563782+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:53.792395+0000","scrub_duration":0.001529683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'128","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.052206+0000","last_change":"2023-10-18T11:09:39.421454+0000","last_active":"2023-10-18T11:38:03.052206+0000","last_peered":"2023-10-18T11:38:03.052206+0000","last_clean":"2023-10-18T11:38:03.052206+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:38:03.052206+0000","last_undegraded":"2023-10-18T11:38:03.052206+0000","last_fullsized":"2023-10-18T11:38:03.052206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'145","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:34.309838+0000","last_change":"2023-10-18T11:38:34.309877+0000","last_active":"2023-10-18T11:38:34.309838+0000","last_peered":"2023-10-18T11:38:34.309838+0000","last_clean":"2023-10-18T11:38:34.309838+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:38:34.309838+0000","last_undegraded":"2023-10-18T11:38:34.309838+0000","last_fullsized":"2023-10-18T11:38:34.309838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:34.309736+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:34.309736+0000","last_clean_scrub_stamp":"2023-10-18T11:38:34.309736+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:20.124864+0000","scrub_duration":0.0026226790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'162","reported_seq":194,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.115038+0000","last_change":"2023-10-18T11:09:39.421024+0000","last_active":"2023-10-18T11:38:12.115038+0000","last_peered":"2023-10-18T11:38:12.115038+0000","last_clean":"2023-10-18T11:38:12.115038+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:38:12.115038+0000","last_undegraded":"2023-10-18T11:38:12.115038+0000","last_fullsized":"2023-10-18T11:38:12.115038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'149","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.215456+0000","last_change":"2023-10-18T11:38:32.215456+0000","last_active":"2023-10-18T11:38:32.215456+0000","last_peered":"2023-10-18T11:38:32.215456+0000","last_clean":"2023-10-18T11:38:32.215456+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:38:32.215456+0000","last_undegraded":"2023-10-18T11:38:32.215456+0000","last_fullsized":"2023-10-18T11:38:32.215456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'149","last_scrub_stamp":"2023-10-18T11:38:32.215344+0000","last_deep_scrub":"31'149","last_deep_scrub_stamp":"2023-10-18T11:38:32.215344+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.215344+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:46.370051+0000","scrub_duration":0.0012886499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'153","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:25.111474+0000","last_change":"2023-10-18T11:38:25.111474+0000","last_active":"2023-10-18T11:38:25.111474+0000","last_peered":"2023-10-18T11:38:25.111474+0000","last_clean":"2023-10-18T11:38:25.111474+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:38:25.111474+0000","last_undegraded":"2023-10-18T11:38:25.111474+0000","last_fullsized":"2023-10-18T11:38:25.111474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:25.111222+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:25.111222+0000","last_clean_scrub_stamp":"2023-10-18T11:38:25.111222+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:30.151595+0000","scrub_duration":0.0029533910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'152","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.587609+0000","last_change":"2023-10-18T11:38:23.587609+0000","last_active":"2023-10-18T11:38:23.587609+0000","last_peered":"2023-10-18T11:38:23.587609+0000","last_clean":"2023-10-18T11:38:23.587609+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:38:23.587609+0000","last_undegraded":"2023-10-18T11:38:23.587609+0000","last_fullsized":"2023-10-18T11:38:23.587609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'152","last_scrub_stamp":"2023-10-18T11:38:23.587505+0000","last_deep_scrub":"31'152","last_deep_scrub_stamp":"2023-10-18T11:38:23.587505+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.587505+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:26.405832+0000","scrub_duration":0.0012722530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'153","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.306511+0000","last_change":"2023-10-18T11:09:39.355219+0000","last_active":"2023-10-18T11:38:16.306511+0000","last_peered":"2023-10-18T11:38:16.306511+0000","last_clean":"2023-10-18T11:38:16.306511+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:38:16.306511+0000","last_undegraded":"2023-10-18T11:38:16.306511+0000","last_fullsized":"2023-10-18T11:38:16.306511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'167","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.660058+0000","last_change":"2023-10-18T11:38:26.660178+0000","last_active":"2023-10-18T11:38:26.660058+0000","last_peered":"2023-10-18T11:38:26.660058+0000","last_clean":"2023-10-18T11:38:26.660058+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:38:26.660058+0000","last_undegraded":"2023-10-18T11:38:26.660058+0000","last_fullsized":"2023-10-18T11:38:26.660058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-10-18T11:38:26.659882+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-10-18T11:38:26.659882+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.659882+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:11.158659+0000","scrub_duration":0.0030154539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'146","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:41.580265+0000","last_change":"2023-10-18T11:38:41.580389+0000","last_active":"2023-10-18T11:38:41.580265+0000","last_peered":"2023-10-18T11:38:41.580265+0000","last_clean":"2023-10-18T11:38:41.580265+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:38:41.580265+0000","last_undegraded":"2023-10-18T11:38:41.580265+0000","last_fullsized":"2023-10-18T11:38:41.580265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:41.580103+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:41.580103+0000","last_clean_scrub_stamp":"2023-10-18T11:38:41.580103+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:23:36.795823+0000","scrub_duration":0.003715356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'144","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:45.218022+0000","last_change":"2023-10-18T11:38:45.218066+0000","last_active":"2023-10-18T11:38:45.218022+0000","last_peered":"2023-10-18T11:38:45.218022+0000","last_clean":"2023-10-18T11:38:45.218022+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:38:45.218022+0000","last_undegraded":"2023-10-18T11:38:45.218022+0000","last_fullsized":"2023-10-18T11:38:45.218022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2023-10-18T11:38:45.217957+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2023-10-18T11:38:45.217957+0000","last_clean_scrub_stamp":"2023-10-18T11:38:45.217957+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:50.170432+0000","scrub_duration":0.0024820129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:41.956635+0000","last_change":"2023-10-18T11:38:41.956833+0000","last_active":"2023-10-18T11:38:41.956635+0000","last_peered":"2023-10-18T11:38:41.956635+0000","last_clean":"2023-10-18T11:38:41.956635+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:38:41.956635+0000","last_undegraded":"2023-10-18T11:38:41.956635+0000","last_fullsized":"2023-10-18T11:38:41.956635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:41.956444+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:41.956444+0000","last_clean_scrub_stamp":"2023-10-18T11:38:41.956444+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:15:40.929938+0000","scrub_duration":0.003296551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'135","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.107478+0000","last_change":"2023-10-18T11:38:20.107589+0000","last_active":"2023-10-18T11:38:20.107478+0000","last_peered":"2023-10-18T11:38:20.107478+0000","last_clean":"2023-10-18T11:38:20.107478+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:38:20.107478+0000","last_undegraded":"2023-10-18T11:38:20.107478+0000","last_fullsized":"2023-10-18T11:38:20.107478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2023-10-18T11:38:20.107315+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2023-10-18T11:38:20.107315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.107315+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:23:15.323035+0000","scrub_duration":0.004575244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'173","reported_seq":195,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:03.072979+0000","last_change":"2023-10-18T11:10:10.413087+0000","last_active":"2023-10-18T11:38:03.072979+0000","last_peered":"2023-10-18T11:38:03.072979+0000","last_clean":"2023-10-18T11:38:03.072979+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:38:03.072979+0000","last_undegraded":"2023-10-18T11:38:03.072979+0000","last_fullsized":"2023-10-18T11:38:03.072979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'137","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.600525+0000","last_change":"2023-10-18T11:38:29.600525+0000","last_active":"2023-10-18T11:38:29.600525+0000","last_peered":"2023-10-18T11:38:29.600525+0000","last_clean":"2023-10-18T11:38:29.600525+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:38:29.600525+0000","last_undegraded":"2023-10-18T11:38:29.600525+0000","last_fullsized":"2023-10-18T11:38:29.600525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:29.600430+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:29.600430+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.600430+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:12:23.713131+0000","scrub_duration":0.0012082449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.453393+0000","last_change":"2023-10-18T11:38:37.453393+0000","last_active":"2023-10-18T11:38:37.453393+0000","last_peered":"2023-10-18T11:38:37.453393+0000","last_clean":"2023-10-18T11:38:37.453393+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:38:37.453393+0000","last_undegraded":"2023-10-18T11:38:37.453393+0000","last_fullsized":"2023-10-18T11:38:37.453393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:37.453285+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:37.453285+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.453285+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:11.486559+0000","scrub_duration":0.0016972199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'147","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.494852+0000","last_change":"2023-10-18T11:38:38.494852+0000","last_active":"2023-10-18T11:38:38.494852+0000","last_peered":"2023-10-18T11:38:38.494852+0000","last_clean":"2023-10-18T11:38:38.494852+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:38:38.494852+0000","last_undegraded":"2023-10-18T11:38:38.494852+0000","last_fullsized":"2023-10-18T11:38:38.494852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'147","last_scrub_stamp":"2023-10-18T11:38:38.494746+0000","last_deep_scrub":"31'147","last_deep_scrub_stamp":"2023-10-18T11:38:38.494746+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.494746+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:55:08.117988+0000","scrub_duration":0.001373895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'145","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.306504+0000","last_change":"2023-10-18T11:09:39.355286+0000","last_active":"2023-10-18T11:38:16.306504+0000","last_peered":"2023-10-18T11:38:16.306504+0000","last_clean":"2023-10-18T11:38:16.306504+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:38:16.306504+0000","last_undegraded":"2023-10-18T11:38:16.306504+0000","last_fullsized":"2023-10-18T11:38:16.306504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'150","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.945550+0000","last_change":"2023-10-18T11:38:13.945663+0000","last_active":"2023-10-18T11:38:13.945550+0000","last_peered":"2023-10-18T11:38:13.945550+0000","last_clean":"2023-10-18T11:38:13.945550+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:38:13.945550+0000","last_undegraded":"2023-10-18T11:38:13.945550+0000","last_fullsized":"2023-10-18T11:38:13.945550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.945379+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.853585+0000","scrub_duration":0.0032551009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'134","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:54.714104+0000","last_change":"2023-10-18T11:38:54.714158+0000","last_active":"2023-10-18T11:38:54.714104+0000","last_peered":"2023-10-18T11:38:54.714104+0000","last_clean":"2023-10-18T11:38:54.714104+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:38:54.714104+0000","last_undegraded":"2023-10-18T11:38:54.714104+0000","last_fullsized":"2023-10-18T11:38:54.714104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'134","last_scrub_stamp":"2023-10-18T11:38:54.713999+0000","last_deep_scrub":"31'134","last_deep_scrub_stamp":"2023-10-18T11:38:54.713999+0000","last_clean_scrub_stamp":"2023-10-18T11:38:54.713999+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:47:08.372510+0000","scrub_duration":0.0029353119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'143","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.682215+0000","last_change":"2023-10-18T11:38:38.682399+0000","last_active":"2023-10-18T11:38:38.682215+0000","last_peered":"2023-10-18T11:38:38.682215+0000","last_clean":"2023-10-18T11:38:38.682215+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:38:38.682215+0000","last_undegraded":"2023-10-18T11:38:38.682215+0000","last_fullsized":"2023-10-18T11:38:38.682215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'143","last_scrub_stamp":"2023-10-18T11:38:38.682031+0000","last_deep_scrub":"31'143","last_deep_scrub_stamp":"2023-10-18T11:38:38.682031+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.682031+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:12.903605+0000","scrub_duration":0.0035830810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'127","reported_seq":165,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.587489+0000","last_change":"2023-10-18T11:38:18.587542+0000","last_active":"2023-10-18T11:38:18.587489+0000","last_peered":"2023-10-18T11:38:18.587489+0000","last_clean":"2023-10-18T11:38:18.587489+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:38:18.587489+0000","last_undegraded":"2023-10-18T11:38:18.587489+0000","last_fullsized":"2023-10-18T11:38:18.587489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'127","last_scrub_stamp":"2023-10-18T11:38:18.587414+0000","last_deep_scrub":"31'127","last_deep_scrub_stamp":"2023-10-18T11:38:18.587414+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.587414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:00.007644+0000","scrub_duration":0.0032637949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'137","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:35.338828+0000","last_change":"2023-10-18T11:38:35.338865+0000","last_active":"2023-10-18T11:38:35.338828+0000","last_peered":"2023-10-18T11:38:35.338828+0000","last_clean":"2023-10-18T11:38:35.338828+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:38:35.338828+0000","last_undegraded":"2023-10-18T11:38:35.338828+0000","last_fullsized":"2023-10-18T11:38:35.338828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:35.338757+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:35.338757+0000","last_clean_scrub_stamp":"2023-10-18T11:38:35.338757+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:54:11.626222+0000","scrub_duration":0.0026066140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'142","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.876365+0000","last_change":"2023-10-18T11:38:37.876365+0000","last_active":"2023-10-18T11:38:37.876365+0000","last_peered":"2023-10-18T11:38:37.876365+0000","last_clean":"2023-10-18T11:38:37.876365+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:38:37.876365+0000","last_undegraded":"2023-10-18T11:38:37.876365+0000","last_fullsized":"2023-10-18T11:38:37.876365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:37.876023+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:37.876023+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.876023+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:42.828498+0000","scrub_duration":0.0035315149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'165","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:11.775586+0000","last_change":"2023-10-18T11:38:11.775586+0000","last_active":"2023-10-18T11:38:11.775586+0000","last_peered":"2023-10-18T11:38:11.775586+0000","last_clean":"2023-10-18T11:38:11.775586+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:38:11.775586+0000","last_undegraded":"2023-10-18T11:38:11.775586+0000","last_fullsized":"2023-10-18T11:38:11.775586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:11.775315+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:28.740862+0000","scrub_duration":0.0041709950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'146","reported_seq":179,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.306542+0000","last_change":"2023-10-18T11:09:39.354435+0000","last_active":"2023-10-18T11:38:16.306542+0000","last_peered":"2023-10-18T11:38:16.306542+0000","last_clean":"2023-10-18T11:38:16.306542+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:38:16.306542+0000","last_undegraded":"2023-10-18T11:38:16.306542+0000","last_fullsized":"2023-10-18T11:38:16.306542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:37.687839+0000","last_clean_scrub_stamp":"2023-10-18T11:09:37.687839+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2017,"num_read_kb":484709,"num_write":10619,"num_write_kb":576779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13929,"ondisk_log_size":13929,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9424,"ondisk_log_size":9424,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":100007018,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":2171,"num_read_kb":2416,"num_write":26219,"num_write_kb":112209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159006720,"data_stored":200014036,"data_compressed":12429396,"data_compressed_allocated":19357696,"data_compressed_original":60612608,"omap_allocated":0,"internal_metadata":0},"log_size":24373,"ondisk_log_size":24373,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509802,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113708,"kb_used_data":24228,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94258132,"statfs":{"total":96636764160,"available":96520327168,"internally_reserved":0,"allocated":24809472,"data_stored":31797443,"data_compressed":2010206,"data_compressed_allocated":3112960,"data_compressed_original":10338304,"omap_allocated":1588,"internal_metadata":91617740},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.88200000000000001,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0069999999999999,"5min":1.3260000000000001,"15min":19.158000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.73699999999999999},"min":{"1min":0.44400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.075,"5min":19.673999999999999,"15min":19.673999999999999},"last":0.999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.878,"15min":0.73399999999999999},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.36099999999999999},"max":{"1min":0.91600000000000004,"5min":15.692,"15min":15.692},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.68300000000000005,"15min":0.65900000000000003},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.9239999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.442,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.528,"5min":1.528,"15min":5.444},"last":0.66200000000000003}]},{"osd":3,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.93999999999999995,"15min":0.81899999999999995},"min":{"1min":0.39400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4319999999999999,"5min":12.368,"15min":12.368},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.68799999999999994,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":13.1},"last":0.69599999999999995}]},{"osd":4,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.35199999999999998},"min":{"1min":0.28599999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48999999999999999,"5min":1.895,"15min":1.895},"last":0.378},{"interface":"front","average":{"1min":0.379,"5min":0.37,"15min":0.371},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.53200000000000003,"5min":1.321,"15min":1.321},"last":0.39800000000000002}]},{"osd":5,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.28000000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47999999999999998,"5min":0.85099999999999998,"15min":1.081},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.437,"15min":0.41099999999999998},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.52000000000000002,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44,"15min":0.42499999999999999},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":0.54600000000000004,"5min":3.4409999999999998,"15min":3.4409999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.35899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55900000000000005,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.45200000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509800,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93740,"kb_used_data":18148,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278100,"statfs":{"total":96636764160,"available":96540774400,"internally_reserved":0,"allocated":18583552,"data_stored":23213882,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60499999999999998,"15min":0.63700000000000001},"min":{"1min":0.439,"5min":0.36199999999999999,"15min":0.31},"max":{"1min":1.0489999999999999,"5min":1.0740000000000001,"15min":9.3190000000000008},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.62,"15min":0.66300000000000003},"min":{"1min":0.46600000000000003,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":1.024,"5min":1.1699999999999999,"15min":15.282999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.52300000000000002,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.0369999999999999,"5min":1.202,"15min":6.6429999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61799999999999999,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92200000000000004,"5min":1.153,"15min":1.748},"last":0.74299999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.33300000000000002},"max":{"1min":0.94199999999999995,"5min":1.355,"15min":1.839},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71699999999999997,"15min":0.68200000000000005},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.34499999999999997},"max":{"1min":1.202,"5min":1.468,"15min":1.6819999999999999},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67500000000000004,"15min":0.73299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":1.113,"5min":1.2410000000000001,"15min":13.840999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.69699999999999995,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":1.0800000000000001,"5min":1.1950000000000001,"15min":23.155999999999999},"last":0.84899999999999998}]},{"osd":4,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25700000000000001,"5min":0.23899999999999999,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.52600000000000002,"15min":0.88},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.38200000000000001,"15min":0.371},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.48299999999999998,"5min":0.53500000000000003,"15min":1.0469999999999999},"last":0.44700000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39200000000000002,"15min":0.373},"min":{"1min":0.27900000000000003,"5min":0.26900000000000002,"15min":0.23300000000000001},"max":{"1min":0.5,"5min":0.54300000000000004,"15min":0.56799999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.316,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.624},"last":0.53600000000000003}]},{"osd":7,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.33400000000000002,"5min":0.27500000000000002,"15min":0.253},"max":{"1min":0.56499999999999995,"5min":0.57899999999999996,"15min":0.77600000000000002},"last":0.498},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41299999999999998,"15min":0.40699999999999997},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.53500000000000003,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.51000000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509801,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87864,"kb_used_data":20592,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94283976,"statfs":{"total":96636764160,"available":96546791424,"internally_reserved":0,"allocated":21086208,"data_stored":26657639,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.32200000000000001,"15min":0.29599999999999999},"max":{"1min":0.92300000000000004,"5min":1.21,"15min":1.663},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68600000000000005,"15min":0.623},"min":{"1min":0.45500000000000002,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":0.98699999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.0720000000000001}]},{"osd":1,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.33700000000000002,"15min":0.32500000000000001},"max":{"1min":0.94799999999999995,"5min":1.246,"15min":1.8620000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.748,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.45500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.056,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.66700000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1180000000000001,"5min":1.1990000000000001,"15min":1.248},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.38700000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.2350000000000001,"15min":3.5579999999999998},"last":0.68000000000000005}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.373},"max":{"1min":1.119,"5min":1.4930000000000001,"15min":1.5049999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":1.0840000000000001,"5min":1.4019999999999999,"15min":1.8779999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.223},"max":{"1min":0.504,"5min":0.51500000000000001,"15min":0.72699999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.32100000000000001,"5min":0.248,"15min":0.24399999999999999},"max":{"1min":0.53600000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.41899999999999998}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.24299999999999999,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.57799999999999996,"15min":0.622},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.41099999999999998,"15min":0.40200000000000002},"min":{"1min":0.36599999999999999,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.54600000000000004,"5min":0.65900000000000003,"15min":0.67400000000000004},"last":0.45400000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.56299999999999994,"5min":0.67300000000000004,"15min":0.68999999999999995},"last":0.436}]}]},{"osd":3,"up_from":15,"seq":64424509800,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148704,"kb_used_data":27288,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94223136,"statfs":{"total":96636764160,"available":96484491264,"internally_reserved":0,"allocated":27942912,"data_stored":33976532,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":1591,"internal_metadata":124320201},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.391,"15min":1.147},"min":{"1min":0.66300000000000003,"5min":0.5,"15min":0.314},"max":{"1min":2.6360000000000001,"5min":24.654,"15min":24.654},"last":0.878},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.339,"15min":1.1539999999999999},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.379},"max":{"1min":2.5899999999999999,"5min":18.518000000000001,"15min":18.518000000000001},"last":0.94899999999999995}]},{"osd":1,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.4059999999999999,"15min":1.2430000000000001},"min":{"1min":0.49299999999999999,"5min":0.441,"15min":0.35399999999999998},"max":{"1min":2.8140000000000001,"5min":16.361999999999998,"15min":16.361999999999998},"last":1.042},{"interface":"front","average":{"1min":1.407,"5min":1.5469999999999999,"15min":1.361},"min":{"1min":0.83799999999999997,"5min":0.57699999999999996,"15min":0.43099999999999999},"max":{"1min":2.278,"5min":24.611000000000001,"15min":24.611000000000001},"last":1.1419999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.52,"15min":1.3979999999999999},"min":{"1min":0.71199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.8959999999999999,"5min":16.576000000000001,"15min":16.576000000000001},"last":1.278},{"interface":"front","average":{"1min":1.452,"5min":1.6739999999999999,"15min":1.4810000000000001},"min":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.45100000000000001},"max":{"1min":2.7290000000000001,"5min":24.553000000000001,"15min":24.553000000000001},"last":1.5049999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.454,"15min":1.2290000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.432},"max":{"1min":2.2679999999999998,"5min":18.721,"15min":18.721},"last":1.196},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.379,"15min":1.266},"min":{"1min":0.77000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.5099999999999998,"5min":16.481000000000002,"15min":16.481000000000002},"last":1.458}]},{"osd":5,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.6160000000000001,"15min":1.3959999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.44700000000000001},"max":{"1min":2.569,"5min":24.786999999999999,"15min":24.786999999999999},"last":1.242},{"interface":"front","average":{"1min":1.397,"5min":1.6279999999999999,"15min":1.365},"min":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.49199999999999999},"max":{"1min":2.6120000000000001,"5min":18.681999999999999,"15min":18.681999999999999},"last":1.3220000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.518,"15min":1.397},"min":{"1min":0.82099999999999995,"5min":0.59899999999999998,"15min":0.52900000000000003},"max":{"1min":2.3370000000000002,"5min":16.513999999999999,"15min":16.513999999999999},"last":1.546},{"interface":"front","average":{"1min":1.625,"5min":1.7150000000000001,"15min":1.508},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.54300000000000004},"max":{"1min":2.3940000000000001,"5min":24.834,"15min":24.834},"last":1.383}]},{"osd":7,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5740000000000001,"5min":1.718,"15min":1.4730000000000001},"min":{"1min":0.64700000000000002,"5min":0.499,"15min":0.499},"max":{"1min":2.847,"5min":18.800000000000001,"15min":18.800000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.645,"5min":1.6599999999999999,"15min":1.5209999999999999},"min":{"1min":0.86499999999999999,"5min":0.64100000000000001,"15min":0.496},"max":{"1min":2.6899999999999999,"5min":16.544,"15min":16.544},"last":1.607}]}]},{"osd":2,"up_from":15,"seq":64424509800,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94552,"kb_used_data":13456,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94277288,"statfs":{"total":96636764160,"available":96539942912,"internally_reserved":0,"allocated":13778944,"data_stored":17047576,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.141,"15min":1.0549999999999999},"min":{"1min":0.72199999999999998,"5min":0.40600000000000003,"15min":0.308},"max":{"1min":1.829,"5min":2.5830000000000002,"15min":2.9249999999999998},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1659999999999999,"15min":1.1140000000000001},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":1.732,"5min":3.2919999999999998,"15min":3.964},"last":1.2529999999999999}]},{"osd":1,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.264,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.53700000000000003,"15min":0.40200000000000002},"max":{"1min":2.5409999999999999,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":1.53},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3520000000000001,"15min":1.2849999999999999},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.056,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.7210000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4610000000000001,"15min":1.3680000000000001},"min":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.44},"max":{"1min":2.7250000000000001,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.538,"15min":1.391},"min":{"1min":0.61099999999999999,"5min":0.55400000000000005,"15min":0.53900000000000003},"max":{"1min":2.157,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.8}]},{"osd":4,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2230000000000001,"15min":1.1439999999999999},"min":{"1min":0.66700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.9870000000000001,"5min":3.3759999999999999,"15min":3.3759999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.29,"15min":1.2150000000000001},"min":{"1min":0.70499999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.0449999999999999,"5min":3.831,"15min":3.831},"last":1.3959999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.4199999999999999,"15min":1.254},"min":{"1min":0.76000000000000001,"5min":0.58399999999999996,"15min":0.46200000000000002},"max":{"1min":2.6640000000000001,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":2.1760000000000002},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3740000000000001,"15min":1.27},"min":{"1min":0.57899999999999996,"5min":0.51200000000000001,"15min":0.441},"max":{"1min":2.1150000000000002,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.3440000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.431,"15min":1.329},"min":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.49399999999999999},"max":{"1min":2.1099999999999999,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":2.0009999999999999},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5409999999999999,"15min":1.363},"min":{"1min":0.91200000000000003,"5min":0.68100000000000005,"15min":0.50700000000000001},"max":{"1min":2.7989999999999999,"5min":5.133,"15min":5.133},"last":2.2559999999999998}]},{"osd":7,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.498,"15min":1.385},"min":{"1min":0.89300000000000002,"5min":0.68100000000000005,"15min":0.48599999999999999},"max":{"1min":2.206,"5min":3.597,"15min":3.597},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.571,"15min":1.448},"min":{"1min":0.73999999999999999,"5min":0.65100000000000002,"15min":0.55900000000000005},"max":{"1min":2.3860000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":2.0640000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509801,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153264,"kb_used_data":23592,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94218576,"statfs":{"total":96636764160,"available":96479821824,"internally_reserved":0,"allocated":24158208,"data_stored":30584690,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.056,"15min":1.0980000000000001},"min":{"1min":0.66700000000000004,"5min":0.38400000000000001,"15min":0.313},"max":{"1min":1.4670000000000001,"5min":2.5649999999999999,"15min":10.836},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.169,"15min":1.1319999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":3.8410000000000002},"last":1.599}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1919999999999999,"15min":1.1890000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.32900000000000001},"max":{"1min":1.931,"5min":3.2389999999999999,"15min":4.4199999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.385,"15min":1.335},"min":{"1min":0.50900000000000001,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":8.6229999999999993,"5min":8.6229999999999993,"15min":10.782},"last":1.7549999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.343,"15min":1.405},"min":{"1min":0.70599999999999996,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":1.9330000000000001,"5min":2.8420000000000001,"15min":6.8150000000000004},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.2929999999999999,"15min":1.319},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.0609999999999999,"5min":3.1200000000000001,"15min":3.79},"last":1.147}]},{"osd":4,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.1990000000000001,"15min":1.1870000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.376},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":4.3890000000000002},"last":1.25},{"interface":"front","average":{"1min":1.339,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.65700000000000003,"5min":0.63300000000000001,"15min":0.60899999999999999},"max":{"1min":2.2919999999999998,"5min":2.6349999999999998,"15min":6.9950000000000001},"last":1.3069999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.288,"15min":1.248},"min":{"1min":0.64700000000000002,"5min":0.58599999999999997,"15min":0.495},"max":{"1min":4.2939999999999996,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3100000000000001,"15min":1.3029999999999999},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52900000000000003},"max":{"1min":2.1320000000000001,"5min":2.294,"15min":4.3419999999999996},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.407,"15min":1.405},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9059999999999999,"5min":2.7400000000000002,"15min":6.944},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.353},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55300000000000005},"max":{"1min":2.2130000000000001,"5min":3.3849999999999998,"15min":3.657},"last":1.7050000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4399999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":2.3100000000000001,"5min":3.27,"15min":3.722},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.45,"15min":1.4430000000000001},"min":{"1min":0.72399999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2589999999999999,"5min":2.6309999999999998,"15min":4.2919999999999998},"last":1.486}]}]},{"osd":0,"up_from":15,"seq":64424509801,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106768,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94265072,"statfs":{"total":96636764160,"available":96527433728,"internally_reserved":0,"allocated":17768448,"data_stored":22732859,"data_compressed":1487303,"data_compressed_allocated":2297856,"data_compressed_original":7491584,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.0209999999999999,"15min":1.044},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":5.2450000000000001,"5min":5.2450000000000001,"15min":5.7380000000000004},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.0780000000000001,"15min":1.1779999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.738,"5min":1.9830000000000001,"15min":20.128},"last":1.2849999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.133,"15min":1.1990000000000001},"min":{"1min":0.68700000000000006,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":2.1200000000000001,"5min":2.8039999999999998,"15min":3.2839999999999998},"last":1.133},{"interface":"front","average":{"1min":1.728,"5min":1.2809999999999999,"15min":1.2949999999999999},"min":{"1min":0.52400000000000002,"5min":0.38900000000000001,"15min":0.31900000000000001},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":1.3979999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.28,"15min":1.272},"min":{"1min":0.72899999999999998,"5min":0.47699999999999998,"15min":0.44600000000000001},"max":{"1min":2.1499999999999999,"5min":4.0510000000000002,"15min":8.9879999999999995},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.3600000000000001,"15min":1.4139999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.1480000000000001,"5min":2.7639999999999998,"15min":5.6219999999999999},"last":1.514}]},{"osd":4,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.252,"15min":1.2150000000000001},"min":{"1min":0.59699999999999998,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":1.028},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1599999999999999,"15min":1.161},"min":{"1min":0.80700000000000005,"5min":0.53800000000000003,"15min":0.51800000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":3.6219999999999999},"last":1.2350000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.2689999999999999,"15min":1.2529999999999999},"min":{"1min":0.88,"5min":0.61899999999999999,"15min":0.49099999999999999},"max":{"1min":2.323,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":1.073},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.3140000000000001,"15min":1.3},"min":{"1min":0.91200000000000003,"5min":0.59299999999999997,"15min":0.56200000000000006},"max":{"1min":2.0289999999999999,"5min":2.2349999999999999,"15min":2.8140000000000001},"last":1.3540000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.3779999999999999,"15min":1.369},"min":{"1min":0.84699999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2360000000000002,"5min":2.274,"15min":2.7669999999999999},"last":1.448},{"interface":"front","average":{"1min":1.542,"5min":1.391,"15min":1.3620000000000001},"min":{"1min":0.89900000000000002,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.7669999999999999},"last":1.4730000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.47,"15min":1.444},"min":{"1min":0.80700000000000005,"5min":0.56599999999999995,"15min":0.49199999999999999},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.915},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.3939999999999999,"15min":1.375},"min":{"1min":0.77500000000000002,"5min":0.66500000000000004,"15min":0.59999999999999998},"max":{"1min":2.2829999999999999,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1.6240000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542504,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98600,"kb_used_data":13344,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273240,"statfs":{"total":96636764160,"available":96535797760,"internally_reserved":0,"allocated":13664256,"data_stored":16262951,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.60799999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":0.95099999999999996,"5min":3.387,"15min":3.387},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.33300000000000002,"15min":0.31},"max":{"1min":0.92500000000000004,"5min":1.587,"15min":1.587},"last":0.71199999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65900000000000003,"15min":0.63300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.25},"max":{"1min":1.069,"5min":1.478,"15min":1.478},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":1.0129999999999999,"5min":1.554,"15min":1.669},"last":0.89400000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.377,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":1.2070000000000001,"15min":1.712},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96299999999999997,"5min":1.1000000000000001,"15min":1.1839999999999999},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.877,"5min":1.3200000000000001,"15min":2.694},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68999999999999995,"15min":0.70499999999999996},"min":{"1min":0.48399999999999999,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.97599999999999998,"5min":1.4159999999999999,"15min":2.1459999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35199999999999998,"15min":0.35899999999999999},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.42599999999999999,"5min":0.55600000000000005,"15min":0.63700000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36499999999999999,"15min":0.37},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26500000000000001},"max":{"1min":0.40300000000000002,"5min":0.57599999999999996,"15min":0.68600000000000005},"last":0.39700000000000002}]},{"osd":5,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35699999999999998,"15min":0.36699999999999999},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.252},"max":{"1min":0.43099999999999999,"5min":0.65700000000000003,"15min":0.85199999999999998},"last":0.372},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38600000000000001,"15min":0.39500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.46600000000000003,"5min":0.65800000000000003,"15min":0.67000000000000004},"last":0.56000000000000005}]},{"osd":7,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26700000000000002},"max":{"1min":0.432,"5min":0.63600000000000001,"15min":0.77600000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.44800000000000001,"5min":0.68300000000000005,"15min":0.80000000000000004},"last":0.45100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17371136,"data_stored":22007641,"data_compressed":1454768,"data_compressed_allocated":2252800,"data_compressed_original":6918144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23826432,"data_stored":30449840,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13447168,"data_stored":16912726,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27611136,"data_stored":33841682,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20754432,"data_stored":26522789,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":23079032,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13332480,"data_stored":16128101,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24412160,"data_stored":31072225,"data_compressed":1977671,"data_compressed_allocated":3067904,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:38:58.779 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.780 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.780 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.781 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.781 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.781 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.782 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.782 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.783 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.783 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.783 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.784 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.784 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.784 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.785 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.785 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.785 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.786 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.786 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.787 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.787 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.787 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-18T11:09:37.687839+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=37, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:38:58.788 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-18T11:39:11.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:39:11.862 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:39:17.788 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:30:33.882 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:39:17.798 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:30:33.892 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:39:17.849 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:30:34.017 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:39:17.851 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:30:34.019 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:39:17.855 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:30:34.023 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:39:17.856 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:30:34.024 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:39:17.915 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:30:34.083 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:39:17.920 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:30:34.088 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:39:17.940 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:30:34.034 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:39:18.789 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:39:19.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.001+0000 7f4bf73d5640 1 Processor -- start 2023-10-18T11:39:19.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.002+0000 7f4bf73d5640 1 -- start start 2023-10-18T11:39:19.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.003+0000 7f4bf73d5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf006d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.003+0000 7f4bf73d5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4bf006dca0 0x7f4bf0159170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.003+0000 7f4bf73d5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf00c5740 con 0x7f4bf014ff40 2023-10-18T11:39:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.003+0000 7f4bf73d5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf006e0b0 con 0x7f4bf006dca0 2023-10-18T11:39:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.003+0000 7f4bf73d5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf00c2d60 con 0x7f4bf00c67b0 2023-10-18T11:39:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.004+0000 7f4bf4970640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf006d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.004+0000 7f4bf4970640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf006d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:47746/0 (socket says 172.21.15.151:47746) 2023-10-18T11:39:19.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.004+0000 7f4bf4970640 1 -- 172.21.15.151:0/3665826452 learned_addr learned my addr 172.21.15.151:0/3665826452 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:19.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.005+0000 7f4bf5972640 1 --2- 172.21.15.151:0/3665826452 >> v2:172.21.15.151:3300/0 conn(0x7f4bf006dca0 0x7f4bf0159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:19.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.006+0000 7f4bf4970640 1 -- 172.21.15.151:0/3665826452 >> v2:172.21.15.151:3300/0 conn(0x7f4bf006dca0 msgr2=0x7f4bf0159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:39:19.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.006+0000 7f4bf4970640 1 --2- 172.21.15.151:0/3665826452 >> v2:172.21.15.151:3300/0 conn(0x7f4bf006dca0 0x7f4bf0159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:19.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.006+0000 7f4bf4970640 1 -- 172.21.15.151:0/3665826452 >> v1:172.21.15.151:6789/0 conn(0x7f4bf014ff40 legacy=0x7f4bf00c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:19.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.006+0000 7f4bf4970640 1 -- 172.21.15.151:0/3665826452 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf0150320 con 0x7f4bf00c67b0 2023-10-18T11:39:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.009+0000 7f4bf4970640 1 --2- 172.21.15.151:0/3665826452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf006d760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009870 tx=0x7f4be402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf1c1b4aa01a994 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:19.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.012+0000 7f4beffff640 1 -- 172.21.15.151:0/3665826452 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4030840 con 0x7f4bf00c67b0 2023-10-18T11:39:19.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.012+0000 7f4beffff640 1 -- 172.21.15.151:0/3665826452 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be40309a0 con 0x7f4bf00c67b0 2023-10-18T11:39:19.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.012+0000 7f4beffff640 1 -- 172.21.15.151:0/3665826452 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4030d30 con 0x7f4bf00c67b0 2023-10-18T11:39:19.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.013+0000 7f4bf73d5640 1 -- 172.21.15.151:0/3665826452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 msgr2=0x7f4bf006d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:19.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.013+0000 7f4bf73d5640 1 --2- 172.21.15.151:0/3665826452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf006d760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009870 tx=0x7f4be402b980 comp rx=0 tx=0).stop 2023-10-18T11:39:19.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.013+0000 7f4bf73d5640 1 -- 172.21.15.151:0/3665826452 shutdown_connections 2023-10-18T11:39:19.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.013+0000 7f4bf73d5640 1 --2- 172.21.15.151:0/3665826452 >> v2:172.21.15.151:3300/0 conn(0x7f4bf006dca0 0x7f4bf0159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:19.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.013+0000 7f4bf73d5640 1 --2- 172.21.15.151:0/3665826452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf006d760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:19.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.013+0000 7f4bf73d5640 1 -- 172.21.15.151:0/3665826452 >> 172.21.15.151:0/3665826452 conn(0x7f4bf00c6f10 msgr2=0x7f4bf00c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:19.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.013+0000 7f4bf73d5640 1 -- 172.21.15.151:0/3665826452 shutdown_connections 2023-10-18T11:39:19.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.014+0000 7f4bf73d5640 1 -- 172.21.15.151:0/3665826452 wait complete. 2023-10-18T11:39:19.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.016+0000 7f4bf73d5640 1 Processor -- start 2023-10-18T11:39:19.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.016+0000 7f4bf73d5640 1 -- start start 2023-10-18T11:39:19.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.017+0000 7f4bf73d5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bf006dca0 0x7f4bf0158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:19.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.017+0000 7f4bf73d5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:19.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.017+0000 7f4bf73d5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf014ff40 0x7f4bf014b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:19.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.017+0000 7f4bf73d5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf014d870 con 0x7f4bf014ff40 2023-10-18T11:39:19.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.017+0000 7f4bf73d5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf01ef6c0 con 0x7f4bf006dca0 2023-10-18T11:39:19.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.017+0000 7f4bf73d5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf014a470 con 0x7f4bf00c67b0 2023-10-18T11:39:19.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.018+0000 7f4bf5972640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf014ff40 0x7f4bf014b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:19.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.018+0000 7f4bf5171640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bf006dca0 0x7f4bf0158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:19.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.018+0000 7f4bf4970640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:19.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.018+0000 7f4bf5972640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf014ff40 0x7f4bf014b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54672/0 (socket says 172.21.15.151:54672) 2023-10-18T11:39:19.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.018+0000 7f4bf5972640 1 -- 172.21.15.151:0/183176615 learned_addr learned my addr 172.21.15.151:0/183176615 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.021+0000 7f4bf4970640 1 -- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bf006dca0 msgr2=0x7f4bf0158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.021+0000 7f4bf4970640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bf006dca0 0x7f4bf0158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.021+0000 7f4bf4970640 1 -- 172.21.15.151:0/183176615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf014ff40 msgr2=0x7f4bf014b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.021+0000 7f4bf4970640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf014ff40 0x7f4bf014b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:19.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.021+0000 7f4bf4970640 1 -- 172.21.15.151:0/183176615 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be40094d0 con 0x7f4bf00c67b0 2023-10-18T11:39:19.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.024+0000 7f4bf4970640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf014b480 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00c6490 tx=0x7f4be4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:19.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.027+0000 7f4bedffb640 1 -- 172.21.15.151:0/183176615 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4039c90 con 0x7f4bf00c67b0 2023-10-18T11:39:19.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.027+0000 7f4bedffb640 1 -- 172.21.15.151:0/183176615 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be4039e10 con 0x7f4bf00c67b0 2023-10-18T11:39:19.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.027+0000 7f4bedffb640 1 -- 172.21.15.151:0/183176615 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4043640 con 0x7f4bf00c67b0 2023-10-18T11:39:19.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.027+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf014a750 con 0x7f4bf00c67b0 2023-10-18T11:39:19.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.028+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf014ddc0 con 0x7f4bf00c67b0 2023-10-18T11:39:19.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.029+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf00c8b50 con 0x7f4bf00c67b0 2023-10-18T11:39:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.053+0000 7f4bedffb640 1 -- 172.21.15.151:0/183176615 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4be40437a0 con 0x7f4bf00c67b0 2023-10-18T11:39:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.054+0000 7f4bedffb640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bdc06aec0 0x7f4bdc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.054+0000 7f4bedffb640 1 -- 172.21.15.151:0/183176615 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4be403e070 con 0x7f4bf00c67b0 2023-10-18T11:39:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.054+0000 7f4bf5171640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bdc06aec0 0x7f4bdc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:19.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.055+0000 7f4bf5171640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bdc06aec0 0x7f4bdc06d380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4be0001e70 tx=0x7f4be0009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:19.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.286+0000 7f4bedffb640 1 -- 172.21.15.151:0/183176615 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4be40780b0 con 0x7f4bf00c67b0 2023-10-18T11:39:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.497+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4bf0159fe0 con 0x7f4bdc06aec0 2023-10-18T11:39:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.513+0000 7f4bedffb640 1 -- 172.21.15.151:0/183176615 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373592 (secure 0 0 0) 0x7f4be000fe00 con 0x7f4bdc06aec0 2023-10-18T11:39:19.517 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:39:19.524 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:39:19.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bdc06aec0 msgr2=0x7f4bdc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:19.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bdc06aec0 0x7f4bdc06d380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4be0001e70 tx=0x7f4be0009040 comp rx=0 tx=0).stop 2023-10-18T11:39:19.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 msgr2=0x7f4bf014b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:19.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf014b480 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00c6490 tx=0x7f4be4004730 comp rx=0 tx=0).stop 2023-10-18T11:39:19.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 shutdown_connections 2023-10-18T11:39:19.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bf014ff40 0x7f4bf014b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:19.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4bf00c67b0 0x7f4bf014b480 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:19.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f4bdc06aec0 0x7f4bdc06d380 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:19.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 --2- 172.21.15.151:0/183176615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bf006dca0 0x7f4bf0158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:19.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 >> 172.21.15.151:0/183176615 conn(0x7f4bf00c6f10 msgr2=0x7f4bf00ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:19.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 shutdown_connections 2023-10-18T11:39:19.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:19.522+0000 7f4bf73d5640 1 -- 172.21.15.151:0/183176615 wait complete. 2023-10-18T11:39:19.544 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":925,"stamp":"2023-10-18T11:39:18.626414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":100597386,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":4304,"num_read_kb":487225,"num_write":36997,"num_write_kb":691404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47845,"ondisk_log_size":47845,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":897200,"kb_used_data":158000,"kb_used_omap":12,"kb_used_meta":739123,"kb_avail":754077520,"statfs":{"total":773094113280,"available":772175380480,"internally_reserved":0,"allocated":161792000,"data_stored":202273572,"data_compressed":12494466,"data_compressed_allocated":19447808,"data_compressed_original":61759488,"omap_allocated":12742,"internal_metadata":756862522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003247"},"pg_stats":[{"pgid":"2.1f","version":"31'1794","reported_seq":1838,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.079438+0000","last_change":"2023-10-18T11:38:12.079438+0000","last_active":"2023-10-18T11:38:12.079438+0000","last_peered":"2023-10-18T11:38:12.079438+0000","last_clean":"2023-10-18T11:38:12.079438+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:38:12.079438+0000","last_undegraded":"2023-10-18T11:38:12.079438+0000","last_fullsized":"2023-10-18T11:38:12.079438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1794","last_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_deep_scrub":"31'1794","last_deep_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.079262+0000","objects_scrubbed":9,"log_size":1794,"log_dups_size":0,"ondisk_log_size":1794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:20:44.669761+0000","scrub_duration":0.099044419999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9277295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":10015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'142","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.955490+0000","last_change":"2023-10-18T11:38:16.955575+0000","last_active":"2023-10-18T11:38:16.955490+0000","last_peered":"2023-10-18T11:38:16.955490+0000","last_clean":"2023-10-18T11:38:16.955490+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:38:16.955490+0000","last_undegraded":"2023-10-18T11:38:16.955490+0000","last_fullsized":"2023-10-18T11:38:16.955490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:16.955379+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:16.955379+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.955379+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:19.773706+0000","scrub_duration":0.0027257150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'384","reported_seq":467,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:12.937269+0000","last_change":"2023-10-18T11:39:12.937564+0000","last_active":"2023-10-18T11:39:12.937269+0000","last_peered":"2023-10-18T11:39:12.937269+0000","last_clean":"2023-10-18T11:39:12.937269+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:39:12.937269+0000","last_undegraded":"2023-10-18T11:39:12.937269+0000","last_fullsized":"2023-10-18T11:39:12.937269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'384","last_scrub_stamp":"2023-10-18T11:39:12.937058+0000","last_deep_scrub":"31'384","last_deep_scrub_stamp":"2023-10-18T11:39:12.937058+0000","last_clean_scrub_stamp":"2023-10-18T11:39:12.937058+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:44:43.964531+0000","scrub_duration":0.0099049389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":285,"num_write_kb":10314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'1439","reported_seq":1483,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.051027+0000","last_change":"2023-10-18T11:38:23.051102+0000","last_active":"2023-10-18T11:38:23.051027+0000","last_peered":"2023-10-18T11:38:23.051027+0000","last_clean":"2023-10-18T11:38:23.051027+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:38:23.051027+0000","last_undegraded":"2023-10-18T11:38:23.051027+0000","last_fullsized":"2023-10-18T11:38:23.051027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1439","last_scrub_stamp":"2023-10-18T11:38:23.050919+0000","last_deep_scrub":"31'1439","last_deep_scrub_stamp":"2023-10-18T11:38:23.050919+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.050919+0000","objects_scrubbed":2,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:37.205626+0000","scrub_duration":0.089910790000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1431,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'165","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.966648+0000","last_change":"2023-10-18T11:38:31.966648+0000","last_active":"2023-10-18T11:38:31.966648+0000","last_peered":"2023-10-18T11:38:31.966648+0000","last_clean":"2023-10-18T11:38:31.966648+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:38:31.966648+0000","last_undegraded":"2023-10-18T11:38:31.966648+0000","last_fullsized":"2023-10-18T11:38:31.966648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2023-10-18T11:38:31.966374+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2023-10-18T11:38:31.966374+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.966374+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:57:30.180571+0000","scrub_duration":0.0039781039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'453","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.642188+0000","last_change":"2023-10-18T11:38:38.642188+0000","last_active":"2023-10-18T11:38:38.642188+0000","last_peered":"2023-10-18T11:38:38.642188+0000","last_clean":"2023-10-18T11:38:38.642188+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:38:38.642188+0000","last_undegraded":"2023-10-18T11:38:38.642188+0000","last_fullsized":"2023-10-18T11:38:38.642188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'453","last_scrub_stamp":"2023-10-18T11:38:38.642006+0000","last_deep_scrub":"31'453","last_deep_scrub_stamp":"2023-10-18T11:38:38.642006+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.642006+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:43.682379+0000","scrub_duration":0.0041783769999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":14204,"num_write":357,"num_write_kb":21017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'825","reported_seq":866,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:34.615568+0000","last_change":"2023-10-18T11:38:34.615623+0000","last_active":"2023-10-18T11:38:34.615568+0000","last_peered":"2023-10-18T11:38:34.615568+0000","last_clean":"2023-10-18T11:38:34.615568+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:38:34.615568+0000","last_undegraded":"2023-10-18T11:38:34.615568+0000","last_fullsized":"2023-10-18T11:38:34.615568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'825","last_scrub_stamp":"2023-10-18T11:38:34.615490+0000","last_deep_scrub":"31'825","last_deep_scrub_stamp":"2023-10-18T11:38:34.615490+0000","last_clean_scrub_stamp":"2023-10-18T11:38:34.615490+0000","objects_scrubbed":8,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:39.655863+0000","scrub_duration":0.025506078000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3060357,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'145","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.303391+0000","last_change":"2023-10-18T11:38:37.303430+0000","last_active":"2023-10-18T11:38:37.303391+0000","last_peered":"2023-10-18T11:38:37.303391+0000","last_clean":"2023-10-18T11:38:37.303391+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:38:37.303391+0000","last_undegraded":"2023-10-18T11:38:37.303391+0000","last_fullsized":"2023-10-18T11:38:37.303391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:37.303321+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:37.303321+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.303321+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:55:06.926563+0000","scrub_duration":0.001256479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'331","reported_seq":412,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:45.741405+0000","last_change":"2023-10-18T11:38:45.741499+0000","last_active":"2023-10-18T11:38:45.741405+0000","last_peered":"2023-10-18T11:38:45.741405+0000","last_clean":"2023-10-18T11:38:45.741405+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:38:45.741405+0000","last_undegraded":"2023-10-18T11:38:45.741405+0000","last_fullsized":"2023-10-18T11:38:45.741405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'331","last_scrub_stamp":"2023-10-18T11:38:45.741329+0000","last_deep_scrub":"31'331","last_deep_scrub_stamp":"2023-10-18T11:38:45.741329+0000","last_clean_scrub_stamp":"2023-10-18T11:38:45.741329+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:50.693803+0000","scrub_duration":0.0043312309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":213,"num_write_kb":9865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'10","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.523461+0000","last_change":"2023-10-18T11:38:21.523502+0000","last_active":"2023-10-18T11:38:21.523461+0000","last_peered":"2023-10-18T11:38:21.523461+0000","last_clean":"2023-10-18T11:38:21.523461+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:38:21.523461+0000","last_undegraded":"2023-10-18T11:38:21.523461+0000","last_fullsized":"2023-10-18T11:38:21.523461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-10-18T11:38:21.523393+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-10-18T11:38:21.523393+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.523393+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:57:54.359212+0000","scrub_duration":0.008442148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'167","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:50.073173+0000","last_change":"2023-10-18T11:38:50.073212+0000","last_active":"2023-10-18T11:38:50.073173+0000","last_peered":"2023-10-18T11:38:50.073173+0000","last_clean":"2023-10-18T11:38:50.073173+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:38:50.073173+0000","last_undegraded":"2023-10-18T11:38:50.073173+0000","last_fullsized":"2023-10-18T11:38:50.073173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-10-18T11:38:50.073100+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-10-18T11:38:50.073100+0000","last_clean_scrub_stamp":"2023-10-18T11:38:50.073100+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:14:40.873775+0000","scrub_duration":0.0014290189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'461","reported_seq":552,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:48.707189+0000","last_change":"2023-10-18T11:38:48.707251+0000","last_active":"2023-10-18T11:38:48.707189+0000","last_peered":"2023-10-18T11:38:48.707189+0000","last_clean":"2023-10-18T11:38:48.707189+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:38:48.707189+0000","last_undegraded":"2023-10-18T11:38:48.707189+0000","last_fullsized":"2023-10-18T11:38:48.707189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'461","last_scrub_stamp":"2023-10-18T11:38:48.707107+0000","last_deep_scrub":"31'461","last_deep_scrub_stamp":"2023-10-18T11:38:48.707107+0000","last_clean_scrub_stamp":"2023-10-18T11:38:48.707107+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:39:13.854788+0000","scrub_duration":0.0044031340000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":15764,"num_write":351,"num_write_kb":32860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'140","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.567551+0000","last_change":"2023-10-18T11:38:31.567593+0000","last_active":"2023-10-18T11:38:31.567551+0000","last_peered":"2023-10-18T11:38:31.567551+0000","last_clean":"2023-10-18T11:38:31.567551+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:38:31.567551+0000","last_undegraded":"2023-10-18T11:38:31.567551+0000","last_fullsized":"2023-10-18T11:38:31.567551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'140","last_scrub_stamp":"2023-10-18T11:38:31.567485+0000","last_deep_scrub":"31'140","last_deep_scrub_stamp":"2023-10-18T11:38:31.567485+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.567485+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:17.382614+0000","scrub_duration":0.0011892719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'770","reported_seq":813,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.579965+0000","last_change":"2023-10-18T11:38:20.579965+0000","last_active":"2023-10-18T11:38:20.579965+0000","last_peered":"2023-10-18T11:38:20.579965+0000","last_clean":"2023-10-18T11:38:20.579965+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:38:20.579965+0000","last_undegraded":"2023-10-18T11:38:20.579965+0000","last_fullsized":"2023-10-18T11:38:20.579965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'770","last_scrub_stamp":"2023-10-18T11:38:20.579828+0000","last_deep_scrub":"31'770","last_deep_scrub_stamp":"2023-10-18T11:38:20.579828+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.579828+0000","objects_scrubbed":3,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:49.808441+0000","scrub_duration":0.018364789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'437","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:40.640322+0000","last_change":"2023-10-18T11:38:40.640322+0000","last_active":"2023-10-18T11:38:40.640322+0000","last_peered":"2023-10-18T11:38:40.640322+0000","last_clean":"2023-10-18T11:38:40.640322+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:38:40.640322+0000","last_undegraded":"2023-10-18T11:38:40.640322+0000","last_fullsized":"2023-10-18T11:38:40.640322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'437","last_scrub_stamp":"2023-10-18T11:38:40.640174+0000","last_deep_scrub":"31'437","last_deep_scrub_stamp":"2023-10-18T11:38:40.640174+0000","last_clean_scrub_stamp":"2023-10-18T11:38:40.640174+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:14.673448+0000","scrub_duration":0.0046948529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":11430,"num_write":325,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'139","reported_seq":179,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.093847+0000","last_change":"2023-10-18T11:38:30.093847+0000","last_active":"2023-10-18T11:38:30.093847+0000","last_peered":"2023-10-18T11:38:30.093847+0000","last_clean":"2023-10-18T11:38:30.093847+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:38:30.093847+0000","last_undegraded":"2023-10-18T11:38:30.093847+0000","last_fullsized":"2023-10-18T11:38:30.093847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'139","last_scrub_stamp":"2023-10-18T11:38:30.093539+0000","last_deep_scrub":"31'139","last_deep_scrub_stamp":"2023-10-18T11:38:30.093539+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.093539+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:04.126814+0000","scrub_duration":0.0040762330000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'486","reported_seq":529,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.714481+0000","last_change":"2023-10-18T11:38:15.714604+0000","last_active":"2023-10-18T11:38:15.714481+0000","last_peered":"2023-10-18T11:38:15.714481+0000","last_clean":"2023-10-18T11:38:15.714481+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:38:15.714481+0000","last_undegraded":"2023-10-18T11:38:15.714481+0000","last_fullsized":"2023-10-18T11:38:15.714481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'486","last_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_deep_scrub":"31'486","last_deep_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.714323+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:22:01.854784+0000","scrub_duration":0.005976121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'427","reported_seq":528,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:44.740500+0000","last_change":"2023-10-18T11:38:44.740500+0000","last_active":"2023-10-18T11:38:44.740500+0000","last_peered":"2023-10-18T11:38:44.740500+0000","last_clean":"2023-10-18T11:38:44.740500+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:38:44.740500+0000","last_undegraded":"2023-10-18T11:38:44.740500+0000","last_fullsized":"2023-10-18T11:38:44.740500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'427","last_scrub_stamp":"2023-10-18T11:38:44.740345+0000","last_deep_scrub":"31'427","last_deep_scrub_stamp":"2023-10-18T11:38:44.740345+0000","last_clean_scrub_stamp":"2023-10-18T11:38:44.740345+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:03.076796+0000","scrub_duration":0.0046967049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":327,"num_write_kb":17650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'148","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.949313+0000","last_change":"2023-10-18T11:38:14.949444+0000","last_active":"2023-10-18T11:38:14.949313+0000","last_peered":"2023-10-18T11:38:14.949313+0000","last_clean":"2023-10-18T11:38:14.949313+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:38:14.949313+0000","last_undegraded":"2023-10-18T11:38:14.949313+0000","last_fullsized":"2023-10-18T11:38:14.949313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.949157+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:41:56.369387+0000","scrub_duration":0.0041327179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'284","reported_seq":327,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.832954+0000","last_change":"2023-10-18T11:38:21.833085+0000","last_active":"2023-10-18T11:38:21.832954+0000","last_peered":"2023-10-18T11:38:21.832954+0000","last_clean":"2023-10-18T11:38:21.832954+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:38:21.832954+0000","last_undegraded":"2023-10-18T11:38:21.832954+0000","last_fullsized":"2023-10-18T11:38:21.832954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'284","last_scrub_stamp":"2023-10-18T11:38:21.832756+0000","last_deep_scrub":"31'284","last_deep_scrub_stamp":"2023-10-18T11:38:21.832756+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.832756+0000","objects_scrubbed":4,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:25.405192+0000","scrub_duration":0.011219165,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'423","reported_seq":489,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:44.599182+0000","last_change":"2023-10-18T11:38:44.599463+0000","last_active":"2023-10-18T11:38:44.599182+0000","last_peered":"2023-10-18T11:38:44.599182+0000","last_clean":"2023-10-18T11:38:44.599182+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:38:44.599182+0000","last_undegraded":"2023-10-18T11:38:44.599182+0000","last_fullsized":"2023-10-18T11:38:44.599182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'423","last_scrub_stamp":"2023-10-18T11:38:44.598911+0000","last_deep_scrub":"31'423","last_deep_scrub_stamp":"2023-10-18T11:38:44.598911+0000","last_clean_scrub_stamp":"2023-10-18T11:38:44.598911+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:30.414039+0000","scrub_duration":0.0060615870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":324,"num_write_kb":16893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'124","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.596521+0000","last_change":"2023-10-18T11:38:16.596581+0000","last_active":"2023-10-18T11:38:16.596521+0000","last_peered":"2023-10-18T11:38:16.596521+0000","last_clean":"2023-10-18T11:38:16.596521+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:38:16.596521+0000","last_undegraded":"2023-10-18T11:38:16.596521+0000","last_fullsized":"2023-10-18T11:38:16.596521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'124","last_scrub_stamp":"2023-10-18T11:38:16.596449+0000","last_deep_scrub":"31'124","last_deep_scrub_stamp":"2023-10-18T11:38:16.596449+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.596449+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:46:57.233493+0000","scrub_duration":0.001755993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'9","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:40.590744+0000","last_change":"2023-10-18T11:38:40.590786+0000","last_active":"2023-10-18T11:38:40.590744+0000","last_peered":"2023-10-18T11:38:40.590744+0000","last_clean":"2023-10-18T11:38:40.590744+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:38:40.590744+0000","last_undegraded":"2023-10-18T11:38:40.590744+0000","last_fullsized":"2023-10-18T11:38:40.590744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-10-18T11:38:40.590681+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-10-18T11:38:40.590681+0000","last_clean_scrub_stamp":"2023-10-18T11:38:40.590681+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:12:10.767078+0000","scrub_duration":0.0057985620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'432","reported_seq":625,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:33.633067+0000","last_change":"2023-10-18T11:38:33.633067+0000","last_active":"2023-10-18T11:38:33.633067+0000","last_peered":"2023-10-18T11:38:33.633067+0000","last_clean":"2023-10-18T11:38:33.633067+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:38:33.633067+0000","last_undegraded":"2023-10-18T11:38:33.633067+0000","last_fullsized":"2023-10-18T11:38:33.633067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'432","last_scrub_stamp":"2023-10-18T11:38:33.632896+0000","last_deep_scrub":"31'432","last_deep_scrub_stamp":"2023-10-18T11:38:33.632896+0000","last_clean_scrub_stamp":"2023-10-18T11:38:33.632896+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:47.787602+0000","scrub_duration":0.0053552069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":19825,"num_write":333,"num_write_kb":19445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'132","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:28.012524+0000","last_change":"2023-10-18T11:38:28.012708+0000","last_active":"2023-10-18T11:38:28.012524+0000","last_peered":"2023-10-18T11:38:28.012524+0000","last_clean":"2023-10-18T11:38:28.012524+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:38:28.012524+0000","last_undegraded":"2023-10-18T11:38:28.012524+0000","last_fullsized":"2023-10-18T11:38:28.012524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2023-10-18T11:38:28.012283+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2023-10-18T11:38:28.012283+0000","last_clean_scrub_stamp":"2023-10-18T11:38:28.012283+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:02.045557+0000","scrub_duration":0.0049242060000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'17","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.715097+0000","last_change":"2023-10-18T11:38:18.715180+0000","last_active":"2023-10-18T11:38:18.715097+0000","last_peered":"2023-10-18T11:38:18.715097+0000","last_clean":"2023-10-18T11:38:18.715097+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:38:18.715097+0000","last_undegraded":"2023-10-18T11:38:18.715097+0000","last_fullsized":"2023-10-18T11:38:18.715097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'17","last_scrub_stamp":"2023-10-18T11:38:18.715002+0000","last_deep_scrub":"31'17","last_deep_scrub_stamp":"2023-10-18T11:38:18.715002+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.715002+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:34.623209+0000","scrub_duration":0.0046622959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'438","reported_seq":530,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.622058+0000","last_change":"2023-10-18T11:38:30.622058+0000","last_active":"2023-10-18T11:38:30.622058+0000","last_peered":"2023-10-18T11:38:30.622058+0000","last_clean":"2023-10-18T11:38:30.622058+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:38:30.622058+0000","last_undegraded":"2023-10-18T11:38:30.622058+0000","last_fullsized":"2023-10-18T11:38:30.622058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'438","last_scrub_stamp":"2023-10-18T11:38:30.621913+0000","last_deep_scrub":"31'438","last_deep_scrub_stamp":"2023-10-18T11:38:30.621913+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.621913+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:04.843486+0000","scrub_duration":0.0026375550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":16856,"num_write":335,"num_write_kb":23716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'142","reported_seq":182,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.111901+0000","last_change":"2023-10-18T11:38:38.112111+0000","last_active":"2023-10-18T11:38:38.111901+0000","last_peered":"2023-10-18T11:38:38.111901+0000","last_clean":"2023-10-18T11:38:38.111901+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:38:38.111901+0000","last_undegraded":"2023-10-18T11:38:38.111901+0000","last_fullsized":"2023-10-18T11:38:38.111901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:38.111667+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:38.111667+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.111667+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:12:08.288064+0000","scrub_duration":0.0040221160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'292","reported_seq":335,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:22.871865+0000","last_change":"2023-10-18T11:38:22.872065+0000","last_active":"2023-10-18T11:38:22.871865+0000","last_peered":"2023-10-18T11:38:22.871865+0000","last_clean":"2023-10-18T11:38:22.871865+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:38:22.871865+0000","last_undegraded":"2023-10-18T11:38:22.871865+0000","last_fullsized":"2023-10-18T11:38:22.871865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'292","last_scrub_stamp":"2023-10-18T11:38:22.871678+0000","last_deep_scrub":"31'292","last_deep_scrub_stamp":"2023-10-18T11:38:22.871678+0000","last_clean_scrub_stamp":"2023-10-18T11:38:22.871678+0000","objects_scrubbed":4,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:37.026385+0000","scrub_duration":0.014122981999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'450","reported_seq":544,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:13.938382+0000","last_change":"2023-10-18T11:39:13.938556+0000","last_active":"2023-10-18T11:39:13.938382+0000","last_peered":"2023-10-18T11:39:13.938382+0000","last_clean":"2023-10-18T11:39:13.938382+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:39:13.938382+0000","last_undegraded":"2023-10-18T11:39:13.938382+0000","last_fullsized":"2023-10-18T11:39:13.938382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'450","last_scrub_stamp":"2023-10-18T11:39:13.938180+0000","last_deep_scrub":"31'450","last_deep_scrub_stamp":"2023-10-18T11:39:13.938180+0000","last_clean_scrub_stamp":"2023-10-18T11:39:13.938180+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:38.628933+0000","scrub_duration":0.0066451879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":337,"num_write_kb":25264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'150","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.964725+0000","last_change":"2023-10-18T11:38:30.964725+0000","last_active":"2023-10-18T11:38:30.964725+0000","last_peered":"2023-10-18T11:38:30.964725+0000","last_clean":"2023-10-18T11:38:30.964725+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:38:30.964725+0000","last_undegraded":"2023-10-18T11:38:30.964725+0000","last_fullsized":"2023-10-18T11:38:30.964725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2023-10-18T11:38:30.964435+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2023-10-18T11:38:30.964435+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.964435+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:36.004808+0000","scrub_duration":0.0040942510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'245","reported_seq":289,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.473647+0000","last_change":"2023-10-18T11:38:29.473647+0000","last_active":"2023-10-18T11:38:29.473647+0000","last_peered":"2023-10-18T11:38:29.473647+0000","last_clean":"2023-10-18T11:38:29.473647+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:38:29.473647+0000","last_undegraded":"2023-10-18T11:38:29.473647+0000","last_fullsized":"2023-10-18T11:38:29.473647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'245","last_scrub_stamp":"2023-10-18T11:38:29.473550+0000","last_deep_scrub":"31'245","last_deep_scrub_stamp":"2023-10-18T11:38:29.473550+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.473550+0000","objects_scrubbed":3,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:43.628257+0000","scrub_duration":0.0080227579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'490","reported_seq":572,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:59.121635+0000","last_change":"2023-10-18T11:38:59.121848+0000","last_active":"2023-10-18T11:38:59.121635+0000","last_peered":"2023-10-18T11:38:59.121635+0000","last_clean":"2023-10-18T11:38:59.121635+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:38:59.121635+0000","last_undegraded":"2023-10-18T11:38:59.121635+0000","last_fullsized":"2023-10-18T11:38:59.121635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'490","last_scrub_stamp":"2023-10-18T11:38:59.121469+0000","last_deep_scrub":"31'490","last_deep_scrub_stamp":"2023-10-18T11:38:59.121469+0000","last_clean_scrub_stamp":"2023-10-18T11:38:59.121469+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:48:42.729260+0000","scrub_duration":0.0050932360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":390,"num_write_kb":31170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'172","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:46.168808+0000","last_change":"2023-10-18T11:38:46.168808+0000","last_active":"2023-10-18T11:38:46.168808+0000","last_peered":"2023-10-18T11:38:46.168808+0000","last_clean":"2023-10-18T11:38:46.168808+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:38:46.168808+0000","last_undegraded":"2023-10-18T11:38:46.168808+0000","last_fullsized":"2023-10-18T11:38:46.168808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'172","last_scrub_stamp":"2023-10-18T11:38:46.168705+0000","last_deep_scrub":"31'172","last_deep_scrub_stamp":"2023-10-18T11:38:46.168705+0000","last_clean_scrub_stamp":"2023-10-18T11:38:46.168705+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:43:35.619956+0000","scrub_duration":0.0025812449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'791","reported_seq":835,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.776538+0000","last_change":"2023-10-18T11:38:13.776538+0000","last_active":"2023-10-18T11:38:13.776538+0000","last_peered":"2023-10-18T11:38:13.776538+0000","last_clean":"2023-10-18T11:38:13.776538+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:38:13.776538+0000","last_undegraded":"2023-10-18T11:38:13.776538+0000","last_fullsized":"2023-10-18T11:38:13.776538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'791","last_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_deep_scrub":"31'791","last_deep_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.776362+0000","objects_scrubbed":1,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.684568+0000","scrub_duration":0.035930087999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'468","reported_seq":537,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:48.991355+0000","last_change":"2023-10-18T11:38:48.991355+0000","last_active":"2023-10-18T11:38:48.991355+0000","last_peered":"2023-10-18T11:38:48.991355+0000","last_clean":"2023-10-18T11:38:48.991355+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:38:48.991355+0000","last_undegraded":"2023-10-18T11:38:48.991355+0000","last_fullsized":"2023-10-18T11:38:48.991355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'468","last_scrub_stamp":"2023-10-18T11:38:48.990848+0000","last_deep_scrub":"31'468","last_deep_scrub_stamp":"2023-10-18T11:38:48.990848+0000","last_clean_scrub_stamp":"2023-10-18T11:38:48.990848+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:53.651083+0000","scrub_duration":0.0055479769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":9414,"num_write":343,"num_write_kb":17104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'148","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:24.579369+0000","last_change":"2023-10-18T11:38:24.579369+0000","last_active":"2023-10-18T11:38:24.579369+0000","last_peered":"2023-10-18T11:38:24.579369+0000","last_clean":"2023-10-18T11:38:24.579369+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:38:24.579369+0000","last_undegraded":"2023-10-18T11:38:24.579369+0000","last_fullsized":"2023-10-18T11:38:24.579369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-10-18T11:38:24.579245+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-10-18T11:38:24.579245+0000","last_clean_scrub_stamp":"2023-10-18T11:38:24.579245+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:05.999475+0000","scrub_duration":0.00254185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1651","reported_seq":1695,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.284837+0000","last_change":"2023-10-18T11:38:26.284837+0000","last_active":"2023-10-18T11:38:26.284837+0000","last_peered":"2023-10-18T11:38:26.284837+0000","last_clean":"2023-10-18T11:38:26.284837+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:38:26.284837+0000","last_undegraded":"2023-10-18T11:38:26.284837+0000","last_fullsized":"2023-10-18T11:38:26.284837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1651","last_scrub_stamp":"2023-10-18T11:38:26.284633+0000","last_deep_scrub":"31'1651","last_deep_scrub_stamp":"2023-10-18T11:38:26.284633+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.284633+0000","objects_scrubbed":3,"log_size":1651,"log_dups_size":0,"ondisk_log_size":1651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:00.506206+0000","scrub_duration":0.080692793999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1639,"num_write_kb":9112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'412","reported_seq":507,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:59.080288+0000","last_change":"2023-10-18T11:38:59.080504+0000","last_active":"2023-10-18T11:38:59.080288+0000","last_peered":"2023-10-18T11:38:59.080288+0000","last_clean":"2023-10-18T11:38:59.080288+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:38:59.080288+0000","last_undegraded":"2023-10-18T11:38:59.080288+0000","last_fullsized":"2023-10-18T11:38:59.080288+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'412","last_scrub_stamp":"2023-10-18T11:38:59.080117+0000","last_deep_scrub":"31'412","last_deep_scrub_stamp":"2023-10-18T11:38:59.080117+0000","last_clean_scrub_stamp":"2023-10-18T11:38:59.080117+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:51:45.539656+0000","scrub_duration":0.0072235390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":14478,"num_write":303,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'145","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:36.940989+0000","last_change":"2023-10-18T11:38:36.941113+0000","last_active":"2023-10-18T11:38:36.940989+0000","last_peered":"2023-10-18T11:38:36.940989+0000","last_clean":"2023-10-18T11:38:36.940989+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:38:36.940989+0000","last_undegraded":"2023-10-18T11:38:36.940989+0000","last_fullsized":"2023-10-18T11:38:36.940989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:36.940776+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:36.940776+0000","last_clean_scrub_stamp":"2023-10-18T11:38:36.940776+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:57:35.154973+0000","scrub_duration":0.0037340989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'1267","reported_seq":1768,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.829671+0000","last_change":"2023-10-18T11:38:18.829671+0000","last_active":"2023-10-18T11:38:18.829671+0000","last_peered":"2023-10-18T11:38:18.829671+0000","last_clean":"2023-10-18T11:38:18.829671+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:38:18.829671+0000","last_undegraded":"2023-10-18T11:38:18.829671+0000","last_fullsized":"2023-10-18T11:38:18.829671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1267","last_scrub_stamp":"2023-10-18T11:38:18.829387+0000","last_deep_scrub":"31'1267","last_deep_scrub_stamp":"2023-10-18T11:38:18.829387+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.829387+0000","objects_scrubbed":5,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:33:56.899504+0000","scrub_duration":0.050335492000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4329052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":492,"num_write":1258,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'421","reported_seq":536,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:54.024248+0000","last_change":"2023-10-18T11:38:54.024444+0000","last_active":"2023-10-18T11:38:54.024248+0000","last_peered":"2023-10-18T11:38:54.024248+0000","last_clean":"2023-10-18T11:38:54.024248+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:38:54.024248+0000","last_undegraded":"2023-10-18T11:38:54.024248+0000","last_fullsized":"2023-10-18T11:38:54.024248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'421","last_scrub_stamp":"2023-10-18T11:38:54.024078+0000","last_deep_scrub":"31'421","last_deep_scrub_stamp":"2023-10-18T11:38:54.024078+0000","last_clean_scrub_stamp":"2023-10-18T11:38:54.024078+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:36.911182+0000","scrub_duration":0.0068162250000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":19812,"num_write":327,"num_write_kb":12739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'143","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.055509+0000","last_change":"2023-10-18T11:38:18.055509+0000","last_active":"2023-10-18T11:38:18.055509+0000","last_peered":"2023-10-18T11:38:18.055509+0000","last_clean":"2023-10-18T11:38:18.055509+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:38:18.055509+0000","last_undegraded":"2023-10-18T11:38:18.055509+0000","last_fullsized":"2023-10-18T11:38:18.055509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'143","last_scrub_stamp":"2023-10-18T11:38:18.055229+0000","last_deep_scrub":"31'143","last_deep_scrub_stamp":"2023-10-18T11:38:18.055229+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.055229+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:21.627664+0000","scrub_duration":0.0029786410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'377","reported_seq":421,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.593054+0000","last_change":"2023-10-18T11:38:37.593095+0000","last_active":"2023-10-18T11:38:37.593054+0000","last_peered":"2023-10-18T11:38:37.593054+0000","last_clean":"2023-10-18T11:38:37.593054+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:38:37.593054+0000","last_undegraded":"2023-10-18T11:38:37.593054+0000","last_fullsized":"2023-10-18T11:38:37.593054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'377","last_scrub_stamp":"2023-10-18T11:38:37.592987+0000","last_deep_scrub":"31'377","last_deep_scrub_stamp":"2023-10-18T11:38:37.592987+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.592987+0000","objects_scrubbed":2,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:03:20.703498+0000","scrub_duration":0.020092005999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956517,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'424","reported_seq":525,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:52.127431+0000","last_change":"2023-10-18T11:38:52.127595+0000","last_active":"2023-10-18T11:38:52.127431+0000","last_peered":"2023-10-18T11:38:52.127431+0000","last_clean":"2023-10-18T11:38:52.127431+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:38:52.127431+0000","last_undegraded":"2023-10-18T11:38:52.127431+0000","last_fullsized":"2023-10-18T11:38:52.127431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'424","last_scrub_stamp":"2023-10-18T11:38:52.127271+0000","last_deep_scrub":"31'424","last_deep_scrub_stamp":"2023-10-18T11:38:52.127271+0000","last_clean_scrub_stamp":"2023-10-18T11:38:52.127271+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:47:05.785782+0000","scrub_duration":0.006042141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":329,"num_write_kb":22819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'140","reported_seq":181,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:53.019020+0000","last_change":"2023-10-18T11:38:53.019150+0000","last_active":"2023-10-18T11:38:53.019020+0000","last_peered":"2023-10-18T11:38:53.019020+0000","last_clean":"2023-10-18T11:38:53.019020+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:38:53.019020+0000","last_undegraded":"2023-10-18T11:38:53.019020+0000","last_fullsized":"2023-10-18T11:38:53.019020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'140","last_scrub_stamp":"2023-10-18T11:38:53.018795+0000","last_deep_scrub":"31'140","last_deep_scrub_stamp":"2023-10-18T11:38:53.018795+0000","last_clean_scrub_stamp":"2023-10-18T11:38:53.018795+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:57.679029+0000","scrub_duration":0.0031559790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.202419+0000","last_change":"2023-10-18T11:38:29.202419+0000","last_active":"2023-10-18T11:38:29.202419+0000","last_peered":"2023-10-18T11:38:29.202419+0000","last_clean":"2023-10-18T11:38:29.202419+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:38:29.202419+0000","last_undegraded":"2023-10-18T11:38:29.202419+0000","last_fullsized":"2023-10-18T11:38:29.202419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-10-18T11:38:29.202254+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-10-18T11:38:29.202254+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.202254+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:32.774689+0000","scrub_duration":0.011167610999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":198,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:19.573886+0000","last_change":"2023-10-18T11:38:19.573937+0000","last_active":"2023-10-18T11:38:19.573886+0000","last_peered":"2023-10-18T11:38:19.573886+0000","last_clean":"2023-10-18T11:38:19.573886+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:38:19.573886+0000","last_undegraded":"2023-10-18T11:38:19.573886+0000","last_fullsized":"2023-10-18T11:38:19.573886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-10-18T11:38:19.573815+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-10-18T11:38:19.573815+0000","last_clean_scrub_stamp":"2023-10-18T11:38:19.573815+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:22.392143+0000","scrub_duration":0.0092019140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'526","reported_seq":641,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.527039+0000","last_change":"2023-10-18T11:38:51.527039+0000","last_active":"2023-10-18T11:38:51.527039+0000","last_peered":"2023-10-18T11:38:51.527039+0000","last_clean":"2023-10-18T11:38:51.527039+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:38:51.527039+0000","last_undegraded":"2023-10-18T11:38:51.527039+0000","last_fullsized":"2023-10-18T11:38:51.527039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'526","last_scrub_stamp":"2023-10-18T11:38:51.526893+0000","last_deep_scrub":"31'526","last_deep_scrub_stamp":"2023-10-18T11:38:51.526893+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.526893+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:39:16.674574+0000","scrub_duration":0.003785755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":19822,"num_write":415,"num_write_kb":19524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'153","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:56.721242+0000","last_change":"2023-10-18T11:38:56.721288+0000","last_active":"2023-10-18T11:38:56.721242+0000","last_peered":"2023-10-18T11:38:56.721242+0000","last_clean":"2023-10-18T11:38:56.721242+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:38:56.721242+0000","last_undegraded":"2023-10-18T11:38:56.721242+0000","last_fullsized":"2023-10-18T11:38:56.721242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:56.721148+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:56.721148+0000","last_clean_scrub_stamp":"2023-10-18T11:38:56.721148+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:39.608251+0000","scrub_duration":0.001787432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'902","reported_seq":945,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.776996+0000","last_change":"2023-10-18T11:38:21.776996+0000","last_active":"2023-10-18T11:38:21.776996+0000","last_peered":"2023-10-18T11:38:21.776996+0000","last_clean":"2023-10-18T11:38:21.776996+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:38:21.776996+0000","last_undegraded":"2023-10-18T11:38:21.776996+0000","last_fullsized":"2023-10-18T11:38:21.776996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'902","last_scrub_stamp":"2023-10-18T11:38:21.776574+0000","last_deep_scrub":"31'902","last_deep_scrub_stamp":"2023-10-18T11:38:21.776574+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.776574+0000","objects_scrubbed":3,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:47:08.842481+0000","scrub_duration":0.042635698999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'411","reported_seq":531,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:06.609547+0000","last_change":"2023-10-18T11:39:06.609604+0000","last_active":"2023-10-18T11:39:06.609547+0000","last_peered":"2023-10-18T11:39:06.609547+0000","last_clean":"2023-10-18T11:39:06.609547+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:39:06.609547+0000","last_undegraded":"2023-10-18T11:39:06.609547+0000","last_fullsized":"2023-10-18T11:39:06.609547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'411","last_scrub_stamp":"2023-10-18T11:39:06.609469+0000","last_deep_scrub":"31'411","last_deep_scrub_stamp":"2023-10-18T11:39:06.609469+0000","last_clean_scrub_stamp":"2023-10-18T11:39:06.609469+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:48:50.217261+0000","scrub_duration":0.0051196439999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":18796,"num_write":308,"num_write_kb":13390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'137","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:48.136433+0000","last_change":"2023-10-18T11:38:48.136433+0000","last_active":"2023-10-18T11:38:48.136433+0000","last_peered":"2023-10-18T11:38:48.136433+0000","last_clean":"2023-10-18T11:38:48.136433+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:38:48.136433+0000","last_undegraded":"2023-10-18T11:38:48.136433+0000","last_fullsized":"2023-10-18T11:38:48.136433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:48.136304+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:48.136304+0000","last_clean_scrub_stamp":"2023-10-18T11:38:48.136304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:52.796538+0000","scrub_duration":0.002452236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'1294","reported_seq":1337,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.833782+0000","last_change":"2023-10-18T11:38:16.833782+0000","last_active":"2023-10-18T11:38:16.833782+0000","last_peered":"2023-10-18T11:38:16.833782+0000","last_clean":"2023-10-18T11:38:16.833782+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:38:16.833782+0000","last_undegraded":"2023-10-18T11:38:16.833782+0000","last_fullsized":"2023-10-18T11:38:16.833782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1294","last_scrub_stamp":"2023-10-18T11:38:16.833369+0000","last_deep_scrub":"31'1294","last_deep_scrub_stamp":"2023-10-18T11:38:16.833369+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.833369+0000","objects_scrubbed":3,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:19.651697+0000","scrub_duration":0.079856599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7520929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1284,"num_write_kb":8040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'435","reported_seq":558,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.918512+0000","last_change":"2023-10-18T11:38:38.918512+0000","last_active":"2023-10-18T11:38:38.918512+0000","last_peered":"2023-10-18T11:38:38.918512+0000","last_clean":"2023-10-18T11:38:38.918512+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:38:38.918512+0000","last_undegraded":"2023-10-18T11:38:38.918512+0000","last_fullsized":"2023-10-18T11:38:38.918512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'435","last_scrub_stamp":"2023-10-18T11:38:38.918083+0000","last_deep_scrub":"31'435","last_deep_scrub_stamp":"2023-10-18T11:38:38.918083+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.918083+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:43:28.369335+0000","scrub_duration":0.0060519450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":340,"num_write_kb":14424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'136","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:05.760733+0000","last_change":"2023-10-18T11:39:05.760783+0000","last_active":"2023-10-18T11:39:05.760733+0000","last_peered":"2023-10-18T11:39:05.760733+0000","last_clean":"2023-10-18T11:39:05.760733+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:39:05.760733+0000","last_undegraded":"2023-10-18T11:39:05.760733+0000","last_fullsized":"2023-10-18T11:39:05.760733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'136","last_scrub_stamp":"2023-10-18T11:39:05.760647+0000","last_deep_scrub":"31'136","last_deep_scrub_stamp":"2023-10-18T11:39:05.760647+0000","last_clean_scrub_stamp":"2023-10-18T11:39:05.760647+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:25:38.573943+0000","scrub_duration":0.0018971999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'9","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.700844+0000","last_change":"2023-10-18T11:38:23.700844+0000","last_active":"2023-10-18T11:38:23.700844+0000","last_peered":"2023-10-18T11:38:23.700844+0000","last_clean":"2023-10-18T11:38:23.700844+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:38:23.700844+0000","last_undegraded":"2023-10-18T11:38:23.700844+0000","last_fullsized":"2023-10-18T11:38:23.700844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-10-18T11:38:23.700596+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-10-18T11:38:23.700596+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.700596+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:47:43.822850+0000","scrub_duration":0.0075550569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'409","reported_seq":507,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:54.030278+0000","last_change":"2023-10-18T11:38:54.030372+0000","last_active":"2023-10-18T11:38:54.030278+0000","last_peered":"2023-10-18T11:38:54.030278+0000","last_clean":"2023-10-18T11:38:54.030278+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:38:54.030278+0000","last_undegraded":"2023-10-18T11:38:54.030278+0000","last_fullsized":"2023-10-18T11:38:54.030278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'409","last_scrub_stamp":"2023-10-18T11:38:54.030199+0000","last_deep_scrub":"31'409","last_deep_scrub_stamp":"2023-10-18T11:38:54.030199+0000","last_clean_scrub_stamp":"2023-10-18T11:38:54.030199+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:08:11.779372+0000","scrub_duration":0.0025696439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":17064,"num_write":295,"num_write_kb":17834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'136","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.655098+0000","last_change":"2023-10-18T11:38:51.655098+0000","last_active":"2023-10-18T11:38:51.655098+0000","last_peered":"2023-10-18T11:38:51.655098+0000","last_clean":"2023-10-18T11:38:51.655098+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:38:51.655098+0000","last_undegraded":"2023-10-18T11:38:51.655098+0000","last_fullsized":"2023-10-18T11:38:51.655098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'136","last_scrub_stamp":"2023-10-18T11:38:51.654982+0000","last_deep_scrub":"31'136","last_deep_scrub_stamp":"2023-10-18T11:38:51.654982+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.654982+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:26:13.696712+0000","scrub_duration":0.0012451610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'255","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.648486+0000","last_change":"2023-10-18T11:38:13.648486+0000","last_active":"2023-10-18T11:38:13.648486+0000","last_peered":"2023-10-18T11:38:13.648486+0000","last_clean":"2023-10-18T11:38:13.648486+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:38:13.648486+0000","last_undegraded":"2023-10-18T11:38:13.648486+0000","last_fullsized":"2023-10-18T11:38:13.648486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'255","last_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_deep_scrub":"31'255","last_deep_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.648347+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:37.829270+0000","scrub_duration":0.0050540170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'390","reported_seq":467,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.598810+0000","last_change":"2023-10-18T11:38:31.598864+0000","last_active":"2023-10-18T11:38:31.598810+0000","last_peered":"2023-10-18T11:38:31.598810+0000","last_clean":"2023-10-18T11:38:31.598810+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:38:31.598810+0000","last_undegraded":"2023-10-18T11:38:31.598810+0000","last_fullsized":"2023-10-18T11:38:31.598810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'390","last_scrub_stamp":"2023-10-18T11:38:31.598740+0000","last_deep_scrub":"31'390","last_deep_scrub_stamp":"2023-10-18T11:38:31.598740+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.598740+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:35.171175+0000","scrub_duration":0.0040497909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":302,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'129","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:45.651434+0000","last_change":"2023-10-18T11:38:45.651499+0000","last_active":"2023-10-18T11:38:45.651434+0000","last_peered":"2023-10-18T11:38:45.651434+0000","last_clean":"2023-10-18T11:38:45.651434+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:38:45.651434+0000","last_undegraded":"2023-10-18T11:38:45.651434+0000","last_fullsized":"2023-10-18T11:38:45.651434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2023-10-18T11:38:45.651347+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2023-10-18T11:38:45.651347+0000","last_clean_scrub_stamp":"2023-10-18T11:38:45.651347+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:50.603822+0000","scrub_duration":0.0013624469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'1801","reported_seq":1843,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.945745+0000","last_change":"2023-10-18T11:38:16.945923+0000","last_active":"2023-10-18T11:38:16.945745+0000","last_peered":"2023-10-18T11:38:16.945745+0000","last_clean":"2023-10-18T11:38:16.945745+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:38:16.945745+0000","last_undegraded":"2023-10-18T11:38:16.945745+0000","last_fullsized":"2023-10-18T11:38:16.945745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1801","last_scrub_stamp":"2023-10-18T11:38:16.945606+0000","last_deep_scrub":"31'1801","last_deep_scrub_stamp":"2023-10-18T11:38:16.945606+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.945606+0000","objects_scrubbed":10,"log_size":1801,"log_dups_size":0,"ondisk_log_size":1801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:06:47.403273+0000","scrub_duration":0.099502073999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":9197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'468","reported_seq":560,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:06.104689+0000","last_change":"2023-10-18T11:39:06.104917+0000","last_active":"2023-10-18T11:39:06.104689+0000","last_peered":"2023-10-18T11:39:06.104689+0000","last_clean":"2023-10-18T11:39:06.104689+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:39:06.104689+0000","last_undegraded":"2023-10-18T11:39:06.104689+0000","last_fullsized":"2023-10-18T11:39:06.104689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'468","last_scrub_stamp":"2023-10-18T11:39:06.104515+0000","last_deep_scrub":"31'468","last_deep_scrub_stamp":"2023-10-18T11:39:06.104515+0000","last_clean_scrub_stamp":"2023-10-18T11:39:06.104515+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:53:19.069409+0000","scrub_duration":0.0065353920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":372,"num_write_kb":11119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'118","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:27.563554+0000","last_change":"2023-10-18T11:38:27.563591+0000","last_active":"2023-10-18T11:38:27.563554+0000","last_peered":"2023-10-18T11:38:27.563554+0000","last_clean":"2023-10-18T11:38:27.563554+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:38:27.563554+0000","last_undegraded":"2023-10-18T11:38:27.563554+0000","last_fullsized":"2023-10-18T11:38:27.563554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'118","last_scrub_stamp":"2023-10-18T11:38:27.563488+0000","last_deep_scrub":"31'118","last_deep_scrub_stamp":"2023-10-18T11:38:27.563488+0000","last_clean_scrub_stamp":"2023-10-18T11:38:27.563488+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:31:20.292085+0000","scrub_duration":0.0024232849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'912","reported_seq":954,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.721666+0000","last_change":"2023-10-18T11:38:15.721730+0000","last_active":"2023-10-18T11:38:15.721666+0000","last_peered":"2023-10-18T11:38:15.721666+0000","last_clean":"2023-10-18T11:38:15.721666+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:38:15.721666+0000","last_undegraded":"2023-10-18T11:38:15.721666+0000","last_fullsized":"2023-10-18T11:38:15.721666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'912","last_scrub_stamp":"2023-10-18T11:38:15.721600+0000","last_deep_scrub":"31'912","last_deep_scrub_stamp":"2023-10-18T11:38:15.721600+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.721600+0000","objects_scrubbed":3,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:47:35.843854+0000","scrub_duration":0.019590776000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'408","reported_seq":479,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.115417+0000","last_change":"2023-10-18T11:09:46.110761+0000","last_active":"2023-10-18T11:38:12.115417+0000","last_peered":"2023-10-18T11:38:12.115417+0000","last_clean":"2023-10-18T11:38:12.115417+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:38:12.115417+0000","last_undegraded":"2023-10-18T11:38:12.115417+0000","last_fullsized":"2023-10-18T11:38:12.115417+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":10922,"num_write":302,"num_write_kb":9791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.639879+0000","last_change":"2023-10-18T11:38:16.639919+0000","last_active":"2023-10-18T11:38:16.639879+0000","last_peered":"2023-10-18T11:38:16.639879+0000","last_clean":"2023-10-18T11:38:16.639879+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:38:16.639879+0000","last_undegraded":"2023-10-18T11:38:16.639879+0000","last_fullsized":"2023-10-18T11:38:16.639879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:16.639807+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:16.639807+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.639807+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:32.548013+0000","scrub_duration":0.00137429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'1004","reported_seq":1046,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.374765+0000","last_change":"2023-10-18T11:38:14.374816+0000","last_active":"2023-10-18T11:38:14.374765+0000","last_peered":"2023-10-18T11:38:14.374765+0000","last_clean":"2023-10-18T11:38:14.374765+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:38:14.374765+0000","last_undegraded":"2023-10-18T11:38:14.374765+0000","last_fullsized":"2023-10-18T11:38:14.374765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1004","last_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_deep_scrub":"31'1004","last_deep_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.374705+0000","objects_scrubbed":4,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:02:58.873481+0000","scrub_duration":0.027697919000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":4702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'374","reported_seq":456,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:14.902165+0000","last_change":"2023-10-18T11:39:14.902403+0000","last_active":"2023-10-18T11:39:14.902165+0000","last_peered":"2023-10-18T11:39:14.902165+0000","last_clean":"2023-10-18T11:39:14.902165+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:39:14.902165+0000","last_undegraded":"2023-10-18T11:39:14.902165+0000","last_fullsized":"2023-10-18T11:39:14.902165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'374","last_scrub_stamp":"2023-10-18T11:39:14.901992+0000","last_deep_scrub":"31'374","last_deep_scrub_stamp":"2023-10-18T11:39:14.901992+0000","last_clean_scrub_stamp":"2023-10-18T11:39:14.901992+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:34:44.545220+0000","scrub_duration":0.006342154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":12454,"num_write":279,"num_write_kb":12302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.988607+0000","last_change":"2023-10-18T11:38:12.988796+0000","last_active":"2023-10-18T11:38:12.988607+0000","last_peered":"2023-10-18T11:38:12.988607+0000","last_clean":"2023-10-18T11:38:12.988607+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:38:12.988607+0000","last_undegraded":"2023-10-18T11:38:12.988607+0000","last_fullsized":"2023-10-18T11:38:12.988607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.988423+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:04.605203+0000","scrub_duration":0.002583765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'410","reported_seq":843,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:10.019288+0000","last_change":"2023-10-18T11:38:10.019370+0000","last_active":"2023-10-18T11:38:10.019288+0000","last_peered":"2023-10-18T11:38:10.019288+0000","last_clean":"2023-10-18T11:38:10.019288+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:38:10.019288+0000","last_undegraded":"2023-10-18T11:38:10.019288+0000","last_fullsized":"2023-10-18T11:38:10.019288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'410","last_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_deep_scrub":"31'410","last_deep_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_clean_scrub_stamp":"2023-10-18T11:38:10.019192+0000","objects_scrubbed":7,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:01:36.193379+0000","scrub_duration":0.0084515079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":443,"num_write":404,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'508","reported_seq":647,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:55.010298+0000","last_change":"2023-10-18T11:38:55.010367+0000","last_active":"2023-10-18T11:38:55.010298+0000","last_peered":"2023-10-18T11:38:55.010298+0000","last_clean":"2023-10-18T11:38:55.010298+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:38:55.010298+0000","last_undegraded":"2023-10-18T11:38:55.010298+0000","last_fullsized":"2023-10-18T11:38:55.010298+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'508","last_scrub_stamp":"2023-10-18T11:38:55.010215+0000","last_deep_scrub":"31'508","last_deep_scrub_stamp":"2023-10-18T11:38:55.010215+0000","last_clean_scrub_stamp":"2023-10-18T11:38:55.010215+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:41:31.346583+0000","scrub_duration":0.0039544630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":22458,"num_write":413,"num_write_kb":26305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'141","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:46.611066+0000","last_change":"2023-10-18T11:38:46.611114+0000","last_active":"2023-10-18T11:38:46.611066+0000","last_peered":"2023-10-18T11:38:46.611066+0000","last_clean":"2023-10-18T11:38:46.611066+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:38:46.611066+0000","last_undegraded":"2023-10-18T11:38:46.611066+0000","last_fullsized":"2023-10-18T11:38:46.611066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2023-10-18T11:38:46.610979+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2023-10-18T11:38:46.610979+0000","last_clean_scrub_stamp":"2023-10-18T11:38:46.610979+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:43:36.062230+0000","scrub_duration":0.0027168240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1129","reported_seq":1171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.788264+0000","last_change":"2023-10-18T11:38:17.788313+0000","last_active":"2023-10-18T11:38:17.788264+0000","last_peered":"2023-10-18T11:38:17.788264+0000","last_clean":"2023-10-18T11:38:17.788264+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:38:17.788264+0000","last_undegraded":"2023-10-18T11:38:17.788264+0000","last_fullsized":"2023-10-18T11:38:17.788264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1129","last_scrub_stamp":"2023-10-18T11:38:17.788204+0000","last_deep_scrub":"31'1129","last_deep_scrub_stamp":"2023-10-18T11:38:17.788204+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.788204+0000","objects_scrubbed":6,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:02.286980+0000","scrub_duration":0.060761811999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'423","reported_seq":510,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.967827+0000","last_change":"2023-10-18T11:38:51.968035+0000","last_active":"2023-10-18T11:38:51.967827+0000","last_peered":"2023-10-18T11:38:51.967827+0000","last_clean":"2023-10-18T11:38:51.967827+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:38:51.967827+0000","last_undegraded":"2023-10-18T11:38:51.967827+0000","last_fullsized":"2023-10-18T11:38:51.967827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'423","last_scrub_stamp":"2023-10-18T11:38:51.967647+0000","last_deep_scrub":"31'423","last_deep_scrub_stamp":"2023-10-18T11:38:51.967647+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.967647+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:14:42.768322+0000","scrub_duration":0.0062849749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":12954,"num_write":319,"num_write_kb":22076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'121","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.567855+0000","last_change":"2023-10-18T11:38:17.567915+0000","last_active":"2023-10-18T11:38:17.567855+0000","last_peered":"2023-10-18T11:38:17.567855+0000","last_clean":"2023-10-18T11:38:17.567855+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:38:17.567855+0000","last_undegraded":"2023-10-18T11:38:17.567855+0000","last_fullsized":"2023-10-18T11:38:17.567855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'121","last_scrub_stamp":"2023-10-18T11:38:17.567782+0000","last_deep_scrub":"31'121","last_deep_scrub_stamp":"2023-10-18T11:38:17.567782+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.567782+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:02.066559+0000","scrub_duration":0.001187249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'283","reported_seq":325,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.826508+0000","last_change":"2023-10-18T11:38:18.826508+0000","last_active":"2023-10-18T11:38:18.826508+0000","last_peered":"2023-10-18T11:38:18.826508+0000","last_clean":"2023-10-18T11:38:18.826508+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:38:18.826508+0000","last_undegraded":"2023-10-18T11:38:18.826508+0000","last_fullsized":"2023-10-18T11:38:18.826508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'283","last_scrub_stamp":"2023-10-18T11:38:18.826303+0000","last_deep_scrub":"31'283","last_deep_scrub_stamp":"2023-10-18T11:38:18.826303+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.826303+0000","objects_scrubbed":4,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:48.054916+0000","scrub_duration":0.0084837070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'511","reported_seq":609,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:41.657046+0000","last_change":"2023-10-18T11:38:41.657141+0000","last_active":"2023-10-18T11:38:41.657046+0000","last_peered":"2023-10-18T11:38:41.657046+0000","last_clean":"2023-10-18T11:38:41.657046+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:38:41.657046+0000","last_undegraded":"2023-10-18T11:38:41.657046+0000","last_fullsized":"2023-10-18T11:38:41.657046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'511","last_scrub_stamp":"2023-10-18T11:38:41.656966+0000","last_deep_scrub":"31'511","last_deep_scrub_stamp":"2023-10-18T11:38:41.656966+0000","last_clean_scrub_stamp":"2023-10-18T11:38:41.656966+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:55:11.280208+0000","scrub_duration":0.0028387489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":22028,"num_write":389,"num_write_kb":39504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.935436+0000","last_change":"2023-10-18T11:38:32.935436+0000","last_active":"2023-10-18T11:38:32.935436+0000","last_peered":"2023-10-18T11:38:32.935436+0000","last_clean":"2023-10-18T11:38:32.935436+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:38:32.935436+0000","last_undegraded":"2023-10-18T11:38:32.935436+0000","last_fullsized":"2023-10-18T11:38:32.935436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:32.935169+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:32.935169+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.935169+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:09.549069+0000","scrub_duration":0.0036182440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'403","reported_seq":835,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.336342+0000","last_change":"2023-10-18T11:38:15.336342+0000","last_active":"2023-10-18T11:38:15.336342+0000","last_peered":"2023-10-18T11:38:15.336342+0000","last_clean":"2023-10-18T11:38:15.336342+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:38:15.336342+0000","last_undegraded":"2023-10-18T11:38:15.336342+0000","last_fullsized":"2023-10-18T11:38:15.336342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'403","last_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_deep_scrub":"31'403","last_deep_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.336169+0000","objects_scrubbed":3,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:31.244376+0000","scrub_duration":0.0066715740000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180134,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":390,"num_read_kb":469,"num_write":396,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'442","reported_seq":546,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:09.975426+0000","last_change":"2023-10-18T11:39:09.975634+0000","last_active":"2023-10-18T11:39:09.975426+0000","last_peered":"2023-10-18T11:39:09.975426+0000","last_clean":"2023-10-18T11:39:09.975426+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:39:09.975426+0000","last_undegraded":"2023-10-18T11:39:09.975426+0000","last_fullsized":"2023-10-18T11:39:09.975426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'442","last_scrub_stamp":"2023-10-18T11:39:09.975248+0000","last_deep_scrub":"31'442","last_deep_scrub_stamp":"2023-10-18T11:39:09.975248+0000","last_clean_scrub_stamp":"2023-10-18T11:39:09.975248+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:07:08.755270+0000","scrub_duration":0.0061956320000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17404,"num_write":347,"num_write_kb":27808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.029902+0000","last_change":"2023-10-18T11:38:51.029976+0000","last_active":"2023-10-18T11:38:51.029902+0000","last_peered":"2023-10-18T11:38:51.029902+0000","last_clean":"2023-10-18T11:38:51.029902+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:38:51.029902+0000","last_undegraded":"2023-10-18T11:38:51.029902+0000","last_fullsized":"2023-10-18T11:38:51.029902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:51.029809+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:51.029809+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.029809+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:33.916912+0000","scrub_duration":0.0016098009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'189","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:22.612412+0000","last_change":"2023-10-18T11:38:22.612412+0000","last_active":"2023-10-18T11:38:22.612412+0000","last_peered":"2023-10-18T11:38:22.612412+0000","last_clean":"2023-10-18T11:38:22.612412+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:38:22.612412+0000","last_undegraded":"2023-10-18T11:38:22.612412+0000","last_fullsized":"2023-10-18T11:38:22.612412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'189","last_scrub_stamp":"2023-10-18T11:38:22.612315+0000","last_deep_scrub":"31'189","last_deep_scrub_stamp":"2023-10-18T11:38:22.612315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:22.612315+0000","objects_scrubbed":3,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:22:08.752776+0000","scrub_duration":0.0028915519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'380","reported_seq":482,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:11.963423+0000","last_change":"2023-10-18T11:39:11.963568+0000","last_active":"2023-10-18T11:39:11.963423+0000","last_peered":"2023-10-18T11:39:11.963423+0000","last_clean":"2023-10-18T11:39:11.963423+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:39:11.963423+0000","last_undegraded":"2023-10-18T11:39:11.963423+0000","last_fullsized":"2023-10-18T11:39:11.963423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'380","last_scrub_stamp":"2023-10-18T11:39:11.963312+0000","last_deep_scrub":"31'380","last_deep_scrub_stamp":"2023-10-18T11:39:11.963312+0000","last_clean_scrub_stamp":"2023-10-18T11:39:11.963312+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:25:44.776609+0000","scrub_duration":0.004230452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":277,"num_write_kb":11173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'503","reported_seq":594,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:08.132246+0000","last_change":"2023-10-18T11:39:08.132458+0000","last_active":"2023-10-18T11:39:08.132246+0000","last_peered":"2023-10-18T11:39:08.132246+0000","last_clean":"2023-10-18T11:39:08.132246+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:39:08.132246+0000","last_undegraded":"2023-10-18T11:39:08.132246+0000","last_fullsized":"2023-10-18T11:39:08.132246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'503","last_scrub_stamp":"2023-10-18T11:39:08.132072+0000","last_deep_scrub":"31'503","last_deep_scrub_stamp":"2023-10-18T11:39:08.132072+0000","last_clean_scrub_stamp":"2023-10-18T11:39:08.132072+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:07:06.912094+0000","scrub_duration":0.006724654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":392,"num_write_kb":15493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'157","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.000066+0000","last_change":"2023-10-18T11:38:32.000066+0000","last_active":"2023-10-18T11:38:32.000066+0000","last_peered":"2023-10-18T11:38:32.000066+0000","last_clean":"2023-10-18T11:38:32.000066+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:38:32.000066+0000","last_undegraded":"2023-10-18T11:38:32.000066+0000","last_fullsized":"2023-10-18T11:38:32.000066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'157","last_scrub_stamp":"2023-10-18T11:38:31.999671+0000","last_deep_scrub":"31'157","last_deep_scrub_stamp":"2023-10-18T11:38:31.999671+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.999671+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:06.032945+0000","scrub_duration":0.0041825050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'1037","reported_seq":1079,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.385086+0000","last_change":"2023-10-18T11:38:20.385086+0000","last_active":"2023-10-18T11:38:20.385086+0000","last_peered":"2023-10-18T11:38:20.385086+0000","last_clean":"2023-10-18T11:38:20.385086+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:38:20.385086+0000","last_undegraded":"2023-10-18T11:38:20.385086+0000","last_fullsized":"2023-10-18T11:38:20.385086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1037","last_scrub_stamp":"2023-10-18T11:38:20.384953+0000","last_deep_scrub":"31'1037","last_deep_scrub_stamp":"2023-10-18T11:38:20.384953+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.384953+0000","objects_scrubbed":3,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:12.001733+0000","scrub_duration":0.020741213000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":6522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'495","reported_seq":610,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:59.595427+0000","last_change":"2023-10-18T11:38:59.595427+0000","last_active":"2023-10-18T11:38:59.595427+0000","last_peered":"2023-10-18T11:38:59.595427+0000","last_clean":"2023-10-18T11:38:59.595427+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:38:59.595427+0000","last_undegraded":"2023-10-18T11:38:59.595427+0000","last_fullsized":"2023-10-18T11:38:59.595427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'495","last_scrub_stamp":"2023-10-18T11:38:59.595310+0000","last_deep_scrub":"31'495","last_deep_scrub_stamp":"2023-10-18T11:38:59.595310+0000","last_clean_scrub_stamp":"2023-10-18T11:38:59.595310+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:47:13.253821+0000","scrub_duration":0.0041609450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":22638,"num_write":397,"num_write_kb":22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'163","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.936414+0000","last_change":"2023-10-18T11:38:17.936414+0000","last_active":"2023-10-18T11:38:17.936414+0000","last_peered":"2023-10-18T11:38:17.936414+0000","last_clean":"2023-10-18T11:38:17.936414+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:38:17.936414+0000","last_undegraded":"2023-10-18T11:38:17.936414+0000","last_fullsized":"2023-10-18T11:38:17.936414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-10-18T11:38:17.936124+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-10-18T11:38:17.936124+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.936124+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:47.164737+0000","scrub_duration":0.0040074359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'475","reported_seq":981,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.113430+0000","last_change":"2023-10-18T11:38:26.113430+0000","last_active":"2023-10-18T11:38:26.113430+0000","last_peered":"2023-10-18T11:38:26.113430+0000","last_clean":"2023-10-18T11:38:26.113430+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:38:26.113430+0000","last_undegraded":"2023-10-18T11:38:26.113430+0000","last_fullsized":"2023-10-18T11:38:26.113430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'475","last_scrub_stamp":"2023-10-18T11:38:26.113149+0000","last_deep_scrub":"31'475","last_deep_scrub_stamp":"2023-10-18T11:38:26.113149+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.113149+0000","objects_scrubbed":3,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:11.928277+0000","scrub_duration":0.010428636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":464,"num_read_kb":507,"num_write":469,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'1262","reported_seq":1772,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.769789+0000","last_change":"2023-10-18T11:38:16.769841+0000","last_active":"2023-10-18T11:38:16.769789+0000","last_peered":"2023-10-18T11:38:16.769789+0000","last_clean":"2023-10-18T11:38:16.769789+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:38:16.769789+0000","last_undegraded":"2023-10-18T11:38:16.769789+0000","last_fullsized":"2023-10-18T11:38:16.769789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1262","last_scrub_stamp":"2023-10-18T11:38:16.769713+0000","last_deep_scrub":"31'1262","last_deep_scrub_stamp":"2023-10-18T11:38:16.769713+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.769713+0000","objects_scrubbed":5,"log_size":1262,"log_dups_size":0,"ondisk_log_size":1262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:46:57.406757+0000","scrub_duration":0.022924356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4346422,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":505,"num_write":1257,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'154","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:09.051185+0000","last_change":"2023-10-18T11:38:09.051296+0000","last_active":"2023-10-18T11:38:09.051185+0000","last_peered":"2023-10-18T11:38:09.051185+0000","last_clean":"2023-10-18T11:38:09.051185+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:38:09.051185+0000","last_undegraded":"2023-10-18T11:38:09.051185+0000","last_fullsized":"2023-10-18T11:38:09.051185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_clean_scrub_stamp":"2023-10-18T11:38:09.051022+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:26.016569+0000","scrub_duration":0.003629073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'380","reported_seq":485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.730424+0000","last_change":"2023-10-18T11:38:32.730605+0000","last_active":"2023-10-18T11:38:32.730424+0000","last_peered":"2023-10-18T11:38:32.730424+0000","last_clean":"2023-10-18T11:38:32.730424+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:38:32.730424+0000","last_undegraded":"2023-10-18T11:38:32.730424+0000","last_fullsized":"2023-10-18T11:38:32.730424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'380","last_scrub_stamp":"2023-10-18T11:38:32.730250+0000","last_deep_scrub":"31'380","last_deep_scrub_stamp":"2023-10-18T11:38:32.730250+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.730250+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:14.150480+0000","scrub_duration":0.0065888780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":9856,"num_write":276,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2737","reported_seq":2778,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.081157+0000","last_change":"2023-10-18T11:38:20.081285+0000","last_active":"2023-10-18T11:38:20.081157+0000","last_peered":"2023-10-18T11:38:20.081157+0000","last_clean":"2023-10-18T11:38:20.081157+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:38:20.081157+0000","last_undegraded":"2023-10-18T11:38:20.081157+0000","last_fullsized":"2023-10-18T11:38:20.081157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2737","last_scrub_stamp":"2023-10-18T11:38:20.080991+0000","last_deep_scrub":"31'2737","last_deep_scrub_stamp":"2023-10-18T11:38:20.080991+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.080991+0000","objects_scrubbed":4,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:23.653427+0000","scrub_duration":0.118224197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2726,"num_write_kb":13571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'169","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.602939+0000","last_change":"2023-10-18T11:38:15.602980+0000","last_active":"2023-10-18T11:38:15.602939+0000","last_peered":"2023-10-18T11:38:15.602939+0000","last_clean":"2023-10-18T11:38:15.602939+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:38:15.602939+0000","last_undegraded":"2023-10-18T11:38:15.602939+0000","last_fullsized":"2023-10-18T11:38:15.602939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'169","last_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_deep_scrub":"31'169","last_deep_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.602878+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:15:22.593515+0000","scrub_duration":0.0020891960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'415","reported_seq":491,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:37:16.410397+0000","last_change":"2023-10-18T11:09:46.112244+0000","last_active":"2023-10-18T11:37:16.410397+0000","last_peered":"2023-10-18T11:37:16.410397+0000","last_clean":"2023-10-18T11:37:16.410397+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:37:16.410397+0000","last_undegraded":"2023-10-18T11:37:16.410397+0000","last_fullsized":"2023-10-18T11:37:16.410397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T11:09:44.766414+0000","last_clean_scrub_stamp":"2023-10-18T11:09:44.766414+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":317,"num_write_kb":9906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'168","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:43.499206+0000","last_change":"2023-10-18T11:38:43.499206+0000","last_active":"2023-10-18T11:38:43.499206+0000","last_peered":"2023-10-18T11:38:43.499206+0000","last_clean":"2023-10-18T11:38:43.499206+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:38:43.499206+0000","last_undegraded":"2023-10-18T11:38:43.499206+0000","last_fullsized":"2023-10-18T11:38:43.499206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'168","last_scrub_stamp":"2023-10-18T11:38:43.499098+0000","last_deep_scrub":"31'168","last_deep_scrub_stamp":"2023-10-18T11:38:43.499098+0000","last_clean_scrub_stamp":"2023-10-18T11:38:43.499098+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:48.451573+0000","scrub_duration":0.002558608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'156","reported_seq":197,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:25.678385+0000","last_change":"2023-10-18T11:38:25.678385+0000","last_active":"2023-10-18T11:38:25.678385+0000","last_peered":"2023-10-18T11:38:25.678385+0000","last_clean":"2023-10-18T11:38:25.678385+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:38:25.678385+0000","last_undegraded":"2023-10-18T11:38:25.678385+0000","last_fullsized":"2023-10-18T11:38:25.678385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2023-10-18T11:38:25.677969+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2023-10-18T11:38:25.677969+0000","last_clean_scrub_stamp":"2023-10-18T11:38:25.677969+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:47:06.315013+0000","scrub_duration":0.0040068400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'163","reported_seq":195,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:36.692331+0000","last_change":"2023-10-18T11:38:36.692445+0000","last_active":"2023-10-18T11:38:36.692331+0000","last_peered":"2023-10-18T11:38:36.692331+0000","last_clean":"2023-10-18T11:38:36.692331+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:38:36.692331+0000","last_undegraded":"2023-10-18T11:38:36.692331+0000","last_fullsized":"2023-10-18T11:38:36.692331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-10-18T11:38:36.692173+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-10-18T11:38:36.692173+0000","last_clean_scrub_stamp":"2023-10-18T11:38:36.692173+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:39.510500+0000","scrub_duration":0.0037755890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"31'146","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.084653+0000","last_change":"2023-10-18T11:38:16.084653+0000","last_active":"2023-10-18T11:38:16.084653+0000","last_peered":"2023-10-18T11:38:16.084653+0000","last_clean":"2023-10-18T11:38:16.084653+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:38:16.084653+0000","last_undegraded":"2023-10-18T11:38:16.084653+0000","last_fullsized":"2023-10-18T11:38:16.084653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.084368+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:45.312981+0000","scrub_duration":0.0039813269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'131","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:05.988842+0000","last_change":"2023-10-18T11:39:05.988914+0000","last_active":"2023-10-18T11:39:05.988842+0000","last_peered":"2023-10-18T11:39:05.988842+0000","last_clean":"2023-10-18T11:39:05.988842+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:39:05.988842+0000","last_undegraded":"2023-10-18T11:39:05.988842+0000","last_fullsized":"2023-10-18T11:39:05.988842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'131","last_scrub_stamp":"2023-10-18T11:39:05.988717+0000","last_deep_scrub":"31'131","last_deep_scrub_stamp":"2023-10-18T11:39:05.988717+0000","last_clean_scrub_stamp":"2023-10-18T11:39:05.988717+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:53:18.953611+0000","scrub_duration":0.0025822449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'151","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.950545+0000","last_change":"2023-10-18T11:38:38.950670+0000","last_active":"2023-10-18T11:38:38.950545+0000","last_peered":"2023-10-18T11:38:38.950545+0000","last_clean":"2023-10-18T11:38:38.950545+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:38:38.950545+0000","last_undegraded":"2023-10-18T11:38:38.950545+0000","last_fullsized":"2023-10-18T11:38:38.950545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'151","last_scrub_stamp":"2023-10-18T11:38:38.950368+0000","last_deep_scrub":"31'151","last_deep_scrub_stamp":"2023-10-18T11:38:38.950368+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.950368+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:57.286818+0000","scrub_duration":0.0045621400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'152","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:24.563866+0000","last_change":"2023-10-18T11:38:24.563908+0000","last_active":"2023-10-18T11:38:24.563866+0000","last_peered":"2023-10-18T11:38:24.563866+0000","last_clean":"2023-10-18T11:38:24.563866+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:38:24.563866+0000","last_undegraded":"2023-10-18T11:38:24.563866+0000","last_fullsized":"2023-10-18T11:38:24.563866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'152","last_scrub_stamp":"2023-10-18T11:38:24.563782+0000","last_deep_scrub":"31'152","last_deep_scrub_stamp":"2023-10-18T11:38:24.563782+0000","last_clean_scrub_stamp":"2023-10-18T11:38:24.563782+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:53.792395+0000","scrub_duration":0.001529683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'128","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:01.989414+0000","last_change":"2023-10-18T11:39:01.989533+0000","last_active":"2023-10-18T11:39:01.989414+0000","last_peered":"2023-10-18T11:39:01.989414+0000","last_clean":"2023-10-18T11:39:01.989414+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:39:01.989414+0000","last_undegraded":"2023-10-18T11:39:01.989414+0000","last_fullsized":"2023-10-18T11:39:01.989414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'128","last_scrub_stamp":"2023-10-18T11:39:01.989245+0000","last_deep_scrub":"31'128","last_deep_scrub_stamp":"2023-10-18T11:39:01.989245+0000","last_clean_scrub_stamp":"2023-10-18T11:39:01.989245+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:44.876349+0000","scrub_duration":0.0035044519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'145","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:34.309838+0000","last_change":"2023-10-18T11:38:34.309877+0000","last_active":"2023-10-18T11:38:34.309838+0000","last_peered":"2023-10-18T11:38:34.309838+0000","last_clean":"2023-10-18T11:38:34.309838+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:38:34.309838+0000","last_undegraded":"2023-10-18T11:38:34.309838+0000","last_fullsized":"2023-10-18T11:38:34.309838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:34.309736+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:34.309736+0000","last_clean_scrub_stamp":"2023-10-18T11:38:34.309736+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:20.124864+0000","scrub_duration":0.0026226790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'162","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:00.989024+0000","last_change":"2023-10-18T11:39:00.989143+0000","last_active":"2023-10-18T11:39:00.989024+0000","last_peered":"2023-10-18T11:39:00.989024+0000","last_clean":"2023-10-18T11:39:00.989024+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:39:00.989024+0000","last_undegraded":"2023-10-18T11:39:00.989024+0000","last_fullsized":"2023-10-18T11:39:00.989024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'162","last_scrub_stamp":"2023-10-18T11:39:00.988808+0000","last_deep_scrub":"31'162","last_deep_scrub_stamp":"2023-10-18T11:39:00.988808+0000","last_clean_scrub_stamp":"2023-10-18T11:39:00.988808+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:10:10.375027+0000","scrub_duration":0.0030012239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'149","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.215456+0000","last_change":"2023-10-18T11:38:32.215456+0000","last_active":"2023-10-18T11:38:32.215456+0000","last_peered":"2023-10-18T11:38:32.215456+0000","last_clean":"2023-10-18T11:38:32.215456+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:38:32.215456+0000","last_undegraded":"2023-10-18T11:38:32.215456+0000","last_fullsized":"2023-10-18T11:38:32.215456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'149","last_scrub_stamp":"2023-10-18T11:38:32.215344+0000","last_deep_scrub":"31'149","last_deep_scrub_stamp":"2023-10-18T11:38:32.215344+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.215344+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:46.370051+0000","scrub_duration":0.0012886499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'153","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:25.111474+0000","last_change":"2023-10-18T11:38:25.111474+0000","last_active":"2023-10-18T11:38:25.111474+0000","last_peered":"2023-10-18T11:38:25.111474+0000","last_clean":"2023-10-18T11:38:25.111474+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:38:25.111474+0000","last_undegraded":"2023-10-18T11:38:25.111474+0000","last_fullsized":"2023-10-18T11:38:25.111474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:25.111222+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:25.111222+0000","last_clean_scrub_stamp":"2023-10-18T11:38:25.111222+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:30.151595+0000","scrub_duration":0.0029533910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'152","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.587609+0000","last_change":"2023-10-18T11:38:23.587609+0000","last_active":"2023-10-18T11:38:23.587609+0000","last_peered":"2023-10-18T11:38:23.587609+0000","last_clean":"2023-10-18T11:38:23.587609+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:38:23.587609+0000","last_undegraded":"2023-10-18T11:38:23.587609+0000","last_fullsized":"2023-10-18T11:38:23.587609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'152","last_scrub_stamp":"2023-10-18T11:38:23.587505+0000","last_deep_scrub":"31'152","last_deep_scrub_stamp":"2023-10-18T11:38:23.587505+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.587505+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:26.405832+0000","scrub_duration":0.0012722530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'153","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:02.746285+0000","last_change":"2023-10-18T11:39:02.746320+0000","last_active":"2023-10-18T11:39:02.746285+0000","last_peered":"2023-10-18T11:39:02.746285+0000","last_clean":"2023-10-18T11:39:02.746285+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:39:02.746285+0000","last_undegraded":"2023-10-18T11:39:02.746285+0000","last_fullsized":"2023-10-18T11:39:02.746285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:39:02.746221+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:39:02.746221+0000","last_clean_scrub_stamp":"2023-10-18T11:39:02.746221+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:28:44.912408+0000","scrub_duration":0.0028801230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'167","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.660058+0000","last_change":"2023-10-18T11:38:26.660178+0000","last_active":"2023-10-18T11:38:26.660058+0000","last_peered":"2023-10-18T11:38:26.660058+0000","last_clean":"2023-10-18T11:38:26.660058+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:38:26.660058+0000","last_undegraded":"2023-10-18T11:38:26.660058+0000","last_fullsized":"2023-10-18T11:38:26.660058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-10-18T11:38:26.659882+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-10-18T11:38:26.659882+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.659882+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:11.158659+0000","scrub_duration":0.0030154539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'146","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:41.580265+0000","last_change":"2023-10-18T11:38:41.580389+0000","last_active":"2023-10-18T11:38:41.580265+0000","last_peered":"2023-10-18T11:38:41.580265+0000","last_clean":"2023-10-18T11:38:41.580265+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:38:41.580265+0000","last_undegraded":"2023-10-18T11:38:41.580265+0000","last_fullsized":"2023-10-18T11:38:41.580265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:41.580103+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:41.580103+0000","last_clean_scrub_stamp":"2023-10-18T11:38:41.580103+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:23:36.795823+0000","scrub_duration":0.003715356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'144","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:45.218022+0000","last_change":"2023-10-18T11:38:45.218066+0000","last_active":"2023-10-18T11:38:45.218022+0000","last_peered":"2023-10-18T11:38:45.218022+0000","last_clean":"2023-10-18T11:38:45.218022+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:38:45.218022+0000","last_undegraded":"2023-10-18T11:38:45.218022+0000","last_fullsized":"2023-10-18T11:38:45.218022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2023-10-18T11:38:45.217957+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2023-10-18T11:38:45.217957+0000","last_clean_scrub_stamp":"2023-10-18T11:38:45.217957+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:50.170432+0000","scrub_duration":0.0024820129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:41.956635+0000","last_change":"2023-10-18T11:38:41.956833+0000","last_active":"2023-10-18T11:38:41.956635+0000","last_peered":"2023-10-18T11:38:41.956635+0000","last_clean":"2023-10-18T11:38:41.956635+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:38:41.956635+0000","last_undegraded":"2023-10-18T11:38:41.956635+0000","last_fullsized":"2023-10-18T11:38:41.956635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:41.956444+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:41.956444+0000","last_clean_scrub_stamp":"2023-10-18T11:38:41.956444+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:15:40.929938+0000","scrub_duration":0.003296551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'135","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.107478+0000","last_change":"2023-10-18T11:38:20.107589+0000","last_active":"2023-10-18T11:38:20.107478+0000","last_peered":"2023-10-18T11:38:20.107478+0000","last_clean":"2023-10-18T11:38:20.107478+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:38:20.107478+0000","last_undegraded":"2023-10-18T11:38:20.107478+0000","last_fullsized":"2023-10-18T11:38:20.107478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2023-10-18T11:38:20.107315+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2023-10-18T11:38:20.107315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.107315+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:23:15.323035+0000","scrub_duration":0.004575244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'173","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:00.098272+0000","last_change":"2023-10-18T11:39:00.098272+0000","last_active":"2023-10-18T11:39:00.098272+0000","last_peered":"2023-10-18T11:39:00.098272+0000","last_clean":"2023-10-18T11:39:00.098272+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:39:00.098272+0000","last_undegraded":"2023-10-18T11:39:00.098272+0000","last_fullsized":"2023-10-18T11:39:00.098272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'173","last_scrub_stamp":"2023-10-18T11:39:00.098001+0000","last_deep_scrub":"31'173","last_deep_scrub_stamp":"2023-10-18T11:39:00.098001+0000","last_clean_scrub_stamp":"2023-10-18T11:39:00.098001+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:53:13.062894+0000","scrub_duration":0.0031508560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'137","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.600525+0000","last_change":"2023-10-18T11:38:29.600525+0000","last_active":"2023-10-18T11:38:29.600525+0000","last_peered":"2023-10-18T11:38:29.600525+0000","last_clean":"2023-10-18T11:38:29.600525+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:38:29.600525+0000","last_undegraded":"2023-10-18T11:38:29.600525+0000","last_fullsized":"2023-10-18T11:38:29.600525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:29.600430+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:29.600430+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.600430+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:12:23.713131+0000","scrub_duration":0.0012082449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.453393+0000","last_change":"2023-10-18T11:38:37.453393+0000","last_active":"2023-10-18T11:38:37.453393+0000","last_peered":"2023-10-18T11:38:37.453393+0000","last_clean":"2023-10-18T11:38:37.453393+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:38:37.453393+0000","last_undegraded":"2023-10-18T11:38:37.453393+0000","last_fullsized":"2023-10-18T11:38:37.453393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:37.453285+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:37.453285+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.453285+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:11.486559+0000","scrub_duration":0.0016972199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'147","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.494852+0000","last_change":"2023-10-18T11:38:38.494852+0000","last_active":"2023-10-18T11:38:38.494852+0000","last_peered":"2023-10-18T11:38:38.494852+0000","last_clean":"2023-10-18T11:38:38.494852+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:38:38.494852+0000","last_undegraded":"2023-10-18T11:38:38.494852+0000","last_fullsized":"2023-10-18T11:38:38.494852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'147","last_scrub_stamp":"2023-10-18T11:38:38.494746+0000","last_deep_scrub":"31'147","last_deep_scrub_stamp":"2023-10-18T11:38:38.494746+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.494746+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:55:08.117988+0000","scrub_duration":0.001373895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'145","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:01.739491+0000","last_change":"2023-10-18T11:39:01.739546+0000","last_active":"2023-10-18T11:39:01.739491+0000","last_peered":"2023-10-18T11:39:01.739491+0000","last_clean":"2023-10-18T11:39:01.739491+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:39:01.739491+0000","last_undegraded":"2023-10-18T11:39:01.739491+0000","last_fullsized":"2023-10-18T11:39:01.739491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:39:01.739368+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:39:01.739368+0000","last_clean_scrub_stamp":"2023-10-18T11:39:01.739368+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:53:14.704262+0000","scrub_duration":0.0016360560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'150","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.945550+0000","last_change":"2023-10-18T11:38:13.945663+0000","last_active":"2023-10-18T11:38:13.945550+0000","last_peered":"2023-10-18T11:38:13.945550+0000","last_clean":"2023-10-18T11:38:13.945550+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:38:13.945550+0000","last_undegraded":"2023-10-18T11:38:13.945550+0000","last_fullsized":"2023-10-18T11:38:13.945550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.945379+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.853585+0000","scrub_duration":0.0032551009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'134","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:54.714104+0000","last_change":"2023-10-18T11:38:54.714158+0000","last_active":"2023-10-18T11:38:54.714104+0000","last_peered":"2023-10-18T11:38:54.714104+0000","last_clean":"2023-10-18T11:38:54.714104+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:38:54.714104+0000","last_undegraded":"2023-10-18T11:38:54.714104+0000","last_fullsized":"2023-10-18T11:38:54.714104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'134","last_scrub_stamp":"2023-10-18T11:38:54.713999+0000","last_deep_scrub":"31'134","last_deep_scrub_stamp":"2023-10-18T11:38:54.713999+0000","last_clean_scrub_stamp":"2023-10-18T11:38:54.713999+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:47:08.372510+0000","scrub_duration":0.0029353119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'143","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.682215+0000","last_change":"2023-10-18T11:38:38.682399+0000","last_active":"2023-10-18T11:38:38.682215+0000","last_peered":"2023-10-18T11:38:38.682215+0000","last_clean":"2023-10-18T11:38:38.682215+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:38:38.682215+0000","last_undegraded":"2023-10-18T11:38:38.682215+0000","last_fullsized":"2023-10-18T11:38:38.682215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'143","last_scrub_stamp":"2023-10-18T11:38:38.682031+0000","last_deep_scrub":"31'143","last_deep_scrub_stamp":"2023-10-18T11:38:38.682031+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.682031+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:12.903605+0000","scrub_duration":0.0035830810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'127","reported_seq":165,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.587489+0000","last_change":"2023-10-18T11:38:18.587542+0000","last_active":"2023-10-18T11:38:18.587489+0000","last_peered":"2023-10-18T11:38:18.587489+0000","last_clean":"2023-10-18T11:38:18.587489+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:38:18.587489+0000","last_undegraded":"2023-10-18T11:38:18.587489+0000","last_fullsized":"2023-10-18T11:38:18.587489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'127","last_scrub_stamp":"2023-10-18T11:38:18.587414+0000","last_deep_scrub":"31'127","last_deep_scrub_stamp":"2023-10-18T11:38:18.587414+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.587414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:00.007644+0000","scrub_duration":0.0032637949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'137","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:35.338828+0000","last_change":"2023-10-18T11:38:35.338865+0000","last_active":"2023-10-18T11:38:35.338828+0000","last_peered":"2023-10-18T11:38:35.338828+0000","last_clean":"2023-10-18T11:38:35.338828+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:38:35.338828+0000","last_undegraded":"2023-10-18T11:38:35.338828+0000","last_fullsized":"2023-10-18T11:38:35.338828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:35.338757+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:35.338757+0000","last_clean_scrub_stamp":"2023-10-18T11:38:35.338757+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:54:11.626222+0000","scrub_duration":0.0026066140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'142","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.876365+0000","last_change":"2023-10-18T11:38:37.876365+0000","last_active":"2023-10-18T11:38:37.876365+0000","last_peered":"2023-10-18T11:38:37.876365+0000","last_clean":"2023-10-18T11:38:37.876365+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:38:37.876365+0000","last_undegraded":"2023-10-18T11:38:37.876365+0000","last_fullsized":"2023-10-18T11:38:37.876365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:37.876023+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:37.876023+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.876023+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:42.828498+0000","scrub_duration":0.0035315149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'165","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:11.775586+0000","last_change":"2023-10-18T11:38:11.775586+0000","last_active":"2023-10-18T11:38:11.775586+0000","last_peered":"2023-10-18T11:38:11.775586+0000","last_clean":"2023-10-18T11:38:11.775586+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:38:11.775586+0000","last_undegraded":"2023-10-18T11:38:11.775586+0000","last_fullsized":"2023-10-18T11:38:11.775586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:11.775315+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:28.740862+0000","scrub_duration":0.0041709950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'146","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:58.754530+0000","last_change":"2023-10-18T11:38:58.754569+0000","last_active":"2023-10-18T11:38:58.754530+0000","last_peered":"2023-10-18T11:38:58.754530+0000","last_clean":"2023-10-18T11:38:58.754530+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:38:58.754530+0000","last_undegraded":"2023-10-18T11:38:58.754530+0000","last_fullsized":"2023-10-18T11:38:58.754530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:58.754458+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:58.754458+0000","last_clean_scrub_stamp":"2023-10-18T11:38:58.754458+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:08:16.503632+0000","scrub_duration":0.001988156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2017,"num_read_kb":484709,"num_write":10619,"num_write_kb":576779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13929,"ondisk_log_size":13929,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9424,"ondisk_log_size":9424,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":100007018,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":2171,"num_read_kb":2416,"num_write":26219,"num_write_kb":112209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159006720,"data_stored":200014036,"data_compressed":12429396,"data_compressed_allocated":19357696,"data_compressed_original":60612608,"omap_allocated":0,"internal_metadata":0},"log_size":24373,"ondisk_log_size":24373,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509806,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113708,"kb_used_data":24228,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94258132,"statfs":{"total":96636764160,"available":96520327168,"internally_reserved":0,"allocated":24809472,"data_stored":31797443,"data_compressed":2010206,"data_compressed_allocated":3112960,"data_compressed_original":10338304,"omap_allocated":1588,"internal_metadata":91617740},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.33500000000000002,"15min":0.28999999999999998},"max":{"1min":0.88200000000000001,"5min":3.6469999999999998,"15min":3.6469999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0069999999999999,"5min":1.3260000000000001,"15min":19.158000000000001},"last":1.0940000000000001}]},{"osd":1,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.94099999999999995,"15min":0.73699999999999999},"min":{"1min":0.44400000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.075,"5min":19.673999999999999,"15min":19.673999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.878,"15min":0.73399999999999999},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.36099999999999999},"max":{"1min":0.91600000000000004,"5min":15.692,"15min":15.692},"last":0.64700000000000002}]},{"osd":2,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.68300000000000005,"15min":0.65900000000000003},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.9239999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.442,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.528,"5min":1.528,"15min":5.444},"last":0.69199999999999995}]},{"osd":3,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.93999999999999995,"15min":0.81899999999999995},"min":{"1min":0.39400000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4319999999999999,"5min":12.368,"15min":12.368},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.68799999999999994,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":13.1},"last":0.623}]},{"osd":4,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.35199999999999998},"min":{"1min":0.28599999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48999999999999999,"5min":1.895,"15min":1.895},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.37,"15min":0.371},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.53200000000000003,"5min":1.321,"15min":1.321},"last":0.27700000000000002}]},{"osd":5,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.28000000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47999999999999998,"5min":0.85099999999999998,"15min":1.081},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.437,"15min":0.41099999999999998},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.52000000000000002,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.35799999999999998}]},{"osd":6,"last update":"Wed Oct 18 11:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44,"15min":0.42499999999999999},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":0.54600000000000004,"5min":3.4409999999999998,"15min":3.4409999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.35899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55900000000000005,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.38700000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509804,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93740,"kb_used_data":18148,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278100,"statfs":{"total":96636764160,"available":96540774400,"internally_reserved":0,"allocated":18583552,"data_stored":23213882,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60499999999999998,"15min":0.63700000000000001},"min":{"1min":0.439,"5min":0.36199999999999999,"15min":0.31},"max":{"1min":1.0489999999999999,"5min":1.0740000000000001,"15min":9.3190000000000008},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.62,"15min":0.66300000000000003},"min":{"1min":0.46600000000000003,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":1.024,"5min":1.1699999999999999,"15min":15.282999999999999},"last":0.92000000000000004}]},{"osd":1,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.52300000000000002,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":1.0369999999999999,"5min":1.202,"15min":6.6429999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61799999999999999,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92200000000000004,"5min":1.153,"15min":1.748},"last":0.71399999999999997}]},{"osd":2,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.33300000000000002},"max":{"1min":0.94199999999999995,"5min":1.355,"15min":1.839},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71699999999999997,"15min":0.68200000000000005},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.34499999999999997},"max":{"1min":1.202,"5min":1.468,"15min":1.6819999999999999},"last":1.077}]},{"osd":3,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67500000000000004,"15min":0.73299999999999998},"min":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":1.113,"5min":1.2410000000000001,"15min":13.840999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.69699999999999995,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":1.0800000000000001,"5min":1.1950000000000001,"15min":23.155999999999999},"last":0.95999999999999996}]},{"osd":4,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25700000000000001,"5min":0.23899999999999999,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.52600000000000002,"15min":0.88},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.38200000000000001,"15min":0.371},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.48299999999999998,"5min":0.53500000000000003,"15min":1.0469999999999999},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39200000000000002,"15min":0.373},"min":{"1min":0.27900000000000003,"5min":0.26900000000000002,"15min":0.23300000000000001},"max":{"1min":0.5,"5min":0.54300000000000004,"15min":0.56799999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.316,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.624},"last":0.438}]},{"osd":7,"last update":"Wed Oct 18 11:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.33400000000000002,"5min":0.27500000000000002,"15min":0.253},"max":{"1min":0.56499999999999995,"5min":0.57899999999999996,"15min":0.77600000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41299999999999998,"15min":0.40699999999999997},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.26600000000000001},"max":{"1min":0.53500000000000003,"5min":0.60299999999999998,"15min":0.61499999999999999},"last":0.45100000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509805,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87864,"kb_used_data":20592,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94283976,"statfs":{"total":96636764160,"available":96546791424,"internally_reserved":0,"allocated":21086208,"data_stored":26657639,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.32200000000000001,"15min":0.29599999999999999},"max":{"1min":0.92300000000000004,"5min":1.21,"15min":1.663},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68600000000000005,"15min":0.623},"min":{"1min":0.45500000000000002,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":0.98699999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.88500000000000001}]},{"osd":1,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.33700000000000002,"15min":0.32500000000000001},"max":{"1min":0.94799999999999995,"5min":1.246,"15min":1.8620000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.45500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.056,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.39300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.1180000000000001,"5min":1.1990000000000001,"15min":1.248},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.38700000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.2350000000000001,"15min":3.5579999999999998},"last":0.70099999999999996}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.373},"max":{"1min":1.119,"5min":1.4930000000000001,"15min":1.5049999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":1.0840000000000001,"5min":1.4019999999999999,"15min":1.8779999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.223},"max":{"1min":0.504,"5min":0.51500000000000001,"15min":0.72699999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.32100000000000001,"5min":0.248,"15min":0.24399999999999999},"max":{"1min":0.53600000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36599999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.24299999999999999,"15min":0.224},"max":{"1min":0.51100000000000001,"5min":0.57799999999999996,"15min":0.622},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.41099999999999998,"15min":0.40200000000000002},"min":{"1min":0.36599999999999999,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.54600000000000004,"5min":0.65900000000000003,"15min":0.67400000000000004},"last":0.52700000000000002}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.56299999999999994,"5min":0.67300000000000004,"15min":0.68999999999999995},"last":0.53800000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509804,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148704,"kb_used_data":27288,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94223136,"statfs":{"total":96636764160,"available":96484491264,"internally_reserved":0,"allocated":27942912,"data_stored":33976532,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":1591,"internal_metadata":124320201},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.391,"15min":1.147},"min":{"1min":0.66300000000000003,"5min":0.5,"15min":0.314},"max":{"1min":2.6360000000000001,"5min":24.654,"15min":24.654},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.339,"15min":1.1539999999999999},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.379},"max":{"1min":2.5899999999999999,"5min":18.518000000000001,"15min":18.518000000000001},"last":1.216}]},{"osd":1,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.4059999999999999,"15min":1.2430000000000001},"min":{"1min":0.49299999999999999,"5min":0.441,"15min":0.35399999999999998},"max":{"1min":2.8140000000000001,"5min":16.361999999999998,"15min":16.361999999999998},"last":1.423},{"interface":"front","average":{"1min":1.407,"5min":1.5469999999999999,"15min":1.361},"min":{"1min":0.83799999999999997,"5min":0.57699999999999996,"15min":0.43099999999999999},"max":{"1min":2.278,"5min":24.611000000000001,"15min":24.611000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.52,"15min":1.3979999999999999},"min":{"1min":0.71199999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.8959999999999999,"5min":16.576000000000001,"15min":16.576000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.6739999999999999,"15min":1.4810000000000001},"min":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.45100000000000001},"max":{"1min":2.7290000000000001,"5min":24.553000000000001,"15min":24.553000000000001},"last":1.355}]},{"osd":4,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.454,"15min":1.2290000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.432},"max":{"1min":2.2679999999999998,"5min":18.721,"15min":18.721},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.379,"15min":1.266},"min":{"1min":0.77000000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.5099999999999998,"5min":16.481000000000002,"15min":16.481000000000002},"last":1.0069999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.6160000000000001,"15min":1.3959999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.44700000000000001},"max":{"1min":2.569,"5min":24.786999999999999,"15min":24.786999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.6279999999999999,"15min":1.365},"min":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.49199999999999999},"max":{"1min":2.6120000000000001,"5min":18.681999999999999,"15min":18.681999999999999},"last":1.8600000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.518,"15min":1.397},"min":{"1min":0.82099999999999995,"5min":0.59899999999999998,"15min":0.52900000000000003},"max":{"1min":2.3370000000000002,"5min":16.513999999999999,"15min":16.513999999999999},"last":1.742},{"interface":"front","average":{"1min":1.625,"5min":1.7150000000000001,"15min":1.508},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.54300000000000004},"max":{"1min":2.3940000000000001,"5min":24.834,"15min":24.834},"last":1.2869999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5740000000000001,"5min":1.718,"15min":1.4730000000000001},"min":{"1min":0.64700000000000002,"5min":0.499,"15min":0.499},"max":{"1min":2.847,"5min":18.800000000000001,"15min":18.800000000000001},"last":1.786},{"interface":"front","average":{"1min":1.645,"5min":1.6599999999999999,"15min":1.5209999999999999},"min":{"1min":0.86499999999999999,"5min":0.64100000000000001,"15min":0.496},"max":{"1min":2.6899999999999999,"5min":16.544,"15min":16.544},"last":1.821}]}]},{"osd":2,"up_from":15,"seq":64424509804,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94552,"kb_used_data":13456,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94277288,"statfs":{"total":96636764160,"available":96539942912,"internally_reserved":0,"allocated":13778944,"data_stored":17047576,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.141,"15min":1.0549999999999999},"min":{"1min":0.72199999999999998,"5min":0.40600000000000003,"15min":0.308},"max":{"1min":1.829,"5min":2.5830000000000002,"15min":2.9249999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1659999999999999,"15min":1.1140000000000001},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":1.732,"5min":3.2919999999999998,"15min":3.964},"last":1.413}]},{"osd":1,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.264,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.53700000000000003,"15min":0.40200000000000002},"max":{"1min":2.5409999999999999,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3520000000000001,"15min":1.2849999999999999},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.056,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.456}]},{"osd":3,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4610000000000001,"15min":1.3680000000000001},"min":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.44},"max":{"1min":2.7250000000000001,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.538,"15min":1.391},"min":{"1min":0.61099999999999999,"5min":0.55400000000000005,"15min":0.53900000000000003},"max":{"1min":2.157,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.2909999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2230000000000001,"15min":1.1439999999999999},"min":{"1min":0.66700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.9870000000000001,"5min":3.3759999999999999,"15min":3.3759999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.248,"5min":1.29,"15min":1.2150000000000001},"min":{"1min":0.70499999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.0449999999999999,"5min":3.831,"15min":3.831},"last":1.0029999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.4199999999999999,"15min":1.254},"min":{"1min":0.76000000000000001,"5min":0.58399999999999996,"15min":0.46200000000000002},"max":{"1min":2.6640000000000001,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3740000000000001,"15min":1.27},"min":{"1min":0.57899999999999996,"5min":0.51200000000000001,"15min":0.441},"max":{"1min":2.1150000000000002,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.2110000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.431,"15min":1.329},"min":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.49399999999999999},"max":{"1min":2.1099999999999999,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":1.129},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5409999999999999,"15min":1.363},"min":{"1min":0.91200000000000003,"5min":0.68100000000000005,"15min":0.50700000000000001},"max":{"1min":2.7989999999999999,"5min":5.133,"15min":5.133},"last":1.1599999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:38:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.498,"15min":1.385},"min":{"1min":0.89300000000000002,"5min":0.68100000000000005,"15min":0.48599999999999999},"max":{"1min":2.206,"5min":3.597,"15min":3.597},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.482,"5min":1.571,"15min":1.448},"min":{"1min":0.73999999999999999,"5min":0.65100000000000002,"15min":0.55900000000000005},"max":{"1min":2.3860000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":1.3400000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509805,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153264,"kb_used_data":23592,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94218576,"statfs":{"total":96636764160,"available":96479821824,"internally_reserved":0,"allocated":24158208,"data_stored":30584690,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.056,"15min":1.0980000000000001},"min":{"1min":0.66700000000000004,"5min":0.38400000000000001,"15min":0.313},"max":{"1min":1.4670000000000001,"5min":2.5649999999999999,"15min":10.836},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.169,"15min":1.1319999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":3.8410000000000002},"last":1.1279999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1919999999999999,"15min":1.1890000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.32900000000000001},"max":{"1min":1.931,"5min":3.2389999999999999,"15min":4.4199999999999999},"last":1.23},{"interface":"front","average":{"1min":1.649,"5min":1.385,"15min":1.335},"min":{"1min":0.50900000000000001,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":8.6229999999999993,"5min":8.6229999999999993,"15min":10.782},"last":1.1910000000000001}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.343,"15min":1.405},"min":{"1min":0.70599999999999996,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":1.9330000000000001,"5min":2.8420000000000001,"15min":6.8150000000000004},"last":1.331},{"interface":"front","average":{"1min":1.234,"5min":1.2929999999999999,"15min":1.319},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.0609999999999999,"5min":3.1200000000000001,"15min":3.79},"last":1.359}]},{"osd":4,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.1990000000000001,"15min":1.1870000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.376},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":4.3890000000000002},"last":1.044},{"interface":"front","average":{"1min":1.339,"5min":1.262,"15min":1.2829999999999999},"min":{"1min":0.65700000000000003,"5min":0.63300000000000001,"15min":0.60899999999999999},"max":{"1min":2.2919999999999998,"5min":2.6349999999999998,"15min":6.9950000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.288,"15min":1.248},"min":{"1min":0.64700000000000002,"5min":0.58599999999999997,"15min":0.495},"max":{"1min":4.2939999999999996,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3100000000000001,"15min":1.3029999999999999},"min":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52900000000000003},"max":{"1min":2.1320000000000001,"5min":2.294,"15min":4.3419999999999996},"last":0.86599999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.407,"15min":1.405},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9059999999999999,"5min":2.7400000000000002,"15min":6.944},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.353},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55300000000000005},"max":{"1min":2.2130000000000001,"5min":3.3849999999999998,"15min":3.657},"last":1.72}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4399999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":2.3100000000000001,"5min":3.27,"15min":3.722},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.45,"15min":1.4430000000000001},"min":{"1min":0.72399999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2589999999999999,"5min":2.6309999999999998,"15min":4.2919999999999998},"last":1.679}]}]},{"osd":0,"up_from":15,"seq":64424509805,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106768,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94265072,"statfs":{"total":96636764160,"available":96527433728,"internally_reserved":0,"allocated":17768448,"data_stored":22732859,"data_compressed":1487303,"data_compressed_allocated":2297856,"data_compressed_original":7491584,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.0209999999999999,"15min":1.044},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":5.2450000000000001,"5min":5.2450000000000001,"15min":5.7380000000000004},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.0780000000000001,"15min":1.1779999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.738,"5min":1.9830000000000001,"15min":20.128},"last":1.347}]},{"osd":2,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.133,"15min":1.1990000000000001},"min":{"1min":0.68700000000000006,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":2.1200000000000001,"5min":2.8039999999999998,"15min":3.2839999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.728,"5min":1.2809999999999999,"15min":1.2949999999999999},"min":{"1min":0.52400000000000002,"5min":0.38900000000000001,"15min":0.31900000000000001},"max":{"1min":8.2260000000000009,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":1.1739999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.28,"15min":1.272},"min":{"1min":0.72899999999999998,"5min":0.47699999999999998,"15min":0.44600000000000001},"max":{"1min":2.1499999999999999,"5min":4.0510000000000002,"15min":8.9879999999999995},"last":1.073},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.3600000000000001,"15min":1.4139999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.1480000000000001,"5min":2.7639999999999998,"15min":5.6219999999999999},"last":1.5029999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.252,"15min":1.2150000000000001},"min":{"1min":0.59699999999999998,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":3.3769999999999998,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1599999999999999,"15min":1.161},"min":{"1min":0.80700000000000005,"5min":0.53800000000000003,"15min":0.51800000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":3.6219999999999999},"last":0.80900000000000005}]},{"osd":5,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.2689999999999999,"15min":1.2529999999999999},"min":{"1min":0.88,"5min":0.61899999999999999,"15min":0.49099999999999999},"max":{"1min":2.323,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.3140000000000001,"15min":1.3},"min":{"1min":0.91200000000000003,"5min":0.59299999999999997,"15min":0.56200000000000006},"max":{"1min":2.0289999999999999,"5min":2.2349999999999999,"15min":2.8140000000000001},"last":1.0249999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.3779999999999999,"15min":1.369},"min":{"1min":0.84699999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.2360000000000002,"5min":2.274,"15min":2.7669999999999999},"last":1.395},{"interface":"front","average":{"1min":1.542,"5min":1.391,"15min":1.3620000000000001},"min":{"1min":0.89900000000000002,"5min":0.54200000000000004,"15min":0.44900000000000001},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.7669999999999999},"last":0.871}]},{"osd":7,"last update":"Wed Oct 18 11:38:15 2023","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.47,"15min":1.444},"min":{"1min":0.80700000000000005,"5min":0.56599999999999995,"15min":0.49199999999999999},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.915},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.518,"5min":1.3939999999999999,"15min":1.375},"min":{"1min":0.77500000000000002,"5min":0.66500000000000004,"15min":0.59999999999999998},"max":{"1min":2.2829999999999999,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":1.272}]}]},{"osd":6,"up_from":14,"seq":60129542508,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98600,"kb_used_data":13344,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273240,"statfs":{"total":96636764160,"available":96535797760,"internally_reserved":0,"allocated":13664256,"data_stored":16262951,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.60799999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":0.95099999999999996,"5min":3.387,"15min":3.387},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.33300000000000002,"15min":0.31},"max":{"1min":0.92500000000000004,"5min":1.587,"15min":1.587},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65900000000000003,"15min":0.63300000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.25},"max":{"1min":1.069,"5min":1.478,"15min":1.478},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":1.0129999999999999,"5min":1.554,"15min":1.669},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.377,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":1.2070000000000001,"15min":1.712},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.64400000000000002},"min":{"1min":0.40600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96299999999999997,"5min":1.1000000000000001,"15min":1.1839999999999999},"last":0.82199999999999995}]},{"osd":3,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.877,"5min":1.3200000000000001,"15min":2.694},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68999999999999995,"15min":0.70499999999999996},"min":{"1min":0.48399999999999999,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.97599999999999998,"5min":1.4159999999999999,"15min":2.1459999999999999},"last":1.0800000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35199999999999998,"15min":0.35899999999999999},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.23400000000000001},"max":{"1min":0.42599999999999999,"5min":0.55600000000000005,"15min":0.63700000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36499999999999999,"15min":0.37},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26500000000000001},"max":{"1min":0.40300000000000002,"5min":0.57599999999999996,"15min":0.68600000000000005},"last":0.35299999999999998}]},{"osd":5,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35699999999999998,"15min":0.36699999999999999},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.252},"max":{"1min":0.43099999999999999,"5min":0.65700000000000003,"15min":0.85199999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38600000000000001,"15min":0.39500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.46600000000000003,"5min":0.65800000000000003,"15min":0.67000000000000004},"last":0.41699999999999998}]},{"osd":7,"last update":"Wed Oct 18 11:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26700000000000002},"max":{"1min":0.432,"5min":0.63600000000000001,"15min":0.77600000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.378,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.44800000000000001,"5min":0.68300000000000005,"15min":0.80000000000000004},"last":0.39200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17371136,"data_stored":22007641,"data_compressed":1454768,"data_compressed_allocated":2252800,"data_compressed_original":6918144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23826432,"data_stored":30449840,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13447168,"data_stored":16912726,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27611136,"data_stored":33841682,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20754432,"data_stored":26522789,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":23079032,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13332480,"data_stored":16128101,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24412160,"data_stored":31072225,"data_compressed":1977671,"data_compressed_allocated":3067904,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:39:19.553 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:39:19.554 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-18T11:09:44.766414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=11, tm_min=38, tm_sec=6, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T11:39:19.555 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-18T11:39:39.556 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T11:39:39.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.773+0000 7f95ef955640 1 Processor -- start 2023-10-18T11:39:39.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.774+0000 7f95ef955640 1 -- start start 2023-10-18T11:39:39.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.775+0000 7f95ef955640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e80cd1a0 0x7f95e80c6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:39.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.775+0000 7f95ef955640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e8156f80 con 0x7f95e8151190 2023-10-18T11:39:39.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.775+0000 7f95ef955640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e815a690 con 0x7f95e8157480 2023-10-18T11:39:39.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.775+0000 7f95ef955640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e80cd5e0 con 0x7f95e80cd1a0 2023-10-18T11:39:39.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.776+0000 7f95ed6f1640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f95e8151190 0x7f95e80c85d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:36808/0 (socket says 172.21.15.151:36808) 2023-10-18T11:39:39.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.776+0000 7f95ed6f1640 1 -- 172.21.15.151:0/115437472 learned_addr learned my addr 172.21.15.151:0/115437472 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:39:39.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.776+0000 7f95ecef0640 1 --2- 172.21.15.151:0/115437472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e80cd1a0 0x7f95e80c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:39.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.779+0000 7f95e7fff640 1 -- 172.21.15.151:0/115437472 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300175020 0 0) 0x7f95e8156f80 con 0x7f95e8151190 2023-10-18T11:39:39.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.779+0000 7f95e7fff640 1 -- 172.21.15.151:0/115437472 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d0003520 con 0x7f95e8151190 2023-10-18T11:39:39.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.780+0000 7f95ecef0640 1 -- 172.21.15.151:0/115437472 >> v1:172.21.15.169:6789/0 conn(0x7f95e8157480 legacy=0x7f95e81578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:39.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.780+0000 7f95ecef0640 1 -- 172.21.15.151:0/115437472 >> v1:172.21.15.151:6789/0 conn(0x7f95e8151190 legacy=0x7f95e80c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:39.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.780+0000 7f95ecef0640 1 -- 172.21.15.151:0/115437472 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e815a970 con 0x7f95e80cd1a0 2023-10-18T11:39:39.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.782+0000 7f95ecef0640 1 --2- 172.21.15.151:0/115437472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e80cd1a0 0x7f95e80c6640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0097d0 tx=0x7f95dc02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae5e3c50a02553f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:39.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.786+0000 7f95e7fff640 1 -- 172.21.15.151:0/115437472 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc030880 con 0x7f95e80cd1a0 2023-10-18T11:39:39.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.786+0000 7f95e7fff640 1 -- 172.21.15.151:0/115437472 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc0309e0 con 0x7f95e80cd1a0 2023-10-18T11:39:39.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.786+0000 7f95e7fff640 1 -- 172.21.15.151:0/115437472 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc030d70 con 0x7f95e80cd1a0 2023-10-18T11:39:39.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.788+0000 7f95ef955640 1 -- 172.21.15.151:0/115437472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e80cd1a0 msgr2=0x7f95e80c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:39.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.788+0000 7f95ef955640 1 --2- 172.21.15.151:0/115437472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e80cd1a0 0x7f95e80c6640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0097d0 tx=0x7f95dc02b9c0 comp rx=0 tx=0).stop 2023-10-18T11:39:39.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.788+0000 7f95ef955640 1 -- 172.21.15.151:0/115437472 shutdown_connections 2023-10-18T11:39:39.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.788+0000 7f95ef955640 1 --2- 172.21.15.151:0/115437472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e80cd1a0 0x7f95e80c6640 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:39.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.788+0000 7f95ef955640 1 -- 172.21.15.151:0/115437472 >> 172.21.15.151:0/115437472 conn(0x7f95e80cc680 msgr2=0x7f95e80cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:39.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.788+0000 7f95ef955640 1 -- 172.21.15.151:0/115437472 shutdown_connections 2023-10-18T11:39:39.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.788+0000 7f95ef955640 1 -- 172.21.15.151:0/115437472 wait complete. 2023-10-18T11:39:39.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.790+0000 7f95ef955640 1 Processor -- start 2023-10-18T11:39:39.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.790+0000 7f95ef955640 1 -- start start 2023-10-18T11:39:39.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.792+0000 7f95ef955640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80cd1a0 0x7f95e81ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:39.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.792+0000 7f95ef955640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95e8151190 0x7f95e806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:39.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.792+0000 7f95ef955640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e8157480 0x7f95e80ba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:39.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.792+0000 7f95ef955640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e81ef000 con 0x7f95e80cd1a0 2023-10-18T11:39:39.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.792+0000 7f95ef955640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e80cc530 con 0x7f95e8151190 2023-10-18T11:39:39.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.792+0000 7f95ef955640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8150950 con 0x7f95e8157480 2023-10-18T11:39:39.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.792+0000 7f95ecef0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95e8151190 0x7f95e806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:39.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.792+0000 7f95edef2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e8157480 0x7f95e80ba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:39.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.793+0000 7f95ed6f1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80cd1a0 0x7f95e81ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:39.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.793+0000 7f95edef2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e8157480 0x7f95e80ba7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:46004/0 (socket says 172.21.15.151:46004) 2023-10-18T11:39:39.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.793+0000 7f95edef2640 1 -- 172.21.15.151:0/3678058571 learned_addr learned my addr 172.21.15.151:0/3678058571 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.797+0000 7f95edef2640 1 -- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95e8151190 msgr2=0x7f95e806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.797+0000 7f95edef2640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95e8151190 0x7f95e806aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.797+0000 7f95edef2640 1 -- 172.21.15.151:0/3678058571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80cd1a0 msgr2=0x7f95e81ef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.797+0000 7f95edef2640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80cd1a0 0x7f95e81ef420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.797+0000 7f95edef2640 1 -- 172.21.15.151:0/3678058571 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009400 con 0x7f95e8157480 2023-10-18T11:39:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.799+0000 7f95edef2640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e8157480 0x7f95e80ba7e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c3f0 tx=0x7f95e000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.803+0000 7f95e5ffb640 1 -- 172.21.15.151:0/3678058571 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00052d0 con 0x7f95e8157480 2023-10-18T11:39:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.803+0000 7f95e5ffb640 1 -- 172.21.15.151:0/3678058571 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0005430 con 0x7f95e8157480 2023-10-18T11:39:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.803+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e80ca4d0 con 0x7f95e8157480 2023-10-18T11:39:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.803+0000 7f95e5ffb640 1 -- 172.21.15.151:0/3678058571 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0003830 con 0x7f95e8157480 2023-10-18T11:39:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.803+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e81ee940 con 0x7f95e8157480 2023-10-18T11:39:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.804+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e81ef140 con 0x7f95e8157480 2023-10-18T11:39:39.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.825+0000 7f95e5ffb640 1 -- 172.21.15.151:0/3678058571 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f95e0003990 con 0x7f95e8157480 2023-10-18T11:39:39.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.826+0000 7f95e5ffb640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f95d406aef0 0x7f95d406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:39.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.826+0000 7f95e5ffb640 1 -- 172.21.15.151:0/3678058571 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95e0088f70 con 0x7f95e8157480 2023-10-18T11:39:39.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.827+0000 7f95ed6f1640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f95d406aef0 0x7f95d406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:39.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:39.827+0000 7f95ed6f1640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f95d406aef0 0x7f95d406d3b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f95d8001560 tx=0x7f95d8001a90 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.065+0000 7f95e5ffb640 1 -- 172.21.15.151:0/3678058571 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95e0053f40 con 0x7f95e8157480 2023-10-18T11:39:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.294+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 --> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95e80bad20 con 0x7f95d406aef0 2023-10-18T11:39:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.306+0000 7f95e5ffb640 1 -- 172.21.15.151:0/3678058571 <== mgr.4153 v2:172.21.15.169:6832/3214727900 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373607 (secure 0 0 0) 0x7f95d8001f60 con 0x7f95d406aef0 2023-10-18T11:39:40.313 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:39:40.315 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-10-18T11:39:40.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.311+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f95d406aef0 msgr2=0x7f95d406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:40.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.311+0000 7f95ef955640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f95d406aef0 0x7f95d406d3b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f95d8001560 tx=0x7f95d8001a90 comp rx=0 tx=0).stop 2023-10-18T11:39:40.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.311+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e8157480 msgr2=0x7f95e80ba7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:40.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.311+0000 7f95ef955640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e8157480 0x7f95e80ba7e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c3f0 tx=0x7f95e000c7f0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.312+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 shutdown_connections 2023-10-18T11:39:40.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.312+0000 7f95ef955640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95e8157480 0x7f95e80ba7e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.312+0000 7f95ef955640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f95d406aef0 0x7f95d406d3b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.312+0000 7f95ef955640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95e8151190 0x7f95e806aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.312+0000 7f95ef955640 1 --2- 172.21.15.151:0/3678058571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80cd1a0 0x7f95e81ef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.312+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 >> 172.21.15.151:0/3678058571 conn(0x7f95e80cc680 msgr2=0x7f95e80cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:40.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.312+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 shutdown_connections 2023-10-18T11:39:40.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.312+0000 7f95ef955640 1 -- 172.21.15.151:0/3678058571 wait complete. 2023-10-18T11:39:40.334 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":935,"stamp":"2023-10-18T11:39:38.631866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":100597386,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":4304,"num_read_kb":487225,"num_write":36997,"num_write_kb":691404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47845,"ondisk_log_size":47845,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":897200,"kb_used_data":158000,"kb_used_omap":12,"kb_used_meta":739123,"kb_avail":754077520,"statfs":{"total":773094113280,"available":772175380480,"internally_reserved":0,"allocated":161792000,"data_stored":202273572,"data_compressed":12494466,"data_compressed_allocated":19447808,"data_compressed_original":61759488,"omap_allocated":12742,"internal_metadata":756862522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003558"},"pg_stats":[{"pgid":"2.1f","version":"31'1794","reported_seq":1838,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.079438+0000","last_change":"2023-10-18T11:38:12.079438+0000","last_active":"2023-10-18T11:38:12.079438+0000","last_peered":"2023-10-18T11:38:12.079438+0000","last_clean":"2023-10-18T11:38:12.079438+0000","last_became_active":"2023-10-18T11:09:36.796023+0000","last_became_peered":"2023-10-18T11:09:36.796023+0000","last_unstale":"2023-10-18T11:38:12.079438+0000","last_undegraded":"2023-10-18T11:38:12.079438+0000","last_fullsized":"2023-10-18T11:38:12.079438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1794","last_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_deep_scrub":"31'1794","last_deep_scrub_stamp":"2023-10-18T11:38:12.079262+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.079262+0000","objects_scrubbed":9,"log_size":1794,"log_dups_size":0,"ondisk_log_size":1794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:20:44.669761+0000","scrub_duration":0.099044419999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9277295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":10015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'142","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.955490+0000","last_change":"2023-10-18T11:38:16.955575+0000","last_active":"2023-10-18T11:38:16.955490+0000","last_peered":"2023-10-18T11:38:16.955490+0000","last_clean":"2023-10-18T11:38:16.955490+0000","last_became_active":"2023-10-18T11:09:39.420360+0000","last_became_peered":"2023-10-18T11:09:39.420360+0000","last_unstale":"2023-10-18T11:38:16.955490+0000","last_undegraded":"2023-10-18T11:38:16.955490+0000","last_fullsized":"2023-10-18T11:38:16.955490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:16.955379+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:16.955379+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.955379+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:19.773706+0000","scrub_duration":0.0027257150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'384","reported_seq":467,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:12.937269+0000","last_change":"2023-10-18T11:39:12.937564+0000","last_active":"2023-10-18T11:39:12.937269+0000","last_peered":"2023-10-18T11:39:12.937269+0000","last_clean":"2023-10-18T11:39:12.937269+0000","last_became_active":"2023-10-18T11:09:46.109807+0000","last_became_peered":"2023-10-18T11:09:46.109807+0000","last_unstale":"2023-10-18T11:39:12.937269+0000","last_undegraded":"2023-10-18T11:39:12.937269+0000","last_fullsized":"2023-10-18T11:39:12.937269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'384","last_scrub_stamp":"2023-10-18T11:39:12.937058+0000","last_deep_scrub":"31'384","last_deep_scrub_stamp":"2023-10-18T11:39:12.937058+0000","last_clean_scrub_stamp":"2023-10-18T11:39:12.937058+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:44:43.964531+0000","scrub_duration":0.0099049389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":285,"num_write_kb":10314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'1439","reported_seq":1484,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.051102+0000","last_change":"2023-10-18T11:38:23.051102+0000","last_active":"2023-10-18T11:38:23.051102+0000","last_peered":"2023-10-18T11:38:23.051102+0000","last_clean":"2023-10-18T11:38:23.051102+0000","last_became_active":"2023-10-18T11:09:36.908091+0000","last_became_peered":"2023-10-18T11:09:36.908091+0000","last_unstale":"2023-10-18T11:38:23.051102+0000","last_undegraded":"2023-10-18T11:38:23.051102+0000","last_fullsized":"2023-10-18T11:38:23.051102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1439","last_scrub_stamp":"2023-10-18T11:38:23.050919+0000","last_deep_scrub":"31'1439","last_deep_scrub_stamp":"2023-10-18T11:38:23.050919+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.050919+0000","objects_scrubbed":2,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:37.205626+0000","scrub_duration":0.089910790000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1431,"num_write_kb":8901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'165","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.966648+0000","last_change":"2023-10-18T11:38:31.966648+0000","last_active":"2023-10-18T11:38:31.966648+0000","last_peered":"2023-10-18T11:38:31.966648+0000","last_clean":"2023-10-18T11:38:31.966648+0000","last_became_active":"2023-10-18T11:09:39.362014+0000","last_became_peered":"2023-10-18T11:09:39.362014+0000","last_unstale":"2023-10-18T11:38:31.966648+0000","last_undegraded":"2023-10-18T11:38:31.966648+0000","last_fullsized":"2023-10-18T11:38:31.966648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2023-10-18T11:38:31.966374+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2023-10-18T11:38:31.966374+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.966374+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:57:30.180571+0000","scrub_duration":0.0039781039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'453","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.642188+0000","last_change":"2023-10-18T11:38:38.642188+0000","last_active":"2023-10-18T11:38:38.642188+0000","last_peered":"2023-10-18T11:38:38.642188+0000","last_clean":"2023-10-18T11:38:38.642188+0000","last_became_active":"2023-10-18T11:09:46.109573+0000","last_became_peered":"2023-10-18T11:09:46.109573+0000","last_unstale":"2023-10-18T11:38:38.642188+0000","last_undegraded":"2023-10-18T11:38:38.642188+0000","last_fullsized":"2023-10-18T11:38:38.642188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'453","last_scrub_stamp":"2023-10-18T11:38:38.642006+0000","last_deep_scrub":"31'453","last_deep_scrub_stamp":"2023-10-18T11:38:38.642006+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.642006+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:43.682379+0000","scrub_duration":0.0041783769999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":14204,"num_write":357,"num_write_kb":21017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'825","reported_seq":867,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:34.615623+0000","last_change":"2023-10-18T11:38:34.615623+0000","last_active":"2023-10-18T11:38:34.615623+0000","last_peered":"2023-10-18T11:38:34.615623+0000","last_clean":"2023-10-18T11:38:34.615623+0000","last_became_active":"2023-10-18T11:09:36.896467+0000","last_became_peered":"2023-10-18T11:09:36.896467+0000","last_unstale":"2023-10-18T11:38:34.615623+0000","last_undegraded":"2023-10-18T11:38:34.615623+0000","last_fullsized":"2023-10-18T11:38:34.615623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'825","last_scrub_stamp":"2023-10-18T11:38:34.615490+0000","last_deep_scrub":"31'825","last_deep_scrub_stamp":"2023-10-18T11:38:34.615490+0000","last_clean_scrub_stamp":"2023-10-18T11:38:34.615490+0000","objects_scrubbed":8,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:39.655863+0000","scrub_duration":0.025506078000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3060357,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'145","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.303391+0000","last_change":"2023-10-18T11:38:37.303430+0000","last_active":"2023-10-18T11:38:37.303391+0000","last_peered":"2023-10-18T11:38:37.303391+0000","last_clean":"2023-10-18T11:38:37.303391+0000","last_became_active":"2023-10-18T11:09:39.396942+0000","last_became_peered":"2023-10-18T11:09:39.396942+0000","last_unstale":"2023-10-18T11:38:37.303391+0000","last_undegraded":"2023-10-18T11:38:37.303391+0000","last_fullsized":"2023-10-18T11:38:37.303391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:37.303321+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:37.303321+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.303321+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:55:06.926563+0000","scrub_duration":0.001256479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'331","reported_seq":412,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:45.741405+0000","last_change":"2023-10-18T11:38:45.741499+0000","last_active":"2023-10-18T11:38:45.741405+0000","last_peered":"2023-10-18T11:38:45.741405+0000","last_clean":"2023-10-18T11:38:45.741405+0000","last_became_active":"2023-10-18T11:09:46.114450+0000","last_became_peered":"2023-10-18T11:09:46.114450+0000","last_unstale":"2023-10-18T11:38:45.741405+0000","last_undegraded":"2023-10-18T11:38:45.741405+0000","last_fullsized":"2023-10-18T11:38:45.741405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'331","last_scrub_stamp":"2023-10-18T11:38:45.741329+0000","last_deep_scrub":"31'331","last_deep_scrub_stamp":"2023-10-18T11:38:45.741329+0000","last_clean_scrub_stamp":"2023-10-18T11:38:45.741329+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:50.693803+0000","scrub_duration":0.0043312309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":213,"num_write_kb":9865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'10","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.523502+0000","last_change":"2023-10-18T11:38:21.523502+0000","last_active":"2023-10-18T11:38:21.523502+0000","last_peered":"2023-10-18T11:38:21.523502+0000","last_clean":"2023-10-18T11:38:21.523502+0000","last_became_active":"2023-10-18T11:09:36.794735+0000","last_became_peered":"2023-10-18T11:09:36.794735+0000","last_unstale":"2023-10-18T11:38:21.523502+0000","last_undegraded":"2023-10-18T11:38:21.523502+0000","last_fullsized":"2023-10-18T11:38:21.523502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-10-18T11:38:21.523393+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-10-18T11:38:21.523393+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.523393+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:57:54.359212+0000","scrub_duration":0.008442148,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'167","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:50.073173+0000","last_change":"2023-10-18T11:38:50.073212+0000","last_active":"2023-10-18T11:38:50.073173+0000","last_peered":"2023-10-18T11:38:50.073173+0000","last_clean":"2023-10-18T11:38:50.073173+0000","last_became_active":"2023-10-18T11:09:39.398401+0000","last_became_peered":"2023-10-18T11:09:39.398401+0000","last_unstale":"2023-10-18T11:38:50.073173+0000","last_undegraded":"2023-10-18T11:38:50.073173+0000","last_fullsized":"2023-10-18T11:38:50.073173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-10-18T11:38:50.073100+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-10-18T11:38:50.073100+0000","last_clean_scrub_stamp":"2023-10-18T11:38:50.073100+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:14:40.873775+0000","scrub_duration":0.0014290189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'461","reported_seq":552,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:48.707189+0000","last_change":"2023-10-18T11:38:48.707251+0000","last_active":"2023-10-18T11:38:48.707189+0000","last_peered":"2023-10-18T11:38:48.707189+0000","last_clean":"2023-10-18T11:38:48.707189+0000","last_became_active":"2023-10-18T11:09:46.114873+0000","last_became_peered":"2023-10-18T11:09:46.114873+0000","last_unstale":"2023-10-18T11:38:48.707189+0000","last_undegraded":"2023-10-18T11:38:48.707189+0000","last_fullsized":"2023-10-18T11:38:48.707189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'461","last_scrub_stamp":"2023-10-18T11:38:48.707107+0000","last_deep_scrub":"31'461","last_deep_scrub_stamp":"2023-10-18T11:38:48.707107+0000","last_clean_scrub_stamp":"2023-10-18T11:38:48.707107+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:39:13.854788+0000","scrub_duration":0.0044031340000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":15764,"num_write":351,"num_write_kb":32860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'140","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.567551+0000","last_change":"2023-10-18T11:38:31.567593+0000","last_active":"2023-10-18T11:38:31.567551+0000","last_peered":"2023-10-18T11:38:31.567551+0000","last_clean":"2023-10-18T11:38:31.567551+0000","last_became_active":"2023-10-18T11:09:39.396985+0000","last_became_peered":"2023-10-18T11:09:39.396985+0000","last_unstale":"2023-10-18T11:38:31.567551+0000","last_undegraded":"2023-10-18T11:38:31.567551+0000","last_fullsized":"2023-10-18T11:38:31.567551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'140","last_scrub_stamp":"2023-10-18T11:38:31.567485+0000","last_deep_scrub":"31'140","last_deep_scrub_stamp":"2023-10-18T11:38:31.567485+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.567485+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:17.382614+0000","scrub_duration":0.0011892719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'770","reported_seq":813,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.579965+0000","last_change":"2023-10-18T11:38:20.579965+0000","last_active":"2023-10-18T11:38:20.579965+0000","last_peered":"2023-10-18T11:38:20.579965+0000","last_clean":"2023-10-18T11:38:20.579965+0000","last_became_active":"2023-10-18T11:09:36.892715+0000","last_became_peered":"2023-10-18T11:09:36.892715+0000","last_unstale":"2023-10-18T11:38:20.579965+0000","last_undegraded":"2023-10-18T11:38:20.579965+0000","last_fullsized":"2023-10-18T11:38:20.579965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'770","last_scrub_stamp":"2023-10-18T11:38:20.579828+0000","last_deep_scrub":"31'770","last_deep_scrub_stamp":"2023-10-18T11:38:20.579828+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.579828+0000","objects_scrubbed":3,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:49.808441+0000","scrub_duration":0.018364789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'437","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:40.640322+0000","last_change":"2023-10-18T11:38:40.640322+0000","last_active":"2023-10-18T11:38:40.640322+0000","last_peered":"2023-10-18T11:38:40.640322+0000","last_clean":"2023-10-18T11:38:40.640322+0000","last_became_active":"2023-10-18T11:09:46.095699+0000","last_became_peered":"2023-10-18T11:09:46.095699+0000","last_unstale":"2023-10-18T11:38:40.640322+0000","last_undegraded":"2023-10-18T11:38:40.640322+0000","last_fullsized":"2023-10-18T11:38:40.640322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'437","last_scrub_stamp":"2023-10-18T11:38:40.640174+0000","last_deep_scrub":"31'437","last_deep_scrub_stamp":"2023-10-18T11:38:40.640174+0000","last_clean_scrub_stamp":"2023-10-18T11:38:40.640174+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:14.673448+0000","scrub_duration":0.0046948529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":11430,"num_write":325,"num_write_kb":7784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'139","reported_seq":179,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.093847+0000","last_change":"2023-10-18T11:38:30.093847+0000","last_active":"2023-10-18T11:38:30.093847+0000","last_peered":"2023-10-18T11:38:30.093847+0000","last_clean":"2023-10-18T11:38:30.093847+0000","last_became_active":"2023-10-18T11:09:39.422655+0000","last_became_peered":"2023-10-18T11:09:39.422655+0000","last_unstale":"2023-10-18T11:38:30.093847+0000","last_undegraded":"2023-10-18T11:38:30.093847+0000","last_fullsized":"2023-10-18T11:38:30.093847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'139","last_scrub_stamp":"2023-10-18T11:38:30.093539+0000","last_deep_scrub":"31'139","last_deep_scrub_stamp":"2023-10-18T11:38:30.093539+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.093539+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:04.126814+0000","scrub_duration":0.0040762330000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'486","reported_seq":529,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.714481+0000","last_change":"2023-10-18T11:38:15.714604+0000","last_active":"2023-10-18T11:38:15.714481+0000","last_peered":"2023-10-18T11:38:15.714481+0000","last_clean":"2023-10-18T11:38:15.714481+0000","last_became_active":"2023-10-18T11:09:36.913220+0000","last_became_peered":"2023-10-18T11:09:36.913220+0000","last_unstale":"2023-10-18T11:38:15.714481+0000","last_undegraded":"2023-10-18T11:38:15.714481+0000","last_fullsized":"2023-10-18T11:38:15.714481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'486","last_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_deep_scrub":"31'486","last_deep_scrub_stamp":"2023-10-18T11:38:15.714323+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.714323+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:22:01.854784+0000","scrub_duration":0.005976121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1292,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'427","reported_seq":528,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:44.740500+0000","last_change":"2023-10-18T11:38:44.740500+0000","last_active":"2023-10-18T11:38:44.740500+0000","last_peered":"2023-10-18T11:38:44.740500+0000","last_clean":"2023-10-18T11:38:44.740500+0000","last_became_active":"2023-10-18T11:09:46.114366+0000","last_became_peered":"2023-10-18T11:09:46.114366+0000","last_unstale":"2023-10-18T11:38:44.740500+0000","last_undegraded":"2023-10-18T11:38:44.740500+0000","last_fullsized":"2023-10-18T11:38:44.740500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'427","last_scrub_stamp":"2023-10-18T11:38:44.740345+0000","last_deep_scrub":"31'427","last_deep_scrub_stamp":"2023-10-18T11:38:44.740345+0000","last_clean_scrub_stamp":"2023-10-18T11:38:44.740345+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:03.076796+0000","scrub_duration":0.0046967049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":327,"num_write_kb":17650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'148","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.949313+0000","last_change":"2023-10-18T11:38:14.949444+0000","last_active":"2023-10-18T11:38:14.949313+0000","last_peered":"2023-10-18T11:38:14.949313+0000","last_clean":"2023-10-18T11:38:14.949313+0000","last_became_active":"2023-10-18T11:09:39.419146+0000","last_became_peered":"2023-10-18T11:09:39.419146+0000","last_unstale":"2023-10-18T11:38:14.949313+0000","last_undegraded":"2023-10-18T11:38:14.949313+0000","last_fullsized":"2023-10-18T11:38:14.949313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-10-18T11:38:14.949157+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.949157+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:41:56.369387+0000","scrub_duration":0.0041327179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'284","reported_seq":327,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.832954+0000","last_change":"2023-10-18T11:38:21.833085+0000","last_active":"2023-10-18T11:38:21.832954+0000","last_peered":"2023-10-18T11:38:21.832954+0000","last_clean":"2023-10-18T11:38:21.832954+0000","last_became_active":"2023-10-18T11:09:36.914707+0000","last_became_peered":"2023-10-18T11:09:36.914707+0000","last_unstale":"2023-10-18T11:38:21.832954+0000","last_undegraded":"2023-10-18T11:38:21.832954+0000","last_fullsized":"2023-10-18T11:38:21.832954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'284","last_scrub_stamp":"2023-10-18T11:38:21.832756+0000","last_deep_scrub":"31'284","last_deep_scrub_stamp":"2023-10-18T11:38:21.832756+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.832756+0000","objects_scrubbed":4,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:25.405192+0000","scrub_duration":0.011219165,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'423","reported_seq":490,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:44.599463+0000","last_change":"2023-10-18T11:38:44.599463+0000","last_active":"2023-10-18T11:38:44.599463+0000","last_peered":"2023-10-18T11:38:44.599463+0000","last_clean":"2023-10-18T11:38:44.599463+0000","last_became_active":"2023-10-18T11:10:10.412996+0000","last_became_peered":"2023-10-18T11:10:10.412996+0000","last_unstale":"2023-10-18T11:38:44.599463+0000","last_undegraded":"2023-10-18T11:38:44.599463+0000","last_fullsized":"2023-10-18T11:38:44.599463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'423","last_scrub_stamp":"2023-10-18T11:38:44.598911+0000","last_deep_scrub":"31'423","last_deep_scrub_stamp":"2023-10-18T11:38:44.598911+0000","last_clean_scrub_stamp":"2023-10-18T11:38:44.598911+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:30.414039+0000","scrub_duration":0.0060615870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":8382,"num_write":324,"num_write_kb":16893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'124","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.596521+0000","last_change":"2023-10-18T11:38:16.596581+0000","last_active":"2023-10-18T11:38:16.596521+0000","last_peered":"2023-10-18T11:38:16.596521+0000","last_clean":"2023-10-18T11:38:16.596521+0000","last_became_active":"2023-10-18T11:09:39.398923+0000","last_became_peered":"2023-10-18T11:09:39.398923+0000","last_unstale":"2023-10-18T11:38:16.596521+0000","last_undegraded":"2023-10-18T11:38:16.596521+0000","last_fullsized":"2023-10-18T11:38:16.596521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'124","last_scrub_stamp":"2023-10-18T11:38:16.596449+0000","last_deep_scrub":"31'124","last_deep_scrub_stamp":"2023-10-18T11:38:16.596449+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.596449+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:46:57.233493+0000","scrub_duration":0.001755993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'9","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:40.590744+0000","last_change":"2023-10-18T11:38:40.590786+0000","last_active":"2023-10-18T11:38:40.590744+0000","last_peered":"2023-10-18T11:38:40.590744+0000","last_clean":"2023-10-18T11:38:40.590744+0000","last_became_active":"2023-10-18T11:09:36.797433+0000","last_became_peered":"2023-10-18T11:09:36.797433+0000","last_unstale":"2023-10-18T11:38:40.590744+0000","last_undegraded":"2023-10-18T11:38:40.590744+0000","last_fullsized":"2023-10-18T11:38:40.590744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-10-18T11:38:40.590681+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-10-18T11:38:40.590681+0000","last_clean_scrub_stamp":"2023-10-18T11:38:40.590681+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:12:10.767078+0000","scrub_duration":0.0057985620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'432","reported_seq":625,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:33.633067+0000","last_change":"2023-10-18T11:38:33.633067+0000","last_active":"2023-10-18T11:38:33.633067+0000","last_peered":"2023-10-18T11:38:33.633067+0000","last_clean":"2023-10-18T11:38:33.633067+0000","last_became_active":"2023-10-18T11:09:46.109030+0000","last_became_peered":"2023-10-18T11:09:46.109030+0000","last_unstale":"2023-10-18T11:38:33.633067+0000","last_undegraded":"2023-10-18T11:38:33.633067+0000","last_fullsized":"2023-10-18T11:38:33.633067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'432","last_scrub_stamp":"2023-10-18T11:38:33.632896+0000","last_deep_scrub":"31'432","last_deep_scrub_stamp":"2023-10-18T11:38:33.632896+0000","last_clean_scrub_stamp":"2023-10-18T11:38:33.632896+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:47.787602+0000","scrub_duration":0.0053552069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":19825,"num_write":333,"num_write_kb":19445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'132","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:28.012524+0000","last_change":"2023-10-18T11:38:28.012708+0000","last_active":"2023-10-18T11:38:28.012524+0000","last_peered":"2023-10-18T11:38:28.012524+0000","last_clean":"2023-10-18T11:38:28.012524+0000","last_became_active":"2023-10-18T11:09:39.365849+0000","last_became_peered":"2023-10-18T11:09:39.365849+0000","last_unstale":"2023-10-18T11:38:28.012524+0000","last_undegraded":"2023-10-18T11:38:28.012524+0000","last_fullsized":"2023-10-18T11:38:28.012524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2023-10-18T11:38:28.012283+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2023-10-18T11:38:28.012283+0000","last_clean_scrub_stamp":"2023-10-18T11:38:28.012283+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:02.045557+0000","scrub_duration":0.0049242060000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'17","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.715097+0000","last_change":"2023-10-18T11:38:18.715180+0000","last_active":"2023-10-18T11:38:18.715097+0000","last_peered":"2023-10-18T11:38:18.715097+0000","last_clean":"2023-10-18T11:38:18.715097+0000","last_became_active":"2023-10-18T11:09:36.896281+0000","last_became_peered":"2023-10-18T11:09:36.896281+0000","last_unstale":"2023-10-18T11:38:18.715097+0000","last_undegraded":"2023-10-18T11:38:18.715097+0000","last_fullsized":"2023-10-18T11:38:18.715097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'17","last_scrub_stamp":"2023-10-18T11:38:18.715002+0000","last_deep_scrub":"31'17","last_deep_scrub_stamp":"2023-10-18T11:38:18.715002+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.715002+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:34.623209+0000","scrub_duration":0.0046622959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'438","reported_seq":530,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.622058+0000","last_change":"2023-10-18T11:38:30.622058+0000","last_active":"2023-10-18T11:38:30.622058+0000","last_peered":"2023-10-18T11:38:30.622058+0000","last_clean":"2023-10-18T11:38:30.622058+0000","last_became_active":"2023-10-18T11:09:46.093802+0000","last_became_peered":"2023-10-18T11:09:46.093802+0000","last_unstale":"2023-10-18T11:38:30.622058+0000","last_undegraded":"2023-10-18T11:38:30.622058+0000","last_fullsized":"2023-10-18T11:38:30.622058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'438","last_scrub_stamp":"2023-10-18T11:38:30.621913+0000","last_deep_scrub":"31'438","last_deep_scrub_stamp":"2023-10-18T11:38:30.621913+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.621913+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:04.843486+0000","scrub_duration":0.0026375550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":16856,"num_write":335,"num_write_kb":23716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'142","reported_seq":182,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.111901+0000","last_change":"2023-10-18T11:38:38.112111+0000","last_active":"2023-10-18T11:38:38.111901+0000","last_peered":"2023-10-18T11:38:38.111901+0000","last_clean":"2023-10-18T11:38:38.111901+0000","last_became_active":"2023-10-18T11:09:39.419023+0000","last_became_peered":"2023-10-18T11:09:39.419023+0000","last_unstale":"2023-10-18T11:38:38.111901+0000","last_undegraded":"2023-10-18T11:38:38.111901+0000","last_fullsized":"2023-10-18T11:38:38.111901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:38.111667+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:38.111667+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.111667+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:12:08.288064+0000","scrub_duration":0.0040221160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'292","reported_seq":335,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:22.871865+0000","last_change":"2023-10-18T11:38:22.872065+0000","last_active":"2023-10-18T11:38:22.871865+0000","last_peered":"2023-10-18T11:38:22.871865+0000","last_clean":"2023-10-18T11:38:22.871865+0000","last_became_active":"2023-10-18T11:09:36.913342+0000","last_became_peered":"2023-10-18T11:09:36.913342+0000","last_unstale":"2023-10-18T11:38:22.871865+0000","last_undegraded":"2023-10-18T11:38:22.871865+0000","last_fullsized":"2023-10-18T11:38:22.871865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'292","last_scrub_stamp":"2023-10-18T11:38:22.871678+0000","last_deep_scrub":"31'292","last_deep_scrub_stamp":"2023-10-18T11:38:22.871678+0000","last_clean_scrub_stamp":"2023-10-18T11:38:22.871678+0000","objects_scrubbed":4,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:37.026385+0000","scrub_duration":0.014122981999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'450","reported_seq":544,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:13.938382+0000","last_change":"2023-10-18T11:39:13.938556+0000","last_active":"2023-10-18T11:39:13.938382+0000","last_peered":"2023-10-18T11:39:13.938382+0000","last_clean":"2023-10-18T11:39:13.938382+0000","last_became_active":"2023-10-18T11:09:46.111878+0000","last_became_peered":"2023-10-18T11:09:46.111878+0000","last_unstale":"2023-10-18T11:39:13.938382+0000","last_undegraded":"2023-10-18T11:39:13.938382+0000","last_fullsized":"2023-10-18T11:39:13.938382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'450","last_scrub_stamp":"2023-10-18T11:39:13.938180+0000","last_deep_scrub":"31'450","last_deep_scrub_stamp":"2023-10-18T11:39:13.938180+0000","last_clean_scrub_stamp":"2023-10-18T11:39:13.938180+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:54:38.628933+0000","scrub_duration":0.0066451879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":337,"num_write_kb":25264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'150","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:30.964725+0000","last_change":"2023-10-18T11:38:30.964725+0000","last_active":"2023-10-18T11:38:30.964725+0000","last_peered":"2023-10-18T11:38:30.964725+0000","last_clean":"2023-10-18T11:38:30.964725+0000","last_became_active":"2023-10-18T11:09:39.242810+0000","last_became_peered":"2023-10-18T11:09:39.242810+0000","last_unstale":"2023-10-18T11:38:30.964725+0000","last_undegraded":"2023-10-18T11:38:30.964725+0000","last_fullsized":"2023-10-18T11:38:30.964725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2023-10-18T11:38:30.964435+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2023-10-18T11:38:30.964435+0000","last_clean_scrub_stamp":"2023-10-18T11:38:30.964435+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:36.004808+0000","scrub_duration":0.0040942510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'245","reported_seq":289,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.473647+0000","last_change":"2023-10-18T11:38:29.473647+0000","last_active":"2023-10-18T11:38:29.473647+0000","last_peered":"2023-10-18T11:38:29.473647+0000","last_clean":"2023-10-18T11:38:29.473647+0000","last_became_active":"2023-10-18T11:09:36.798212+0000","last_became_peered":"2023-10-18T11:09:36.798212+0000","last_unstale":"2023-10-18T11:38:29.473647+0000","last_undegraded":"2023-10-18T11:38:29.473647+0000","last_fullsized":"2023-10-18T11:38:29.473647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'245","last_scrub_stamp":"2023-10-18T11:38:29.473550+0000","last_deep_scrub":"31'245","last_deep_scrub_stamp":"2023-10-18T11:38:29.473550+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.473550+0000","objects_scrubbed":3,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:43.628257+0000","scrub_duration":0.0080227579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'490","reported_seq":572,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:59.121635+0000","last_change":"2023-10-18T11:38:59.121848+0000","last_active":"2023-10-18T11:38:59.121635+0000","last_peered":"2023-10-18T11:38:59.121635+0000","last_clean":"2023-10-18T11:38:59.121635+0000","last_became_active":"2023-10-18T11:09:46.102267+0000","last_became_peered":"2023-10-18T11:09:46.102267+0000","last_unstale":"2023-10-18T11:38:59.121635+0000","last_undegraded":"2023-10-18T11:38:59.121635+0000","last_fullsized":"2023-10-18T11:38:59.121635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'490","last_scrub_stamp":"2023-10-18T11:38:59.121469+0000","last_deep_scrub":"31'490","last_deep_scrub_stamp":"2023-10-18T11:38:59.121469+0000","last_clean_scrub_stamp":"2023-10-18T11:38:59.121469+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:48:42.729260+0000","scrub_duration":0.0050932360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":390,"num_write_kb":31170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'172","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:46.168808+0000","last_change":"2023-10-18T11:38:46.168808+0000","last_active":"2023-10-18T11:38:46.168808+0000","last_peered":"2023-10-18T11:38:46.168808+0000","last_clean":"2023-10-18T11:38:46.168808+0000","last_became_active":"2023-10-18T11:09:39.417028+0000","last_became_peered":"2023-10-18T11:09:39.417028+0000","last_unstale":"2023-10-18T11:38:46.168808+0000","last_undegraded":"2023-10-18T11:38:46.168808+0000","last_fullsized":"2023-10-18T11:38:46.168808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'172","last_scrub_stamp":"2023-10-18T11:38:46.168705+0000","last_deep_scrub":"31'172","last_deep_scrub_stamp":"2023-10-18T11:38:46.168705+0000","last_clean_scrub_stamp":"2023-10-18T11:38:46.168705+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:43:35.619956+0000","scrub_duration":0.0025812449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'791","reported_seq":835,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.776538+0000","last_change":"2023-10-18T11:38:13.776538+0000","last_active":"2023-10-18T11:38:13.776538+0000","last_peered":"2023-10-18T11:38:13.776538+0000","last_clean":"2023-10-18T11:38:13.776538+0000","last_became_active":"2023-10-18T11:09:36.909252+0000","last_became_peered":"2023-10-18T11:09:36.909252+0000","last_unstale":"2023-10-18T11:38:13.776538+0000","last_undegraded":"2023-10-18T11:38:13.776538+0000","last_fullsized":"2023-10-18T11:38:13.776538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'791","last_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_deep_scrub":"31'791","last_deep_scrub_stamp":"2023-10-18T11:38:13.776362+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.776362+0000","objects_scrubbed":1,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.684568+0000","scrub_duration":0.035930087999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'468","reported_seq":537,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:48.991355+0000","last_change":"2023-10-18T11:38:48.991355+0000","last_active":"2023-10-18T11:38:48.991355+0000","last_peered":"2023-10-18T11:38:48.991355+0000","last_clean":"2023-10-18T11:38:48.991355+0000","last_became_active":"2023-10-18T11:09:46.098918+0000","last_became_peered":"2023-10-18T11:09:46.098918+0000","last_unstale":"2023-10-18T11:38:48.991355+0000","last_undegraded":"2023-10-18T11:38:48.991355+0000","last_fullsized":"2023-10-18T11:38:48.991355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'468","last_scrub_stamp":"2023-10-18T11:38:48.990848+0000","last_deep_scrub":"31'468","last_deep_scrub_stamp":"2023-10-18T11:38:48.990848+0000","last_clean_scrub_stamp":"2023-10-18T11:38:48.990848+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:53.651083+0000","scrub_duration":0.0055479769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":9414,"num_write":343,"num_write_kb":17104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"31'148","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:24.579369+0000","last_change":"2023-10-18T11:38:24.579369+0000","last_active":"2023-10-18T11:38:24.579369+0000","last_peered":"2023-10-18T11:38:24.579369+0000","last_clean":"2023-10-18T11:38:24.579369+0000","last_became_active":"2023-10-18T11:09:39.400335+0000","last_became_peered":"2023-10-18T11:09:39.400335+0000","last_unstale":"2023-10-18T11:38:24.579369+0000","last_undegraded":"2023-10-18T11:38:24.579369+0000","last_fullsized":"2023-10-18T11:38:24.579369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-10-18T11:38:24.579245+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-10-18T11:38:24.579245+0000","last_clean_scrub_stamp":"2023-10-18T11:38:24.579245+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:05.999475+0000","scrub_duration":0.00254185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'1651","reported_seq":1695,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.284837+0000","last_change":"2023-10-18T11:38:26.284837+0000","last_active":"2023-10-18T11:38:26.284837+0000","last_peered":"2023-10-18T11:38:26.284837+0000","last_clean":"2023-10-18T11:38:26.284837+0000","last_became_active":"2023-10-18T11:09:36.914735+0000","last_became_peered":"2023-10-18T11:09:36.914735+0000","last_unstale":"2023-10-18T11:38:26.284837+0000","last_undegraded":"2023-10-18T11:38:26.284837+0000","last_fullsized":"2023-10-18T11:38:26.284837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1651","last_scrub_stamp":"2023-10-18T11:38:26.284633+0000","last_deep_scrub":"31'1651","last_deep_scrub_stamp":"2023-10-18T11:38:26.284633+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.284633+0000","objects_scrubbed":3,"log_size":1651,"log_dups_size":0,"ondisk_log_size":1651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:00.506206+0000","scrub_duration":0.080692793999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1639,"num_write_kb":9112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'412","reported_seq":507,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:59.080288+0000","last_change":"2023-10-18T11:38:59.080504+0000","last_active":"2023-10-18T11:38:59.080288+0000","last_peered":"2023-10-18T11:38:59.080288+0000","last_clean":"2023-10-18T11:38:59.080288+0000","last_became_active":"2023-10-18T11:09:46.111720+0000","last_became_peered":"2023-10-18T11:09:46.111720+0000","last_unstale":"2023-10-18T11:38:59.080288+0000","last_undegraded":"2023-10-18T11:38:59.080288+0000","last_fullsized":"2023-10-18T11:38:59.080288+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'412","last_scrub_stamp":"2023-10-18T11:38:59.080117+0000","last_deep_scrub":"31'412","last_deep_scrub_stamp":"2023-10-18T11:38:59.080117+0000","last_clean_scrub_stamp":"2023-10-18T11:38:59.080117+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:51:45.539656+0000","scrub_duration":0.0072235390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":14478,"num_write":303,"num_write_kb":12107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'145","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:36.940989+0000","last_change":"2023-10-18T11:38:36.941113+0000","last_active":"2023-10-18T11:38:36.940989+0000","last_peered":"2023-10-18T11:38:36.940989+0000","last_clean":"2023-10-18T11:38:36.940989+0000","last_became_active":"2023-10-18T11:09:39.242570+0000","last_became_peered":"2023-10-18T11:09:39.242570+0000","last_unstale":"2023-10-18T11:38:36.940989+0000","last_undegraded":"2023-10-18T11:38:36.940989+0000","last_fullsized":"2023-10-18T11:38:36.940989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:36.940776+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:36.940776+0000","last_clean_scrub_stamp":"2023-10-18T11:38:36.940776+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:57:35.154973+0000","scrub_duration":0.0037340989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'1267","reported_seq":1768,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.829671+0000","last_change":"2023-10-18T11:38:18.829671+0000","last_active":"2023-10-18T11:38:18.829671+0000","last_peered":"2023-10-18T11:38:18.829671+0000","last_clean":"2023-10-18T11:38:18.829671+0000","last_became_active":"2023-10-18T11:09:36.908234+0000","last_became_peered":"2023-10-18T11:09:36.908234+0000","last_unstale":"2023-10-18T11:38:18.829671+0000","last_undegraded":"2023-10-18T11:38:18.829671+0000","last_fullsized":"2023-10-18T11:38:18.829671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1267","last_scrub_stamp":"2023-10-18T11:38:18.829387+0000","last_deep_scrub":"31'1267","last_deep_scrub_stamp":"2023-10-18T11:38:18.829387+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.829387+0000","objects_scrubbed":5,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:33:56.899504+0000","scrub_duration":0.050335492000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4329052,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":492,"num_write":1258,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'421","reported_seq":536,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:54.024248+0000","last_change":"2023-10-18T11:38:54.024444+0000","last_active":"2023-10-18T11:38:54.024248+0000","last_peered":"2023-10-18T11:38:54.024248+0000","last_clean":"2023-10-18T11:38:54.024248+0000","last_became_active":"2023-10-18T11:09:46.113999+0000","last_became_peered":"2023-10-18T11:09:46.113999+0000","last_unstale":"2023-10-18T11:38:54.024248+0000","last_undegraded":"2023-10-18T11:38:54.024248+0000","last_fullsized":"2023-10-18T11:38:54.024248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'421","last_scrub_stamp":"2023-10-18T11:38:54.024078+0000","last_deep_scrub":"31'421","last_deep_scrub_stamp":"2023-10-18T11:38:54.024078+0000","last_clean_scrub_stamp":"2023-10-18T11:38:54.024078+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:36.911182+0000","scrub_duration":0.0068162250000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":19812,"num_write":327,"num_write_kb":12739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'143","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.055509+0000","last_change":"2023-10-18T11:38:18.055509+0000","last_active":"2023-10-18T11:38:18.055509+0000","last_peered":"2023-10-18T11:38:18.055509+0000","last_clean":"2023-10-18T11:38:18.055509+0000","last_became_active":"2023-10-18T11:09:39.403532+0000","last_became_peered":"2023-10-18T11:09:39.403532+0000","last_unstale":"2023-10-18T11:38:18.055509+0000","last_undegraded":"2023-10-18T11:38:18.055509+0000","last_fullsized":"2023-10-18T11:38:18.055509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'143","last_scrub_stamp":"2023-10-18T11:38:18.055229+0000","last_deep_scrub":"31'143","last_deep_scrub_stamp":"2023-10-18T11:38:18.055229+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.055229+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:21.627664+0000","scrub_duration":0.0029786410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'377","reported_seq":422,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.593095+0000","last_change":"2023-10-18T11:38:37.593095+0000","last_active":"2023-10-18T11:38:37.593095+0000","last_peered":"2023-10-18T11:38:37.593095+0000","last_clean":"2023-10-18T11:38:37.593095+0000","last_became_active":"2023-10-18T11:09:36.913533+0000","last_became_peered":"2023-10-18T11:09:36.913533+0000","last_unstale":"2023-10-18T11:38:37.593095+0000","last_undegraded":"2023-10-18T11:38:37.593095+0000","last_fullsized":"2023-10-18T11:38:37.593095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'377","last_scrub_stamp":"2023-10-18T11:38:37.592987+0000","last_deep_scrub":"31'377","last_deep_scrub_stamp":"2023-10-18T11:38:37.592987+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.592987+0000","objects_scrubbed":2,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:03:20.703498+0000","scrub_duration":0.020092005999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956517,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'424","reported_seq":525,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:52.127431+0000","last_change":"2023-10-18T11:38:52.127595+0000","last_active":"2023-10-18T11:38:52.127431+0000","last_peered":"2023-10-18T11:38:52.127431+0000","last_clean":"2023-10-18T11:38:52.127431+0000","last_became_active":"2023-10-18T11:09:46.092205+0000","last_became_peered":"2023-10-18T11:09:46.092205+0000","last_unstale":"2023-10-18T11:38:52.127431+0000","last_undegraded":"2023-10-18T11:38:52.127431+0000","last_fullsized":"2023-10-18T11:38:52.127431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'424","last_scrub_stamp":"2023-10-18T11:38:52.127271+0000","last_deep_scrub":"31'424","last_deep_scrub_stamp":"2023-10-18T11:38:52.127271+0000","last_clean_scrub_stamp":"2023-10-18T11:38:52.127271+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:47:05.785782+0000","scrub_duration":0.006042141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":16256,"num_write":329,"num_write_kb":22819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'140","reported_seq":181,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:53.019020+0000","last_change":"2023-10-18T11:38:53.019150+0000","last_active":"2023-10-18T11:38:53.019020+0000","last_peered":"2023-10-18T11:38:53.019020+0000","last_clean":"2023-10-18T11:38:53.019020+0000","last_became_active":"2023-10-18T11:09:39.421999+0000","last_became_peered":"2023-10-18T11:09:39.421999+0000","last_unstale":"2023-10-18T11:38:53.019020+0000","last_undegraded":"2023-10-18T11:38:53.019020+0000","last_fullsized":"2023-10-18T11:38:53.019020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'140","last_scrub_stamp":"2023-10-18T11:38:53.018795+0000","last_deep_scrub":"31'140","last_deep_scrub_stamp":"2023-10-18T11:38:53.018795+0000","last_clean_scrub_stamp":"2023-10-18T11:38:53.018795+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:57.679029+0000","scrub_duration":0.0031559790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.202419+0000","last_change":"2023-10-18T11:38:29.202419+0000","last_active":"2023-10-18T11:38:29.202419+0000","last_peered":"2023-10-18T11:38:29.202419+0000","last_clean":"2023-10-18T11:38:29.202419+0000","last_became_active":"2023-10-18T11:09:36.828251+0000","last_became_peered":"2023-10-18T11:09:36.828251+0000","last_unstale":"2023-10-18T11:38:29.202419+0000","last_undegraded":"2023-10-18T11:38:29.202419+0000","last_fullsized":"2023-10-18T11:38:29.202419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-10-18T11:38:29.202254+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-10-18T11:38:29.202254+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.202254+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:32.774689+0000","scrub_duration":0.011167610999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:19.573937+0000","last_change":"2023-10-18T11:38:19.573937+0000","last_active":"2023-10-18T11:38:19.573937+0000","last_peered":"2023-10-18T11:38:19.573937+0000","last_clean":"2023-10-18T11:38:19.573937+0000","last_became_active":"2023-10-18T11:09:19.365367+0000","last_became_peered":"2023-10-18T11:09:19.365367+0000","last_unstale":"2023-10-18T11:38:19.573937+0000","last_undegraded":"2023-10-18T11:38:19.573937+0000","last_fullsized":"2023-10-18T11:38:19.573937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-10-18T11:38:19.573815+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-10-18T11:38:19.573815+0000","last_clean_scrub_stamp":"2023-10-18T11:38:19.573815+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:22.392143+0000","scrub_duration":0.0092019140000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'526","reported_seq":641,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.527039+0000","last_change":"2023-10-18T11:38:51.527039+0000","last_active":"2023-10-18T11:38:51.527039+0000","last_peered":"2023-10-18T11:38:51.527039+0000","last_clean":"2023-10-18T11:38:51.527039+0000","last_became_active":"2023-10-18T11:09:46.118193+0000","last_became_peered":"2023-10-18T11:09:46.118193+0000","last_unstale":"2023-10-18T11:38:51.527039+0000","last_undegraded":"2023-10-18T11:38:51.527039+0000","last_fullsized":"2023-10-18T11:38:51.527039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'526","last_scrub_stamp":"2023-10-18T11:38:51.526893+0000","last_deep_scrub":"31'526","last_deep_scrub_stamp":"2023-10-18T11:38:51.526893+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.526893+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:39:16.674574+0000","scrub_duration":0.003785755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":19822,"num_write":415,"num_write_kb":19524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'153","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:56.721242+0000","last_change":"2023-10-18T11:38:56.721288+0000","last_active":"2023-10-18T11:38:56.721242+0000","last_peered":"2023-10-18T11:38:56.721242+0000","last_clean":"2023-10-18T11:38:56.721242+0000","last_became_active":"2023-10-18T11:09:39.355176+0000","last_became_peered":"2023-10-18T11:09:39.355176+0000","last_unstale":"2023-10-18T11:38:56.721242+0000","last_undegraded":"2023-10-18T11:38:56.721242+0000","last_fullsized":"2023-10-18T11:38:56.721242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:56.721148+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:56.721148+0000","last_clean_scrub_stamp":"2023-10-18T11:38:56.721148+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:39.608251+0000","scrub_duration":0.001787432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'902","reported_seq":945,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:21.776996+0000","last_change":"2023-10-18T11:38:21.776996+0000","last_active":"2023-10-18T11:38:21.776996+0000","last_peered":"2023-10-18T11:38:21.776996+0000","last_clean":"2023-10-18T11:38:21.776996+0000","last_became_active":"2023-10-18T11:09:36.828307+0000","last_became_peered":"2023-10-18T11:09:36.828307+0000","last_unstale":"2023-10-18T11:38:21.776996+0000","last_undegraded":"2023-10-18T11:38:21.776996+0000","last_fullsized":"2023-10-18T11:38:21.776996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'902","last_scrub_stamp":"2023-10-18T11:38:21.776574+0000","last_deep_scrub":"31'902","last_deep_scrub_stamp":"2023-10-18T11:38:21.776574+0000","last_clean_scrub_stamp":"2023-10-18T11:38:21.776574+0000","objects_scrubbed":3,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:47:08.842481+0000","scrub_duration":0.042635698999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":4597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'411","reported_seq":531,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:06.609547+0000","last_change":"2023-10-18T11:39:06.609604+0000","last_active":"2023-10-18T11:39:06.609547+0000","last_peered":"2023-10-18T11:39:06.609547+0000","last_clean":"2023-10-18T11:39:06.609547+0000","last_became_active":"2023-10-18T11:10:10.418316+0000","last_became_peered":"2023-10-18T11:10:10.418316+0000","last_unstale":"2023-10-18T11:39:06.609547+0000","last_undegraded":"2023-10-18T11:39:06.609547+0000","last_fullsized":"2023-10-18T11:39:06.609547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'411","last_scrub_stamp":"2023-10-18T11:39:06.609469+0000","last_deep_scrub":"31'411","last_deep_scrub_stamp":"2023-10-18T11:39:06.609469+0000","last_clean_scrub_stamp":"2023-10-18T11:39:06.609469+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:48:50.217261+0000","scrub_duration":0.0051196439999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":18796,"num_write":308,"num_write_kb":13390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'137","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:48.136433+0000","last_change":"2023-10-18T11:38:48.136433+0000","last_active":"2023-10-18T11:38:48.136433+0000","last_peered":"2023-10-18T11:38:48.136433+0000","last_clean":"2023-10-18T11:38:48.136433+0000","last_became_active":"2023-10-18T11:09:39.419582+0000","last_became_peered":"2023-10-18T11:09:39.419582+0000","last_unstale":"2023-10-18T11:38:48.136433+0000","last_undegraded":"2023-10-18T11:38:48.136433+0000","last_fullsized":"2023-10-18T11:38:48.136433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:48.136304+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:48.136304+0000","last_clean_scrub_stamp":"2023-10-18T11:38:48.136304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:52.796538+0000","scrub_duration":0.002452236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'1294","reported_seq":1337,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.833782+0000","last_change":"2023-10-18T11:38:16.833782+0000","last_active":"2023-10-18T11:38:16.833782+0000","last_peered":"2023-10-18T11:38:16.833782+0000","last_clean":"2023-10-18T11:38:16.833782+0000","last_became_active":"2023-10-18T11:09:36.912558+0000","last_became_peered":"2023-10-18T11:09:36.912558+0000","last_unstale":"2023-10-18T11:38:16.833782+0000","last_undegraded":"2023-10-18T11:38:16.833782+0000","last_fullsized":"2023-10-18T11:38:16.833782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1294","last_scrub_stamp":"2023-10-18T11:38:16.833369+0000","last_deep_scrub":"31'1294","last_deep_scrub_stamp":"2023-10-18T11:38:16.833369+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.833369+0000","objects_scrubbed":3,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:19.651697+0000","scrub_duration":0.079856599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7520929,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1284,"num_write_kb":8040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'435","reported_seq":558,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.918512+0000","last_change":"2023-10-18T11:38:38.918512+0000","last_active":"2023-10-18T11:38:38.918512+0000","last_peered":"2023-10-18T11:38:38.918512+0000","last_clean":"2023-10-18T11:38:38.918512+0000","last_became_active":"2023-10-18T11:09:46.097268+0000","last_became_peered":"2023-10-18T11:09:46.097268+0000","last_unstale":"2023-10-18T11:38:38.918512+0000","last_undegraded":"2023-10-18T11:38:38.918512+0000","last_fullsized":"2023-10-18T11:38:38.918512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'435","last_scrub_stamp":"2023-10-18T11:38:38.918083+0000","last_deep_scrub":"31'435","last_deep_scrub_stamp":"2023-10-18T11:38:38.918083+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.918083+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:43:28.369335+0000","scrub_duration":0.0060519450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":340,"num_write_kb":14424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'136","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:05.760733+0000","last_change":"2023-10-18T11:39:05.760783+0000","last_active":"2023-10-18T11:39:05.760733+0000","last_peered":"2023-10-18T11:39:05.760733+0000","last_clean":"2023-10-18T11:39:05.760733+0000","last_became_active":"2023-10-18T11:09:39.397228+0000","last_became_peered":"2023-10-18T11:09:39.397228+0000","last_unstale":"2023-10-18T11:39:05.760733+0000","last_undegraded":"2023-10-18T11:39:05.760733+0000","last_fullsized":"2023-10-18T11:39:05.760733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'136","last_scrub_stamp":"2023-10-18T11:39:05.760647+0000","last_deep_scrub":"31'136","last_deep_scrub_stamp":"2023-10-18T11:39:05.760647+0000","last_clean_scrub_stamp":"2023-10-18T11:39:05.760647+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:25:38.573943+0000","scrub_duration":0.0018971999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'9","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.700844+0000","last_change":"2023-10-18T11:38:23.700844+0000","last_active":"2023-10-18T11:38:23.700844+0000","last_peered":"2023-10-18T11:38:23.700844+0000","last_clean":"2023-10-18T11:38:23.700844+0000","last_became_active":"2023-10-18T11:09:36.906018+0000","last_became_peered":"2023-10-18T11:09:36.906018+0000","last_unstale":"2023-10-18T11:38:23.700844+0000","last_undegraded":"2023-10-18T11:38:23.700844+0000","last_fullsized":"2023-10-18T11:38:23.700844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2023-10-18T11:38:23.700596+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2023-10-18T11:38:23.700596+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.700596+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:47:43.822850+0000","scrub_duration":0.0075550569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'409","reported_seq":507,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:54.030278+0000","last_change":"2023-10-18T11:38:54.030372+0000","last_active":"2023-10-18T11:38:54.030278+0000","last_peered":"2023-10-18T11:38:54.030278+0000","last_clean":"2023-10-18T11:38:54.030278+0000","last_became_active":"2023-10-18T11:09:46.096511+0000","last_became_peered":"2023-10-18T11:09:46.096511+0000","last_unstale":"2023-10-18T11:38:54.030278+0000","last_undegraded":"2023-10-18T11:38:54.030278+0000","last_fullsized":"2023-10-18T11:38:54.030278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'409","last_scrub_stamp":"2023-10-18T11:38:54.030199+0000","last_deep_scrub":"31'409","last_deep_scrub_stamp":"2023-10-18T11:38:54.030199+0000","last_clean_scrub_stamp":"2023-10-18T11:38:54.030199+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:08:11.779372+0000","scrub_duration":0.0025696439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":17064,"num_write":295,"num_write_kb":17834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'136","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.655098+0000","last_change":"2023-10-18T11:38:51.655098+0000","last_active":"2023-10-18T11:38:51.655098+0000","last_peered":"2023-10-18T11:38:51.655098+0000","last_clean":"2023-10-18T11:38:51.655098+0000","last_became_active":"2023-10-18T11:09:39.399474+0000","last_became_peered":"2023-10-18T11:09:39.399474+0000","last_unstale":"2023-10-18T11:38:51.655098+0000","last_undegraded":"2023-10-18T11:38:51.655098+0000","last_fullsized":"2023-10-18T11:38:51.655098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'136","last_scrub_stamp":"2023-10-18T11:38:51.654982+0000","last_deep_scrub":"31'136","last_deep_scrub_stamp":"2023-10-18T11:38:51.654982+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.654982+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:26:13.696712+0000","scrub_duration":0.0012451610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'255","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.648486+0000","last_change":"2023-10-18T11:38:13.648486+0000","last_active":"2023-10-18T11:38:13.648486+0000","last_peered":"2023-10-18T11:38:13.648486+0000","last_clean":"2023-10-18T11:38:13.648486+0000","last_became_active":"2023-10-18T11:09:36.897658+0000","last_became_peered":"2023-10-18T11:09:36.897658+0000","last_unstale":"2023-10-18T11:38:13.648486+0000","last_undegraded":"2023-10-18T11:38:13.648486+0000","last_fullsized":"2023-10-18T11:38:13.648486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'255","last_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_deep_scrub":"31'255","last_deep_scrub_stamp":"2023-10-18T11:38:13.648347+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.648347+0000","objects_scrubbed":2,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:38:37.829270+0000","scrub_duration":0.0050540170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'390","reported_seq":467,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:31.598810+0000","last_change":"2023-10-18T11:38:31.598864+0000","last_active":"2023-10-18T11:38:31.598810+0000","last_peered":"2023-10-18T11:38:31.598810+0000","last_clean":"2023-10-18T11:38:31.598810+0000","last_became_active":"2023-10-18T11:09:46.108792+0000","last_became_peered":"2023-10-18T11:09:46.108792+0000","last_unstale":"2023-10-18T11:38:31.598810+0000","last_undegraded":"2023-10-18T11:38:31.598810+0000","last_fullsized":"2023-10-18T11:38:31.598810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'390","last_scrub_stamp":"2023-10-18T11:38:31.598740+0000","last_deep_scrub":"31'390","last_deep_scrub_stamp":"2023-10-18T11:38:31.598740+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.598740+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:35.171175+0000","scrub_duration":0.0040497909999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":302,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'129","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:45.651434+0000","last_change":"2023-10-18T11:38:45.651499+0000","last_active":"2023-10-18T11:38:45.651434+0000","last_peered":"2023-10-18T11:38:45.651434+0000","last_clean":"2023-10-18T11:38:45.651434+0000","last_became_active":"2023-10-18T11:09:39.397244+0000","last_became_peered":"2023-10-18T11:09:39.397244+0000","last_unstale":"2023-10-18T11:38:45.651434+0000","last_undegraded":"2023-10-18T11:38:45.651434+0000","last_fullsized":"2023-10-18T11:38:45.651434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'129","last_scrub_stamp":"2023-10-18T11:38:45.651347+0000","last_deep_scrub":"31'129","last_deep_scrub_stamp":"2023-10-18T11:38:45.651347+0000","last_clean_scrub_stamp":"2023-10-18T11:38:45.651347+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:50.603822+0000","scrub_duration":0.0013624469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'1801","reported_seq":1843,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.945745+0000","last_change":"2023-10-18T11:38:16.945923+0000","last_active":"2023-10-18T11:38:16.945745+0000","last_peered":"2023-10-18T11:38:16.945745+0000","last_clean":"2023-10-18T11:38:16.945745+0000","last_became_active":"2023-10-18T11:09:36.915657+0000","last_became_peered":"2023-10-18T11:09:36.915657+0000","last_unstale":"2023-10-18T11:38:16.945745+0000","last_undegraded":"2023-10-18T11:38:16.945745+0000","last_fullsized":"2023-10-18T11:38:16.945745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1801","last_scrub_stamp":"2023-10-18T11:38:16.945606+0000","last_deep_scrub":"31'1801","last_deep_scrub_stamp":"2023-10-18T11:38:16.945606+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.945606+0000","objects_scrubbed":10,"log_size":1801,"log_dups_size":0,"ondisk_log_size":1801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:06:47.403273+0000","scrub_duration":0.099502073999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":9197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'468","reported_seq":560,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:06.104689+0000","last_change":"2023-10-18T11:39:06.104917+0000","last_active":"2023-10-18T11:39:06.104689+0000","last_peered":"2023-10-18T11:39:06.104689+0000","last_clean":"2023-10-18T11:39:06.104689+0000","last_became_active":"2023-10-18T11:09:46.106356+0000","last_became_peered":"2023-10-18T11:09:46.106356+0000","last_unstale":"2023-10-18T11:39:06.104689+0000","last_undegraded":"2023-10-18T11:39:06.104689+0000","last_fullsized":"2023-10-18T11:39:06.104689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'468","last_scrub_stamp":"2023-10-18T11:39:06.104515+0000","last_deep_scrub":"31'468","last_deep_scrub_stamp":"2023-10-18T11:39:06.104515+0000","last_clean_scrub_stamp":"2023-10-18T11:39:06.104515+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:53:19.069409+0000","scrub_duration":0.0065353920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":372,"num_write_kb":11119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'118","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:27.563554+0000","last_change":"2023-10-18T11:38:27.563591+0000","last_active":"2023-10-18T11:38:27.563554+0000","last_peered":"2023-10-18T11:38:27.563554+0000","last_clean":"2023-10-18T11:38:27.563554+0000","last_became_active":"2023-10-18T11:09:39.357971+0000","last_became_peered":"2023-10-18T11:09:39.357971+0000","last_unstale":"2023-10-18T11:38:27.563554+0000","last_undegraded":"2023-10-18T11:38:27.563554+0000","last_fullsized":"2023-10-18T11:38:27.563554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'118","last_scrub_stamp":"2023-10-18T11:38:27.563488+0000","last_deep_scrub":"31'118","last_deep_scrub_stamp":"2023-10-18T11:38:27.563488+0000","last_clean_scrub_stamp":"2023-10-18T11:38:27.563488+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:31:20.292085+0000","scrub_duration":0.0024232849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'912","reported_seq":954,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.721666+0000","last_change":"2023-10-18T11:38:15.721730+0000","last_active":"2023-10-18T11:38:15.721666+0000","last_peered":"2023-10-18T11:38:15.721666+0000","last_clean":"2023-10-18T11:38:15.721666+0000","last_became_active":"2023-10-18T11:09:36.892769+0000","last_became_peered":"2023-10-18T11:09:36.892769+0000","last_unstale":"2023-10-18T11:38:15.721666+0000","last_undegraded":"2023-10-18T11:38:15.721666+0000","last_fullsized":"2023-10-18T11:38:15.721666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'912","last_scrub_stamp":"2023-10-18T11:38:15.721600+0000","last_deep_scrub":"31'912","last_deep_scrub_stamp":"2023-10-18T11:38:15.721600+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.721600+0000","objects_scrubbed":3,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:47:35.843854+0000","scrub_duration":0.019590776000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'408","reported_seq":487,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:27.979480+0000","last_change":"2023-10-18T11:39:27.979696+0000","last_active":"2023-10-18T11:39:27.979480+0000","last_peered":"2023-10-18T11:39:27.979480+0000","last_clean":"2023-10-18T11:39:27.979480+0000","last_became_active":"2023-10-18T11:09:46.110483+0000","last_became_peered":"2023-10-18T11:09:46.110483+0000","last_unstale":"2023-10-18T11:39:27.979480+0000","last_undegraded":"2023-10-18T11:39:27.979480+0000","last_fullsized":"2023-10-18T11:39:27.979480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'408","last_scrub_stamp":"2023-10-18T11:39:27.979307+0000","last_deep_scrub":"31'408","last_deep_scrub_stamp":"2023-10-18T11:39:27.979307+0000","last_clean_scrub_stamp":"2023-10-18T11:39:27.979307+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:48.032317+0000","scrub_duration":0.0059308659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":10922,"num_write":302,"num_write_kb":9791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.639879+0000","last_change":"2023-10-18T11:38:16.639919+0000","last_active":"2023-10-18T11:38:16.639879+0000","last_peered":"2023-10-18T11:38:16.639879+0000","last_clean":"2023-10-18T11:38:16.639879+0000","last_became_active":"2023-10-18T11:09:39.398926+0000","last_became_peered":"2023-10-18T11:09:39.398926+0000","last_unstale":"2023-10-18T11:38:16.639879+0000","last_undegraded":"2023-10-18T11:38:16.639879+0000","last_fullsized":"2023-10-18T11:38:16.639879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:16.639807+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:16.639807+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.639807+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:32.548013+0000","scrub_duration":0.00137429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'1004","reported_seq":1046,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:14.374765+0000","last_change":"2023-10-18T11:38:14.374816+0000","last_active":"2023-10-18T11:38:14.374765+0000","last_peered":"2023-10-18T11:38:14.374765+0000","last_clean":"2023-10-18T11:38:14.374765+0000","last_became_active":"2023-10-18T11:09:36.905343+0000","last_became_peered":"2023-10-18T11:09:36.905343+0000","last_unstale":"2023-10-18T11:38:14.374765+0000","last_undegraded":"2023-10-18T11:38:14.374765+0000","last_fullsized":"2023-10-18T11:38:14.374765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1004","last_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_deep_scrub":"31'1004","last_deep_scrub_stamp":"2023-10-18T11:38:14.374705+0000","last_clean_scrub_stamp":"2023-10-18T11:38:14.374705+0000","objects_scrubbed":4,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:02:58.873481+0000","scrub_duration":0.027697919000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":4702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'374","reported_seq":456,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:14.902165+0000","last_change":"2023-10-18T11:39:14.902403+0000","last_active":"2023-10-18T11:39:14.902165+0000","last_peered":"2023-10-18T11:39:14.902165+0000","last_clean":"2023-10-18T11:39:14.902165+0000","last_became_active":"2023-10-18T11:09:46.109168+0000","last_became_peered":"2023-10-18T11:09:46.109168+0000","last_unstale":"2023-10-18T11:39:14.902165+0000","last_undegraded":"2023-10-18T11:39:14.902165+0000","last_fullsized":"2023-10-18T11:39:14.902165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'374","last_scrub_stamp":"2023-10-18T11:39:14.901992+0000","last_deep_scrub":"31'374","last_deep_scrub_stamp":"2023-10-18T11:39:14.901992+0000","last_clean_scrub_stamp":"2023-10-18T11:39:14.901992+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:34:44.545220+0000","scrub_duration":0.006342154,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":12454,"num_write":279,"num_write_kb":12302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:12.988607+0000","last_change":"2023-10-18T11:38:12.988796+0000","last_active":"2023-10-18T11:38:12.988607+0000","last_peered":"2023-10-18T11:38:12.988607+0000","last_clean":"2023-10-18T11:38:12.988607+0000","last_became_active":"2023-10-18T11:09:39.361145+0000","last_became_peered":"2023-10-18T11:09:39.361145+0000","last_unstale":"2023-10-18T11:38:12.988607+0000","last_undegraded":"2023-10-18T11:38:12.988607+0000","last_fullsized":"2023-10-18T11:38:12.988607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:12.988423+0000","last_clean_scrub_stamp":"2023-10-18T11:38:12.988423+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:04.605203+0000","scrub_duration":0.002583765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'410","reported_seq":843,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:10.019288+0000","last_change":"2023-10-18T11:38:10.019370+0000","last_active":"2023-10-18T11:38:10.019288+0000","last_peered":"2023-10-18T11:38:10.019288+0000","last_clean":"2023-10-18T11:38:10.019288+0000","last_became_active":"2023-10-18T11:09:36.893031+0000","last_became_peered":"2023-10-18T11:09:36.893031+0000","last_unstale":"2023-10-18T11:38:10.019288+0000","last_undegraded":"2023-10-18T11:38:10.019288+0000","last_fullsized":"2023-10-18T11:38:10.019288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'410","last_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_deep_scrub":"31'410","last_deep_scrub_stamp":"2023-10-18T11:38:10.019192+0000","last_clean_scrub_stamp":"2023-10-18T11:38:10.019192+0000","objects_scrubbed":7,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:01:36.193379+0000","scrub_duration":0.0084515079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":443,"num_write":404,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'508","reported_seq":647,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:55.010298+0000","last_change":"2023-10-18T11:38:55.010367+0000","last_active":"2023-10-18T11:38:55.010298+0000","last_peered":"2023-10-18T11:38:55.010298+0000","last_clean":"2023-10-18T11:38:55.010298+0000","last_became_active":"2023-10-18T11:09:46.114568+0000","last_became_peered":"2023-10-18T11:09:46.114568+0000","last_unstale":"2023-10-18T11:38:55.010298+0000","last_undegraded":"2023-10-18T11:38:55.010298+0000","last_fullsized":"2023-10-18T11:38:55.010298+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'508","last_scrub_stamp":"2023-10-18T11:38:55.010215+0000","last_deep_scrub":"31'508","last_deep_scrub_stamp":"2023-10-18T11:38:55.010215+0000","last_clean_scrub_stamp":"2023-10-18T11:38:55.010215+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T11:41:31.346583+0000","scrub_duration":0.0039544630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":22458,"num_write":413,"num_write_kb":26305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'141","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:46.611066+0000","last_change":"2023-10-18T11:38:46.611114+0000","last_active":"2023-10-18T11:38:46.611066+0000","last_peered":"2023-10-18T11:38:46.611066+0000","last_clean":"2023-10-18T11:38:46.611066+0000","last_became_active":"2023-10-18T11:09:39.420150+0000","last_became_peered":"2023-10-18T11:09:39.420150+0000","last_unstale":"2023-10-18T11:38:46.611066+0000","last_undegraded":"2023-10-18T11:38:46.611066+0000","last_fullsized":"2023-10-18T11:38:46.611066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'141","last_scrub_stamp":"2023-10-18T11:38:46.610979+0000","last_deep_scrub":"31'141","last_deep_scrub_stamp":"2023-10-18T11:38:46.610979+0000","last_clean_scrub_stamp":"2023-10-18T11:38:46.610979+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:43:36.062230+0000","scrub_duration":0.0027168240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1129","reported_seq":1171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.788264+0000","last_change":"2023-10-18T11:38:17.788313+0000","last_active":"2023-10-18T11:38:17.788264+0000","last_peered":"2023-10-18T11:38:17.788264+0000","last_clean":"2023-10-18T11:38:17.788264+0000","last_became_active":"2023-10-18T11:09:36.904423+0000","last_became_peered":"2023-10-18T11:09:36.904423+0000","last_unstale":"2023-10-18T11:38:17.788264+0000","last_undegraded":"2023-10-18T11:38:17.788264+0000","last_fullsized":"2023-10-18T11:38:17.788264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1129","last_scrub_stamp":"2023-10-18T11:38:17.788204+0000","last_deep_scrub":"31'1129","last_deep_scrub_stamp":"2023-10-18T11:38:17.788204+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.788204+0000","objects_scrubbed":6,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:02.286980+0000","scrub_duration":0.060761811999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":4710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'423","reported_seq":510,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.967827+0000","last_change":"2023-10-18T11:38:51.968035+0000","last_active":"2023-10-18T11:38:51.967827+0000","last_peered":"2023-10-18T11:38:51.967827+0000","last_clean":"2023-10-18T11:38:51.967827+0000","last_became_active":"2023-10-18T11:09:46.099507+0000","last_became_peered":"2023-10-18T11:09:46.099507+0000","last_unstale":"2023-10-18T11:38:51.967827+0000","last_undegraded":"2023-10-18T11:38:51.967827+0000","last_fullsized":"2023-10-18T11:38:51.967827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'423","last_scrub_stamp":"2023-10-18T11:38:51.967647+0000","last_deep_scrub":"31'423","last_deep_scrub_stamp":"2023-10-18T11:38:51.967647+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.967647+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:14:42.768322+0000","scrub_duration":0.0062849749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":12954,"num_write":319,"num_write_kb":22076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'121","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.567855+0000","last_change":"2023-10-18T11:38:17.567915+0000","last_active":"2023-10-18T11:38:17.567855+0000","last_peered":"2023-10-18T11:38:17.567855+0000","last_clean":"2023-10-18T11:38:17.567855+0000","last_became_active":"2023-10-18T11:09:39.398302+0000","last_became_peered":"2023-10-18T11:09:39.398302+0000","last_unstale":"2023-10-18T11:38:17.567855+0000","last_undegraded":"2023-10-18T11:38:17.567855+0000","last_fullsized":"2023-10-18T11:38:17.567855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'121","last_scrub_stamp":"2023-10-18T11:38:17.567782+0000","last_deep_scrub":"31'121","last_deep_scrub_stamp":"2023-10-18T11:38:17.567782+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.567782+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:02.066559+0000","scrub_duration":0.001187249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'283","reported_seq":325,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.826508+0000","last_change":"2023-10-18T11:38:18.826508+0000","last_active":"2023-10-18T11:38:18.826508+0000","last_peered":"2023-10-18T11:38:18.826508+0000","last_clean":"2023-10-18T11:38:18.826508+0000","last_became_active":"2023-10-18T11:09:36.912971+0000","last_became_peered":"2023-10-18T11:09:36.912971+0000","last_unstale":"2023-10-18T11:38:18.826508+0000","last_undegraded":"2023-10-18T11:38:18.826508+0000","last_fullsized":"2023-10-18T11:38:18.826508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'283","last_scrub_stamp":"2023-10-18T11:38:18.826303+0000","last_deep_scrub":"31'283","last_deep_scrub_stamp":"2023-10-18T11:38:18.826303+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.826303+0000","objects_scrubbed":4,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:48.054916+0000","scrub_duration":0.0084837070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'511","reported_seq":609,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:41.657046+0000","last_change":"2023-10-18T11:38:41.657141+0000","last_active":"2023-10-18T11:38:41.657046+0000","last_peered":"2023-10-18T11:38:41.657046+0000","last_clean":"2023-10-18T11:38:41.657046+0000","last_became_active":"2023-10-18T11:09:46.093819+0000","last_became_peered":"2023-10-18T11:09:46.093819+0000","last_unstale":"2023-10-18T11:38:41.657046+0000","last_undegraded":"2023-10-18T11:38:41.657046+0000","last_fullsized":"2023-10-18T11:38:41.657046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'511","last_scrub_stamp":"2023-10-18T11:38:41.656966+0000","last_deep_scrub":"31'511","last_deep_scrub_stamp":"2023-10-18T11:38:41.656966+0000","last_clean_scrub_stamp":"2023-10-18T11:38:41.656966+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:55:11.280208+0000","scrub_duration":0.0028387489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":22028,"num_write":389,"num_write_kb":39504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.935436+0000","last_change":"2023-10-18T11:38:32.935436+0000","last_active":"2023-10-18T11:38:32.935436+0000","last_peered":"2023-10-18T11:38:32.935436+0000","last_clean":"2023-10-18T11:38:32.935436+0000","last_became_active":"2023-10-18T11:09:39.362548+0000","last_became_peered":"2023-10-18T11:09:39.362548+0000","last_unstale":"2023-10-18T11:38:32.935436+0000","last_undegraded":"2023-10-18T11:38:32.935436+0000","last_fullsized":"2023-10-18T11:38:32.935436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:32.935169+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:32.935169+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.935169+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:09.549069+0000","scrub_duration":0.0036182440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'403","reported_seq":835,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.336342+0000","last_change":"2023-10-18T11:38:15.336342+0000","last_active":"2023-10-18T11:38:15.336342+0000","last_peered":"2023-10-18T11:38:15.336342+0000","last_clean":"2023-10-18T11:38:15.336342+0000","last_became_active":"2023-10-18T11:09:36.896492+0000","last_became_peered":"2023-10-18T11:09:36.896492+0000","last_unstale":"2023-10-18T11:38:15.336342+0000","last_undegraded":"2023-10-18T11:38:15.336342+0000","last_fullsized":"2023-10-18T11:38:15.336342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'403","last_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_deep_scrub":"31'403","last_deep_scrub_stamp":"2023-10-18T11:38:15.336169+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.336169+0000","objects_scrubbed":3,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:31.244376+0000","scrub_duration":0.0066715740000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180134,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":390,"num_read_kb":469,"num_write":396,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'442","reported_seq":546,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:09.975426+0000","last_change":"2023-10-18T11:39:09.975634+0000","last_active":"2023-10-18T11:39:09.975426+0000","last_peered":"2023-10-18T11:39:09.975426+0000","last_clean":"2023-10-18T11:39:09.975426+0000","last_became_active":"2023-10-18T11:09:46.106280+0000","last_became_peered":"2023-10-18T11:09:46.106280+0000","last_unstale":"2023-10-18T11:39:09.975426+0000","last_undegraded":"2023-10-18T11:39:09.975426+0000","last_fullsized":"2023-10-18T11:39:09.975426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'442","last_scrub_stamp":"2023-10-18T11:39:09.975248+0000","last_deep_scrub":"31'442","last_deep_scrub_stamp":"2023-10-18T11:39:09.975248+0000","last_clean_scrub_stamp":"2023-10-18T11:39:09.975248+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:07:08.755270+0000","scrub_duration":0.0061956320000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17404,"num_write":347,"num_write_kb":27808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:51.029902+0000","last_change":"2023-10-18T11:38:51.029976+0000","last_active":"2023-10-18T11:38:51.029902+0000","last_peered":"2023-10-18T11:38:51.029902+0000","last_clean":"2023-10-18T11:38:51.029902+0000","last_became_active":"2023-10-18T11:09:39.351217+0000","last_became_peered":"2023-10-18T11:09:39.351217+0000","last_unstale":"2023-10-18T11:38:51.029902+0000","last_undegraded":"2023-10-18T11:38:51.029902+0000","last_fullsized":"2023-10-18T11:38:51.029902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:51.029809+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:51.029809+0000","last_clean_scrub_stamp":"2023-10-18T11:38:51.029809+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:33.916912+0000","scrub_duration":0.0016098009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'189","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:22.612412+0000","last_change":"2023-10-18T11:38:22.612412+0000","last_active":"2023-10-18T11:38:22.612412+0000","last_peered":"2023-10-18T11:38:22.612412+0000","last_clean":"2023-10-18T11:38:22.612412+0000","last_became_active":"2023-10-18T11:09:36.896302+0000","last_became_peered":"2023-10-18T11:09:36.896302+0000","last_unstale":"2023-10-18T11:38:22.612412+0000","last_undegraded":"2023-10-18T11:38:22.612412+0000","last_fullsized":"2023-10-18T11:38:22.612412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'189","last_scrub_stamp":"2023-10-18T11:38:22.612315+0000","last_deep_scrub":"31'189","last_deep_scrub_stamp":"2023-10-18T11:38:22.612315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:22.612315+0000","objects_scrubbed":3,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:22:08.752776+0000","scrub_duration":0.0028915519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'380","reported_seq":482,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:11.963423+0000","last_change":"2023-10-18T11:39:11.963568+0000","last_active":"2023-10-18T11:39:11.963423+0000","last_peered":"2023-10-18T11:39:11.963423+0000","last_clean":"2023-10-18T11:39:11.963423+0000","last_became_active":"2023-10-18T11:09:46.106510+0000","last_became_peered":"2023-10-18T11:09:46.106510+0000","last_unstale":"2023-10-18T11:39:11.963423+0000","last_undegraded":"2023-10-18T11:39:11.963423+0000","last_fullsized":"2023-10-18T11:39:11.963423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'380","last_scrub_stamp":"2023-10-18T11:39:11.963312+0000","last_deep_scrub":"31'380","last_deep_scrub_stamp":"2023-10-18T11:39:11.963312+0000","last_clean_scrub_stamp":"2023-10-18T11:39:11.963312+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:25:44.776609+0000","scrub_duration":0.004230452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":277,"num_write_kb":11173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'503","reported_seq":594,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:08.132246+0000","last_change":"2023-10-18T11:39:08.132458+0000","last_active":"2023-10-18T11:39:08.132246+0000","last_peered":"2023-10-18T11:39:08.132246+0000","last_clean":"2023-10-18T11:39:08.132246+0000","last_became_active":"2023-10-18T11:10:10.416780+0000","last_became_peered":"2023-10-18T11:10:10.416780+0000","last_unstale":"2023-10-18T11:39:08.132246+0000","last_undegraded":"2023-10-18T11:39:08.132246+0000","last_fullsized":"2023-10-18T11:39:08.132246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'503","last_scrub_stamp":"2023-10-18T11:39:08.132072+0000","last_deep_scrub":"31'503","last_deep_scrub_stamp":"2023-10-18T11:39:08.132072+0000","last_clean_scrub_stamp":"2023-10-18T11:39:08.132072+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:07:06.912094+0000","scrub_duration":0.006724654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":11176,"num_write":392,"num_write_kb":15493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'157","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.000066+0000","last_change":"2023-10-18T11:38:32.000066+0000","last_active":"2023-10-18T11:38:32.000066+0000","last_peered":"2023-10-18T11:38:32.000066+0000","last_clean":"2023-10-18T11:38:32.000066+0000","last_became_active":"2023-10-18T11:09:39.418205+0000","last_became_peered":"2023-10-18T11:09:39.418205+0000","last_unstale":"2023-10-18T11:38:32.000066+0000","last_undegraded":"2023-10-18T11:38:32.000066+0000","last_fullsized":"2023-10-18T11:38:32.000066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'157","last_scrub_stamp":"2023-10-18T11:38:31.999671+0000","last_deep_scrub":"31'157","last_deep_scrub_stamp":"2023-10-18T11:38:31.999671+0000","last_clean_scrub_stamp":"2023-10-18T11:38:31.999671+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:06.032945+0000","scrub_duration":0.0041825050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'1037","reported_seq":1079,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.385086+0000","last_change":"2023-10-18T11:38:20.385086+0000","last_active":"2023-10-18T11:38:20.385086+0000","last_peered":"2023-10-18T11:38:20.385086+0000","last_clean":"2023-10-18T11:38:20.385086+0000","last_became_active":"2023-10-18T11:09:36.892721+0000","last_became_peered":"2023-10-18T11:09:36.892721+0000","last_unstale":"2023-10-18T11:38:20.385086+0000","last_undegraded":"2023-10-18T11:38:20.385086+0000","last_fullsized":"2023-10-18T11:38:20.385086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1037","last_scrub_stamp":"2023-10-18T11:38:20.384953+0000","last_deep_scrub":"31'1037","last_deep_scrub_stamp":"2023-10-18T11:38:20.384953+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.384953+0000","objects_scrubbed":3,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:59:12.001733+0000","scrub_duration":0.020741213000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":6522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'495","reported_seq":610,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:59.595427+0000","last_change":"2023-10-18T11:38:59.595427+0000","last_active":"2023-10-18T11:38:59.595427+0000","last_peered":"2023-10-18T11:38:59.595427+0000","last_clean":"2023-10-18T11:38:59.595427+0000","last_became_active":"2023-10-18T11:09:46.095005+0000","last_became_peered":"2023-10-18T11:09:46.095005+0000","last_unstale":"2023-10-18T11:38:59.595427+0000","last_undegraded":"2023-10-18T11:38:59.595427+0000","last_fullsized":"2023-10-18T11:38:59.595427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'495","last_scrub_stamp":"2023-10-18T11:38:59.595310+0000","last_deep_scrub":"31'495","last_deep_scrub_stamp":"2023-10-18T11:38:59.595310+0000","last_clean_scrub_stamp":"2023-10-18T11:38:59.595310+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:47:13.253821+0000","scrub_duration":0.0041609450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":22638,"num_write":397,"num_write_kb":22851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'163","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:17.936414+0000","last_change":"2023-10-18T11:38:17.936414+0000","last_active":"2023-10-18T11:38:17.936414+0000","last_peered":"2023-10-18T11:38:17.936414+0000","last_clean":"2023-10-18T11:38:17.936414+0000","last_became_active":"2023-10-18T11:09:39.419699+0000","last_became_peered":"2023-10-18T11:09:39.419699+0000","last_unstale":"2023-10-18T11:38:17.936414+0000","last_undegraded":"2023-10-18T11:38:17.936414+0000","last_fullsized":"2023-10-18T11:38:17.936414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-10-18T11:38:17.936124+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-10-18T11:38:17.936124+0000","last_clean_scrub_stamp":"2023-10-18T11:38:17.936124+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:47.164737+0000","scrub_duration":0.0040074359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'475","reported_seq":981,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.113430+0000","last_change":"2023-10-18T11:38:26.113430+0000","last_active":"2023-10-18T11:38:26.113430+0000","last_peered":"2023-10-18T11:38:26.113430+0000","last_clean":"2023-10-18T11:38:26.113430+0000","last_became_active":"2023-10-18T11:09:36.911254+0000","last_became_peered":"2023-10-18T11:09:36.911254+0000","last_unstale":"2023-10-18T11:38:26.113430+0000","last_undegraded":"2023-10-18T11:38:26.113430+0000","last_fullsized":"2023-10-18T11:38:26.113430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'475","last_scrub_stamp":"2023-10-18T11:38:26.113149+0000","last_deep_scrub":"31'475","last_deep_scrub_stamp":"2023-10-18T11:38:26.113149+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.113149+0000","objects_scrubbed":3,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:11.928277+0000","scrub_duration":0.010428636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151706,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":464,"num_read_kb":507,"num_write":469,"num_write_kb":513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'1262","reported_seq":1772,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.769789+0000","last_change":"2023-10-18T11:38:16.769841+0000","last_active":"2023-10-18T11:38:16.769789+0000","last_peered":"2023-10-18T11:38:16.769789+0000","last_clean":"2023-10-18T11:38:16.769789+0000","last_became_active":"2023-10-18T11:09:36.894080+0000","last_became_peered":"2023-10-18T11:09:36.894080+0000","last_unstale":"2023-10-18T11:38:16.769789+0000","last_undegraded":"2023-10-18T11:38:16.769789+0000","last_fullsized":"2023-10-18T11:38:16.769789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1262","last_scrub_stamp":"2023-10-18T11:38:16.769713+0000","last_deep_scrub":"31'1262","last_deep_scrub_stamp":"2023-10-18T11:38:16.769713+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.769713+0000","objects_scrubbed":5,"log_size":1262,"log_dups_size":0,"ondisk_log_size":1262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:46:57.406757+0000","scrub_duration":0.022924356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4346422,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":505,"num_write":1257,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'154","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:09.051185+0000","last_change":"2023-10-18T11:38:09.051296+0000","last_active":"2023-10-18T11:38:09.051185+0000","last_peered":"2023-10-18T11:38:09.051185+0000","last_clean":"2023-10-18T11:38:09.051185+0000","last_became_active":"2023-10-18T11:09:39.401410+0000","last_became_peered":"2023-10-18T11:09:39.401410+0000","last_unstale":"2023-10-18T11:38:09.051185+0000","last_undegraded":"2023-10-18T11:38:09.051185+0000","last_fullsized":"2023-10-18T11:38:09.051185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:09.051022+0000","last_clean_scrub_stamp":"2023-10-18T11:38:09.051022+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:26.016569+0000","scrub_duration":0.003629073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'380","reported_seq":485,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.730424+0000","last_change":"2023-10-18T11:38:32.730605+0000","last_active":"2023-10-18T11:38:32.730424+0000","last_peered":"2023-10-18T11:38:32.730424+0000","last_clean":"2023-10-18T11:38:32.730424+0000","last_became_active":"2023-10-18T11:09:46.116649+0000","last_became_peered":"2023-10-18T11:09:46.116649+0000","last_unstale":"2023-10-18T11:38:32.730424+0000","last_undegraded":"2023-10-18T11:38:32.730424+0000","last_fullsized":"2023-10-18T11:38:32.730424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'380","last_scrub_stamp":"2023-10-18T11:38:32.730250+0000","last_deep_scrub":"31'380","last_deep_scrub_stamp":"2023-10-18T11:38:32.730250+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.730250+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:14.150480+0000","scrub_duration":0.0065888780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":9856,"num_write":276,"num_write_kb":10033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2737","reported_seq":2779,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.081285+0000","last_change":"2023-10-18T11:38:20.081285+0000","last_active":"2023-10-18T11:38:20.081285+0000","last_peered":"2023-10-18T11:38:20.081285+0000","last_clean":"2023-10-18T11:38:20.081285+0000","last_became_active":"2023-10-18T11:09:36.907182+0000","last_became_peered":"2023-10-18T11:09:36.907182+0000","last_unstale":"2023-10-18T11:38:20.081285+0000","last_undegraded":"2023-10-18T11:38:20.081285+0000","last_fullsized":"2023-10-18T11:38:20.081285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2737","last_scrub_stamp":"2023-10-18T11:38:20.080991+0000","last_deep_scrub":"31'2737","last_deep_scrub_stamp":"2023-10-18T11:38:20.080991+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.080991+0000","objects_scrubbed":4,"log_size":2737,"log_dups_size":0,"ondisk_log_size":2737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:56:23.653427+0000","scrub_duration":0.118224197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2726,"num_write_kb":13571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'169","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:15.602939+0000","last_change":"2023-10-18T11:38:15.602980+0000","last_active":"2023-10-18T11:38:15.602939+0000","last_peered":"2023-10-18T11:38:15.602939+0000","last_clean":"2023-10-18T11:38:15.602939+0000","last_became_active":"2023-10-18T11:09:39.400115+0000","last_became_peered":"2023-10-18T11:09:39.400115+0000","last_unstale":"2023-10-18T11:38:15.602939+0000","last_undegraded":"2023-10-18T11:38:15.602939+0000","last_fullsized":"2023-10-18T11:38:15.602939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'169","last_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_deep_scrub":"31'169","last_deep_scrub_stamp":"2023-10-18T11:38:15.602878+0000","last_clean_scrub_stamp":"2023-10-18T11:38:15.602878+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:15:22.593515+0000","scrub_duration":0.0020891960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'415","reported_seq":499,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:18.905176+0000","last_change":"2023-10-18T11:39:18.905276+0000","last_active":"2023-10-18T11:39:18.905176+0000","last_peered":"2023-10-18T11:39:18.905176+0000","last_clean":"2023-10-18T11:39:18.905176+0000","last_became_active":"2023-10-18T11:09:46.111047+0000","last_became_peered":"2023-10-18T11:09:46.111047+0000","last_unstale":"2023-10-18T11:39:18.905176+0000","last_undegraded":"2023-10-18T11:39:18.905176+0000","last_fullsized":"2023-10-18T11:39:18.905176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'415","last_scrub_stamp":"2023-10-18T11:39:18.904794+0000","last_deep_scrub":"31'415","last_deep_scrub_stamp":"2023-10-18T11:39:18.904794+0000","last_clean_scrub_stamp":"2023-10-18T11:39:18.904794+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:39:37.999254+0000","scrub_duration":0.0036941589999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":317,"num_write_kb":9906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'168","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:43.499206+0000","last_change":"2023-10-18T11:38:43.499206+0000","last_active":"2023-10-18T11:38:43.499206+0000","last_peered":"2023-10-18T11:38:43.499206+0000","last_clean":"2023-10-18T11:38:43.499206+0000","last_became_active":"2023-10-18T11:09:39.359467+0000","last_became_peered":"2023-10-18T11:09:39.359467+0000","last_unstale":"2023-10-18T11:38:43.499206+0000","last_undegraded":"2023-10-18T11:38:43.499206+0000","last_fullsized":"2023-10-18T11:38:43.499206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'168","last_scrub_stamp":"2023-10-18T11:38:43.499098+0000","last_deep_scrub":"31'168","last_deep_scrub_stamp":"2023-10-18T11:38:43.499098+0000","last_clean_scrub_stamp":"2023-10-18T11:38:43.499098+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:48.451573+0000","scrub_duration":0.002558608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'156","reported_seq":197,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:25.678385+0000","last_change":"2023-10-18T11:38:25.678385+0000","last_active":"2023-10-18T11:38:25.678385+0000","last_peered":"2023-10-18T11:38:25.678385+0000","last_clean":"2023-10-18T11:38:25.678385+0000","last_became_active":"2023-10-18T11:09:39.241637+0000","last_became_peered":"2023-10-18T11:09:39.241637+0000","last_unstale":"2023-10-18T11:38:25.678385+0000","last_undegraded":"2023-10-18T11:38:25.678385+0000","last_fullsized":"2023-10-18T11:38:25.678385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'156","last_scrub_stamp":"2023-10-18T11:38:25.677969+0000","last_deep_scrub":"31'156","last_deep_scrub_stamp":"2023-10-18T11:38:25.677969+0000","last_clean_scrub_stamp":"2023-10-18T11:38:25.677969+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:47:06.315013+0000","scrub_duration":0.0040068400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'163","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:36.692445+0000","last_change":"2023-10-18T11:38:36.692445+0000","last_active":"2023-10-18T11:38:36.692445+0000","last_peered":"2023-10-18T11:38:36.692445+0000","last_clean":"2023-10-18T11:38:36.692445+0000","last_became_active":"2023-10-18T11:10:10.415557+0000","last_became_peered":"2023-10-18T11:10:10.415557+0000","last_unstale":"2023-10-18T11:38:36.692445+0000","last_undegraded":"2023-10-18T11:38:36.692445+0000","last_fullsized":"2023-10-18T11:38:36.692445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-10-18T11:38:36.692173+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-10-18T11:38:36.692173+0000","last_clean_scrub_stamp":"2023-10-18T11:38:36.692173+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:39.510500+0000","scrub_duration":0.0037755890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"31'146","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:16.084653+0000","last_change":"2023-10-18T11:38:16.084653+0000","last_active":"2023-10-18T11:38:16.084653+0000","last_peered":"2023-10-18T11:38:16.084653+0000","last_clean":"2023-10-18T11:38:16.084653+0000","last_became_active":"2023-10-18T11:09:39.424815+0000","last_became_peered":"2023-10-18T11:09:39.424815+0000","last_unstale":"2023-10-18T11:38:16.084653+0000","last_undegraded":"2023-10-18T11:38:16.084653+0000","last_fullsized":"2023-10-18T11:38:16.084653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:16.084368+0000","last_clean_scrub_stamp":"2023-10-18T11:38:16.084368+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:45.312981+0000","scrub_duration":0.0039813269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'131","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:05.988842+0000","last_change":"2023-10-18T11:39:05.988914+0000","last_active":"2023-10-18T11:39:05.988842+0000","last_peered":"2023-10-18T11:39:05.988842+0000","last_clean":"2023-10-18T11:39:05.988842+0000","last_became_active":"2023-10-18T11:09:39.424241+0000","last_became_peered":"2023-10-18T11:09:39.424241+0000","last_unstale":"2023-10-18T11:39:05.988842+0000","last_undegraded":"2023-10-18T11:39:05.988842+0000","last_fullsized":"2023-10-18T11:39:05.988842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'131","last_scrub_stamp":"2023-10-18T11:39:05.988717+0000","last_deep_scrub":"31'131","last_deep_scrub_stamp":"2023-10-18T11:39:05.988717+0000","last_clean_scrub_stamp":"2023-10-18T11:39:05.988717+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:53:18.953611+0000","scrub_duration":0.0025822449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'151","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.950545+0000","last_change":"2023-10-18T11:38:38.950670+0000","last_active":"2023-10-18T11:38:38.950545+0000","last_peered":"2023-10-18T11:38:38.950545+0000","last_clean":"2023-10-18T11:38:38.950545+0000","last_became_active":"2023-10-18T11:09:39.421912+0000","last_became_peered":"2023-10-18T11:09:39.421912+0000","last_unstale":"2023-10-18T11:38:38.950545+0000","last_undegraded":"2023-10-18T11:38:38.950545+0000","last_fullsized":"2023-10-18T11:38:38.950545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'151","last_scrub_stamp":"2023-10-18T11:38:38.950368+0000","last_deep_scrub":"31'151","last_deep_scrub_stamp":"2023-10-18T11:38:38.950368+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.950368+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:57.286818+0000","scrub_duration":0.0045621400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'152","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:24.563866+0000","last_change":"2023-10-18T11:38:24.563908+0000","last_active":"2023-10-18T11:38:24.563866+0000","last_peered":"2023-10-18T11:38:24.563866+0000","last_clean":"2023-10-18T11:38:24.563866+0000","last_became_active":"2023-10-18T11:09:39.351345+0000","last_became_peered":"2023-10-18T11:09:39.351345+0000","last_unstale":"2023-10-18T11:38:24.563866+0000","last_undegraded":"2023-10-18T11:38:24.563866+0000","last_fullsized":"2023-10-18T11:38:24.563866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'152","last_scrub_stamp":"2023-10-18T11:38:24.563782+0000","last_deep_scrub":"31'152","last_deep_scrub_stamp":"2023-10-18T11:38:24.563782+0000","last_clean_scrub_stamp":"2023-10-18T11:38:24.563782+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:53.792395+0000","scrub_duration":0.001529683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'128","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:01.989414+0000","last_change":"2023-10-18T11:39:01.989533+0000","last_active":"2023-10-18T11:39:01.989414+0000","last_peered":"2023-10-18T11:39:01.989414+0000","last_clean":"2023-10-18T11:39:01.989414+0000","last_became_active":"2023-10-18T11:09:39.420652+0000","last_became_peered":"2023-10-18T11:09:39.420652+0000","last_unstale":"2023-10-18T11:39:01.989414+0000","last_undegraded":"2023-10-18T11:39:01.989414+0000","last_fullsized":"2023-10-18T11:39:01.989414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'128","last_scrub_stamp":"2023-10-18T11:39:01.989245+0000","last_deep_scrub":"31'128","last_deep_scrub_stamp":"2023-10-18T11:39:01.989245+0000","last_clean_scrub_stamp":"2023-10-18T11:39:01.989245+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:33:44.876349+0000","scrub_duration":0.0035044519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'145","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:34.309838+0000","last_change":"2023-10-18T11:38:34.309877+0000","last_active":"2023-10-18T11:38:34.309838+0000","last_peered":"2023-10-18T11:38:34.309838+0000","last_clean":"2023-10-18T11:38:34.309838+0000","last_became_active":"2023-10-18T11:09:39.419658+0000","last_became_peered":"2023-10-18T11:09:39.419658+0000","last_unstale":"2023-10-18T11:38:34.309838+0000","last_undegraded":"2023-10-18T11:38:34.309838+0000","last_fullsized":"2023-10-18T11:38:34.309838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:38:34.309736+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:38:34.309736+0000","last_clean_scrub_stamp":"2023-10-18T11:38:34.309736+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:20.124864+0000","scrub_duration":0.0026226790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'162","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:00.989024+0000","last_change":"2023-10-18T11:39:00.989143+0000","last_active":"2023-10-18T11:39:00.989024+0000","last_peered":"2023-10-18T11:39:00.989024+0000","last_clean":"2023-10-18T11:39:00.989024+0000","last_became_active":"2023-10-18T11:09:39.419719+0000","last_became_peered":"2023-10-18T11:09:39.419719+0000","last_unstale":"2023-10-18T11:39:00.989024+0000","last_undegraded":"2023-10-18T11:39:00.989024+0000","last_fullsized":"2023-10-18T11:39:00.989024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'162","last_scrub_stamp":"2023-10-18T11:39:00.988808+0000","last_deep_scrub":"31'162","last_deep_scrub_stamp":"2023-10-18T11:39:00.988808+0000","last_clean_scrub_stamp":"2023-10-18T11:39:00.988808+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:10:10.375027+0000","scrub_duration":0.0030012239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'149","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:32.215456+0000","last_change":"2023-10-18T11:38:32.215456+0000","last_active":"2023-10-18T11:38:32.215456+0000","last_peered":"2023-10-18T11:38:32.215456+0000","last_clean":"2023-10-18T11:38:32.215456+0000","last_became_active":"2023-10-18T11:09:39.349020+0000","last_became_peered":"2023-10-18T11:09:39.349020+0000","last_unstale":"2023-10-18T11:38:32.215456+0000","last_undegraded":"2023-10-18T11:38:32.215456+0000","last_fullsized":"2023-10-18T11:38:32.215456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'149","last_scrub_stamp":"2023-10-18T11:38:32.215344+0000","last_deep_scrub":"31'149","last_deep_scrub_stamp":"2023-10-18T11:38:32.215344+0000","last_clean_scrub_stamp":"2023-10-18T11:38:32.215344+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:26:46.370051+0000","scrub_duration":0.0012886499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'153","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:25.111474+0000","last_change":"2023-10-18T11:38:25.111474+0000","last_active":"2023-10-18T11:38:25.111474+0000","last_peered":"2023-10-18T11:38:25.111474+0000","last_clean":"2023-10-18T11:38:25.111474+0000","last_became_active":"2023-10-18T11:09:39.361076+0000","last_became_peered":"2023-10-18T11:09:39.361076+0000","last_unstale":"2023-10-18T11:38:25.111474+0000","last_undegraded":"2023-10-18T11:38:25.111474+0000","last_fullsized":"2023-10-18T11:38:25.111474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:25.111222+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:25.111222+0000","last_clean_scrub_stamp":"2023-10-18T11:38:25.111222+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:30.151595+0000","scrub_duration":0.0029533910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'152","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:23.587609+0000","last_change":"2023-10-18T11:38:23.587609+0000","last_active":"2023-10-18T11:38:23.587609+0000","last_peered":"2023-10-18T11:38:23.587609+0000","last_clean":"2023-10-18T11:38:23.587609+0000","last_became_active":"2023-10-18T11:09:39.398816+0000","last_became_peered":"2023-10-18T11:09:39.398816+0000","last_unstale":"2023-10-18T11:38:23.587609+0000","last_undegraded":"2023-10-18T11:38:23.587609+0000","last_fullsized":"2023-10-18T11:38:23.587609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'152","last_scrub_stamp":"2023-10-18T11:38:23.587505+0000","last_deep_scrub":"31'152","last_deep_scrub_stamp":"2023-10-18T11:38:23.587505+0000","last_clean_scrub_stamp":"2023-10-18T11:38:23.587505+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:05:26.405832+0000","scrub_duration":0.0012722530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'153","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:02.746285+0000","last_change":"2023-10-18T11:39:02.746320+0000","last_active":"2023-10-18T11:39:02.746285+0000","last_peered":"2023-10-18T11:39:02.746285+0000","last_clean":"2023-10-18T11:39:02.746285+0000","last_became_active":"2023-10-18T11:09:39.354942+0000","last_became_peered":"2023-10-18T11:09:39.354942+0000","last_unstale":"2023-10-18T11:39:02.746285+0000","last_undegraded":"2023-10-18T11:39:02.746285+0000","last_fullsized":"2023-10-18T11:39:02.746285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:39:02.746221+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:39:02.746221+0000","last_clean_scrub_stamp":"2023-10-18T11:39:02.746221+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:28:44.912408+0000","scrub_duration":0.0028801230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'167","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:26.660058+0000","last_change":"2023-10-18T11:38:26.660178+0000","last_active":"2023-10-18T11:38:26.660058+0000","last_peered":"2023-10-18T11:38:26.660058+0000","last_clean":"2023-10-18T11:38:26.660058+0000","last_became_active":"2023-10-18T11:09:39.320434+0000","last_became_peered":"2023-10-18T11:09:39.320434+0000","last_unstale":"2023-10-18T11:38:26.660058+0000","last_undegraded":"2023-10-18T11:38:26.660058+0000","last_fullsized":"2023-10-18T11:38:26.660058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-10-18T11:38:26.659882+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-10-18T11:38:26.659882+0000","last_clean_scrub_stamp":"2023-10-18T11:38:26.659882+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:03:11.158659+0000","scrub_duration":0.0030154539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'146","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:41.580265+0000","last_change":"2023-10-18T11:38:41.580389+0000","last_active":"2023-10-18T11:38:41.580265+0000","last_peered":"2023-10-18T11:38:41.580265+0000","last_clean":"2023-10-18T11:38:41.580265+0000","last_became_active":"2023-10-18T11:10:10.400630+0000","last_became_peered":"2023-10-18T11:10:10.400630+0000","last_unstale":"2023-10-18T11:38:41.580265+0000","last_undegraded":"2023-10-18T11:38:41.580265+0000","last_fullsized":"2023-10-18T11:38:41.580265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:41.580103+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:41.580103+0000","last_clean_scrub_stamp":"2023-10-18T11:38:41.580103+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:23:36.795823+0000","scrub_duration":0.003715356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'144","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:45.218022+0000","last_change":"2023-10-18T11:38:45.218066+0000","last_active":"2023-10-18T11:38:45.218022+0000","last_peered":"2023-10-18T11:38:45.218022+0000","last_clean":"2023-10-18T11:38:45.218022+0000","last_became_active":"2023-10-18T11:09:39.354066+0000","last_became_peered":"2023-10-18T11:09:39.354066+0000","last_unstale":"2023-10-18T11:38:45.218022+0000","last_undegraded":"2023-10-18T11:38:45.218022+0000","last_fullsized":"2023-10-18T11:38:45.218022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'144","last_scrub_stamp":"2023-10-18T11:38:45.217957+0000","last_deep_scrub":"31'144","last_deep_scrub_stamp":"2023-10-18T11:38:45.217957+0000","last_clean_scrub_stamp":"2023-10-18T11:38:45.217957+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:50.170432+0000","scrub_duration":0.0024820129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:41.956635+0000","last_change":"2023-10-18T11:38:41.956833+0000","last_active":"2023-10-18T11:38:41.956635+0000","last_peered":"2023-10-18T11:38:41.956635+0000","last_clean":"2023-10-18T11:38:41.956635+0000","last_became_active":"2023-10-18T11:09:39.401256+0000","last_became_peered":"2023-10-18T11:09:39.401256+0000","last_unstale":"2023-10-18T11:38:41.956635+0000","last_undegraded":"2023-10-18T11:38:41.956635+0000","last_fullsized":"2023-10-18T11:38:41.956635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-10-18T11:38:41.956444+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-10-18T11:38:41.956444+0000","last_clean_scrub_stamp":"2023-10-18T11:38:41.956444+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:15:40.929938+0000","scrub_duration":0.003296551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'135","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:20.107478+0000","last_change":"2023-10-18T11:38:20.107589+0000","last_active":"2023-10-18T11:38:20.107478+0000","last_peered":"2023-10-18T11:38:20.107478+0000","last_clean":"2023-10-18T11:38:20.107478+0000","last_became_active":"2023-10-18T11:09:39.365405+0000","last_became_peered":"2023-10-18T11:09:39.365405+0000","last_unstale":"2023-10-18T11:38:20.107478+0000","last_undegraded":"2023-10-18T11:38:20.107478+0000","last_fullsized":"2023-10-18T11:38:20.107478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2023-10-18T11:38:20.107315+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2023-10-18T11:38:20.107315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:20.107315+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:23:15.323035+0000","scrub_duration":0.004575244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'173","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:00.098272+0000","last_change":"2023-10-18T11:39:00.098272+0000","last_active":"2023-10-18T11:39:00.098272+0000","last_peered":"2023-10-18T11:39:00.098272+0000","last_clean":"2023-10-18T11:39:00.098272+0000","last_became_active":"2023-10-18T11:10:10.412547+0000","last_became_peered":"2023-10-18T11:10:10.412547+0000","last_unstale":"2023-10-18T11:39:00.098272+0000","last_undegraded":"2023-10-18T11:39:00.098272+0000","last_fullsized":"2023-10-18T11:39:00.098272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'173","last_scrub_stamp":"2023-10-18T11:39:00.098001+0000","last_deep_scrub":"31'173","last_deep_scrub_stamp":"2023-10-18T11:39:00.098001+0000","last_clean_scrub_stamp":"2023-10-18T11:39:00.098001+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:53:13.062894+0000","scrub_duration":0.0031508560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'137","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:29.600525+0000","last_change":"2023-10-18T11:38:29.600525+0000","last_active":"2023-10-18T11:38:29.600525+0000","last_peered":"2023-10-18T11:38:29.600525+0000","last_clean":"2023-10-18T11:38:29.600525+0000","last_became_active":"2023-10-18T11:09:39.400316+0000","last_became_peered":"2023-10-18T11:09:39.400316+0000","last_unstale":"2023-10-18T11:38:29.600525+0000","last_undegraded":"2023-10-18T11:38:29.600525+0000","last_fullsized":"2023-10-18T11:38:29.600525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:29.600430+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:29.600430+0000","last_clean_scrub_stamp":"2023-10-18T11:38:29.600430+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:12:23.713131+0000","scrub_duration":0.0012082449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'153","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.453393+0000","last_change":"2023-10-18T11:38:37.453393+0000","last_active":"2023-10-18T11:38:37.453393+0000","last_peered":"2023-10-18T11:38:37.453393+0000","last_clean":"2023-10-18T11:38:37.453393+0000","last_became_active":"2023-10-18T11:09:39.320293+0000","last_became_peered":"2023-10-18T11:09:39.320293+0000","last_unstale":"2023-10-18T11:38:37.453393+0000","last_undegraded":"2023-10-18T11:38:37.453393+0000","last_fullsized":"2023-10-18T11:38:37.453393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'153","last_scrub_stamp":"2023-10-18T11:38:37.453285+0000","last_deep_scrub":"31'153","last_deep_scrub_stamp":"2023-10-18T11:38:37.453285+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.453285+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:11.486559+0000","scrub_duration":0.0016972199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'147","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.494852+0000","last_change":"2023-10-18T11:38:38.494852+0000","last_active":"2023-10-18T11:38:38.494852+0000","last_peered":"2023-10-18T11:38:38.494852+0000","last_clean":"2023-10-18T11:38:38.494852+0000","last_became_active":"2023-10-18T11:09:39.320224+0000","last_became_peered":"2023-10-18T11:09:39.320224+0000","last_unstale":"2023-10-18T11:38:38.494852+0000","last_undegraded":"2023-10-18T11:38:38.494852+0000","last_fullsized":"2023-10-18T11:38:38.494852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'147","last_scrub_stamp":"2023-10-18T11:38:38.494746+0000","last_deep_scrub":"31'147","last_deep_scrub_stamp":"2023-10-18T11:38:38.494746+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.494746+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:55:08.117988+0000","scrub_duration":0.001373895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'145","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:39:01.739491+0000","last_change":"2023-10-18T11:39:01.739546+0000","last_active":"2023-10-18T11:39:01.739491+0000","last_peered":"2023-10-18T11:39:01.739491+0000","last_clean":"2023-10-18T11:39:01.739491+0000","last_became_active":"2023-10-18T11:09:39.355008+0000","last_became_peered":"2023-10-18T11:09:39.355008+0000","last_unstale":"2023-10-18T11:39:01.739491+0000","last_undegraded":"2023-10-18T11:39:01.739491+0000","last_fullsized":"2023-10-18T11:39:01.739491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'145","last_scrub_stamp":"2023-10-18T11:39:01.739368+0000","last_deep_scrub":"31'145","last_deep_scrub_stamp":"2023-10-18T11:39:01.739368+0000","last_clean_scrub_stamp":"2023-10-18T11:39:01.739368+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:53:14.704262+0000","scrub_duration":0.0016360560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'150","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:13.945550+0000","last_change":"2023-10-18T11:38:13.945663+0000","last_active":"2023-10-18T11:38:13.945550+0000","last_peered":"2023-10-18T11:38:13.945550+0000","last_clean":"2023-10-18T11:38:13.945550+0000","last_became_active":"2023-10-18T11:09:39.420479+0000","last_became_peered":"2023-10-18T11:09:39.420479+0000","last_unstale":"2023-10-18T11:38:13.945550+0000","last_undegraded":"2023-10-18T11:38:13.945550+0000","last_fullsized":"2023-10-18T11:38:13.945550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'150","last_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_deep_scrub":"31'150","last_deep_scrub_stamp":"2023-10-18T11:38:13.945379+0000","last_clean_scrub_stamp":"2023-10-18T11:38:13.945379+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:41:29.853585+0000","scrub_duration":0.0032551009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'134","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:54.714104+0000","last_change":"2023-10-18T11:38:54.714158+0000","last_active":"2023-10-18T11:38:54.714104+0000","last_peered":"2023-10-18T11:38:54.714104+0000","last_clean":"2023-10-18T11:38:54.714104+0000","last_became_active":"2023-10-18T11:09:39.360659+0000","last_became_peered":"2023-10-18T11:09:39.360659+0000","last_unstale":"2023-10-18T11:38:54.714104+0000","last_undegraded":"2023-10-18T11:38:54.714104+0000","last_fullsized":"2023-10-18T11:38:54.714104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'134","last_scrub_stamp":"2023-10-18T11:38:54.713999+0000","last_deep_scrub":"31'134","last_deep_scrub_stamp":"2023-10-18T11:38:54.713999+0000","last_clean_scrub_stamp":"2023-10-18T11:38:54.713999+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:47:08.372510+0000","scrub_duration":0.0029353119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'143","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:38.682215+0000","last_change":"2023-10-18T11:38:38.682399+0000","last_active":"2023-10-18T11:38:38.682215+0000","last_peered":"2023-10-18T11:38:38.682215+0000","last_clean":"2023-10-18T11:38:38.682215+0000","last_became_active":"2023-10-18T11:10:10.412658+0000","last_became_peered":"2023-10-18T11:10:10.412658+0000","last_unstale":"2023-10-18T11:38:38.682215+0000","last_undegraded":"2023-10-18T11:38:38.682215+0000","last_fullsized":"2023-10-18T11:38:38.682215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'143","last_scrub_stamp":"2023-10-18T11:38:38.682031+0000","last_deep_scrub":"31'143","last_deep_scrub_stamp":"2023-10-18T11:38:38.682031+0000","last_clean_scrub_stamp":"2023-10-18T11:38:38.682031+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:17:12.903605+0000","scrub_duration":0.0035830810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'127","reported_seq":165,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:18.587489+0000","last_change":"2023-10-18T11:38:18.587542+0000","last_active":"2023-10-18T11:38:18.587489+0000","last_peered":"2023-10-18T11:38:18.587489+0000","last_clean":"2023-10-18T11:38:18.587489+0000","last_became_active":"2023-10-18T11:09:39.354785+0000","last_became_peered":"2023-10-18T11:09:39.354785+0000","last_unstale":"2023-10-18T11:38:18.587489+0000","last_undegraded":"2023-10-18T11:38:18.587489+0000","last_fullsized":"2023-10-18T11:38:18.587489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'127","last_scrub_stamp":"2023-10-18T11:38:18.587414+0000","last_deep_scrub":"31'127","last_deep_scrub_stamp":"2023-10-18T11:38:18.587414+0000","last_clean_scrub_stamp":"2023-10-18T11:38:18.587414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:42:00.007644+0000","scrub_duration":0.0032637949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'137","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:35.338828+0000","last_change":"2023-10-18T11:38:35.338865+0000","last_active":"2023-10-18T11:38:35.338828+0000","last_peered":"2023-10-18T11:38:35.338828+0000","last_clean":"2023-10-18T11:38:35.338828+0000","last_became_active":"2023-10-18T11:09:39.418105+0000","last_became_peered":"2023-10-18T11:09:39.418105+0000","last_unstale":"2023-10-18T11:38:35.338828+0000","last_undegraded":"2023-10-18T11:38:35.338828+0000","last_fullsized":"2023-10-18T11:38:35.338828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'137","last_scrub_stamp":"2023-10-18T11:38:35.338757+0000","last_deep_scrub":"31'137","last_deep_scrub_stamp":"2023-10-18T11:38:35.338757+0000","last_clean_scrub_stamp":"2023-10-18T11:38:35.338757+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:54:11.626222+0000","scrub_duration":0.0026066140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'142","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:37.876365+0000","last_change":"2023-10-18T11:38:37.876365+0000","last_active":"2023-10-18T11:38:37.876365+0000","last_peered":"2023-10-18T11:38:37.876365+0000","last_clean":"2023-10-18T11:38:37.876365+0000","last_became_active":"2023-10-18T11:09:39.362477+0000","last_became_peered":"2023-10-18T11:09:39.362477+0000","last_unstale":"2023-10-18T11:38:37.876365+0000","last_undegraded":"2023-10-18T11:38:37.876365+0000","last_fullsized":"2023-10-18T11:38:37.876365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'142","last_scrub_stamp":"2023-10-18T11:38:37.876023+0000","last_deep_scrub":"31'142","last_deep_scrub_stamp":"2023-10-18T11:38:37.876023+0000","last_clean_scrub_stamp":"2023-10-18T11:38:37.876023+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:42.828498+0000","scrub_duration":0.0035315149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'165","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:11.775586+0000","last_change":"2023-10-18T11:38:11.775586+0000","last_active":"2023-10-18T11:38:11.775586+0000","last_peered":"2023-10-18T11:38:11.775586+0000","last_clean":"2023-10-18T11:38:11.775586+0000","last_became_active":"2023-10-18T11:09:39.361826+0000","last_became_peered":"2023-10-18T11:09:39.361826+0000","last_unstale":"2023-10-18T11:38:11.775586+0000","last_undegraded":"2023-10-18T11:38:11.775586+0000","last_fullsized":"2023-10-18T11:38:11.775586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2023-10-18T11:38:11.775315+0000","last_clean_scrub_stamp":"2023-10-18T11:38:11.775315+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:28.740862+0000","scrub_duration":0.0041709950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'146","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-18T11:38:58.754530+0000","last_change":"2023-10-18T11:38:58.754569+0000","last_active":"2023-10-18T11:38:58.754530+0000","last_peered":"2023-10-18T11:38:58.754530+0000","last_clean":"2023-10-18T11:38:58.754530+0000","last_became_active":"2023-10-18T11:09:39.354040+0000","last_became_peered":"2023-10-18T11:09:39.354040+0000","last_unstale":"2023-10-18T11:38:58.754530+0000","last_undegraded":"2023-10-18T11:38:58.754530+0000","last_fullsized":"2023-10-18T11:38:58.754530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'146","last_scrub_stamp":"2023-10-18T11:38:58.754458+0000","last_deep_scrub":"31'146","last_deep_scrub_stamp":"2023-10-18T11:38:58.754458+0000","last_clean_scrub_stamp":"2023-10-18T11:38:58.754458+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:08:16.503632+0000","scrub_duration":0.001988156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2017,"num_read_kb":484709,"num_write":10619,"num_write_kb":576779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13929,"ondisk_log_size":13929,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9424,"ondisk_log_size":9424,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":100007018,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":2171,"num_read_kb":2416,"num_write":26219,"num_write_kb":112209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159006720,"data_stored":200014036,"data_compressed":12429396,"data_compressed_allocated":19357696,"data_compressed_original":60612608,"omap_allocated":0,"internal_metadata":0},"log_size":24373,"ondisk_log_size":24373,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65070,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509810,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113708,"kb_used_data":24228,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94258132,"statfs":{"total":96636764160,"available":96520327168,"internally_reserved":0,"allocated":24809472,"data_stored":31797443,"data_compressed":2010206,"data_compressed_allocated":3112960,"data_compressed_original":10338304,"omap_allocated":1588,"internal_metadata":91617740},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.65200000000000002,"15min":0.60499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.28999999999999998},"max":{"1min":1.0840000000000001,"5min":2.0219999999999998,"15min":3.6469999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.5,"5min":0.34000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0940000000000001,"5min":1.3260000000000001,"15min":19.158000000000001},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Oct 18 11:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.90100000000000002,"15min":0.73999999999999999},"min":{"1min":0.57699999999999996,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":19.673999999999999,"15min":19.673999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.86399999999999999,"15min":0.72999999999999998},"min":{"1min":0.59899999999999998,"5min":0.38600000000000001,"15min":0.36099999999999999},"max":{"1min":1.02,"5min":15.692,"15min":15.692},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed Oct 18 11:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.70099999999999996,"15min":0.66600000000000004},"min":{"1min":0.621,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.9239999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.69899999999999995,"15min":0.68000000000000005},"min":{"1min":0.58599999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1619999999999999,"5min":1.528,"15min":5.444},"last":0.59099999999999997}]},{"osd":3,"last update":"Wed Oct 18 11:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.88100000000000001,"15min":0.81599999999999995},"min":{"1min":0.58699999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.143,"5min":12.368,"15min":12.368},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.49099999999999999,"5min":0.39200000000000002,"15min":0.35999999999999999},"max":{"1min":1.476,"5min":1.6279999999999999,"15min":13.1},"last":0.92900000000000005}]},{"osd":4,"last update":"Wed Oct 18 11:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34799999999999998,"15min":0.35199999999999998},"min":{"1min":0.24199999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":1.895},"last":0.437},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.25700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":1.321},"last":0.29699999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":1.081},"last":0.316},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.624,"15min":5.0819999999999999},"last":0.35399999999999998}]},{"osd":6,"last update":"Wed Oct 18 11:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.42499999999999999},"min":{"1min":0.32500000000000001,"5min":0.29099999999999998,"15min":0.27100000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":3.4409999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.41199999999999998},"min":{"1min":0.32400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":1.1180000000000001},"last":0.33700000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509808,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93740,"kb_used_data":18148,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278100,"statfs":{"total":96636764160,"available":96540774400,"internally_reserved":0,"allocated":18583552,"data_stored":23213882,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.63,"15min":0.63900000000000001},"min":{"1min":0.39000000000000001,"5min":0.36199999999999999,"15min":0.31},"max":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":9.3190000000000008},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.65900000000000003,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":1.087,"5min":1.1699999999999999,"15min":15.282999999999999},"last":0.83799999999999997}]},{"osd":1,"last update":"Wed Oct 18 11:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.53600000000000003,"5min":0.379,"15min":0.32900000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":6.6429999999999998},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.46500000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0009999999999999,"5min":1.1080000000000001,"15min":1.748},"last":0.67300000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.68400000000000005,"15min":0.63300000000000001},"min":{"1min":0.54700000000000004,"5min":0.35799999999999998,"15min":0.33300000000000002},"max":{"1min":0.94699999999999995,"5min":1.355,"15min":1.839},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.71899999999999997,"15min":0.68700000000000006},"min":{"1min":0.60499999999999998,"5min":0.39000000000000001,"15min":0.34499999999999997},"max":{"1min":1.077,"5min":1.468,"15min":1.6819999999999999},"last":0.68100000000000005}]},{"osd":3,"last update":"Wed Oct 18 11:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.67600000000000005,"15min":0.72899999999999998},"min":{"1min":0.57199999999999995,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":0.94599999999999995,"5min":1.113,"15min":13.840999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.76000000000000001},"min":{"1min":0.51300000000000001,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":0.96399999999999997,"5min":1.171,"15min":23.155999999999999},"last":1.0249999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.35899999999999999},"min":{"1min":0.27600000000000002,"5min":0.23899999999999999,"15min":0.222},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.88},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38100000000000001,"15min":0.373},"min":{"1min":0.29499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":1.0469999999999999},"last":0.51800000000000002}]},{"osd":6,"last update":"Wed Oct 18 11:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39000000000000001,"15min":0.376},"min":{"1min":0.27300000000000002,"5min":0.26900000000000002,"15min":0.23300000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.56799999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.38600000000000001},"min":{"1min":0.33700000000000002,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.624},"last":0.53400000000000003}]},{"osd":7,"last update":"Wed Oct 18 11:39:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41099999999999998,"15min":0.40799999999999997},"min":{"1min":0.33800000000000002,"5min":0.27500000000000002,"15min":0.253},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.77600000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41199999999999998,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26600000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.502}]}]},{"osd":4,"up_from":15,"seq":64424509809,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87864,"kb_used_data":20592,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94283976,"statfs":{"total":96636764160,"available":96546791424,"internally_reserved":0,"allocated":21086208,"data_stored":26657639,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.501,"5min":0.32200000000000001,"15min":0.29599999999999999},"max":{"1min":0.98499999999999999,"5min":1.21,"15min":1.663},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71099999999999997,"15min":0.629},"min":{"1min":0.55600000000000005,"5min":0.373,"15min":0.29199999999999998},"max":{"1min":1.0720000000000001,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.93500000000000005}]},{"osd":1,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.66700000000000004,"15min":0.64500000000000002},"min":{"1min":0.57999999999999996,"5min":0.35399999999999998,"15min":0.32500000000000001},"max":{"1min":1.0629999999999999,"5min":1.246,"15min":1.8620000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.71799999999999997,"15min":0.67900000000000005},"min":{"1min":0.56599999999999995,"5min":0.34100000000000003,"15min":0.32800000000000001},"max":{"1min":1.034,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.54800000000000004}]},{"osd":2,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.66500000000000004,"15min":0.63300000000000001},"min":{"1min":0.57699999999999996,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.038,"5min":1.1990000000000001,"15min":1.248},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.69099999999999995},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.32800000000000001},"max":{"1min":1.073,"5min":1.2350000000000001,"15min":3.5579999999999998},"last":0.66400000000000003}]},{"osd":3,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.54100000000000004,"5min":0.38300000000000001,"15min":0.373},"max":{"1min":0.90600000000000003,"5min":1.1299999999999999,"15min":1.5049999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.55800000000000005,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":0.91800000000000004,"5min":1.244,"15min":1.8779999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.29399999999999998,"5min":0.25600000000000001,"15min":0.223},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.72699999999999998},"last":0.374},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.24399999999999999},"max":{"1min":0.55000000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.39200000000000002}]},{"osd":6,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.371,"15min":0.36399999999999999},"min":{"1min":0.28499999999999998,"5min":0.24299999999999999,"15min":0.224},"max":{"1min":0.5,"5min":0.57799999999999996,"15min":0.622},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.40600000000000003},"min":{"1min":0.31900000000000001,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.57199999999999995,"5min":0.65900000000000003,"15min":0.67400000000000004},"last":0.45300000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58799999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42299999999999999},"min":{"1min":0.30499999999999999,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.54000000000000004,"5min":0.67300000000000004,"15min":0.68999999999999995},"last":0.47099999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509808,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148704,"kb_used_data":27288,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94223136,"statfs":{"total":96636764160,"available":96484491264,"internally_reserved":0,"allocated":27942912,"data_stored":33976532,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":1591,"internal_metadata":124320201},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.1619999999999999,"15min":1.137},"min":{"1min":0.70699999999999996,"5min":0.55200000000000005,"15min":0.314},"max":{"1min":1.6759999999999999,"5min":6.1070000000000002,"15min":24.654},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.329,"5min":1.2450000000000001,"15min":1.149},"min":{"1min":0.86099999999999999,"5min":0.42699999999999999,"15min":0.379},"max":{"1min":1.7430000000000001,"5min":9.4079999999999995,"15min":18.518000000000001},"last":1.2450000000000001}]},{"osd":1,"last update":"Wed Oct 18 11:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.3029999999999999,"15min":1.23},"min":{"1min":0.80900000000000005,"5min":0.441,"15min":0.35399999999999998},"max":{"1min":1.7210000000000001,"5min":9.1099999999999994,"15min":16.361999999999998},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.341,"15min":1.355},"min":{"1min":0.80900000000000005,"5min":0.57699999999999996,"15min":0.43099999999999999},"max":{"1min":1.7889999999999999,"5min":6.431,"15min":24.611000000000001},"last":1.1559999999999999}]},{"osd":2,"last update":"Wed Oct 18 11:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.377},"min":{"1min":1.026,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.7250000000000001,"5min":3.5640000000000001,"15min":16.576000000000001},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4790000000000001,"15min":1.4730000000000001},"min":{"1min":0.93500000000000005,"5min":0.46500000000000002,"15min":0.45100000000000001},"max":{"1min":1.998,"5min":6.0430000000000001,"15min":24.553000000000001},"last":1.4670000000000001}]},{"osd":4,"last update":"Wed Oct 18 11:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3109999999999999,"15min":1.2310000000000001},"min":{"1min":0.86399999999999999,"5min":0.51800000000000002,"15min":0.432},"max":{"1min":1.9430000000000001,"5min":9.359,"15min":18.721},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.272,"15min":1.268},"min":{"1min":0.93300000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2650000000000001,"5min":3.8250000000000002,"15min":16.481000000000002},"last":1.1160000000000001}]},{"osd":5,"last update":"Wed Oct 18 11:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.401,"15min":1.3859999999999999},"min":{"1min":0.86899999999999999,"5min":0.621,"15min":0.44700000000000001},"max":{"1min":1.7689999999999999,"5min":6.5570000000000004,"15min":24.786999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4970000000000001,"15min":1.3680000000000001},"min":{"1min":0.96199999999999997,"5min":0.58699999999999997,"15min":0.49199999999999999},"max":{"1min":2.056,"5min":13.087,"15min":18.681999999999999},"last":1.839}]},{"osd":6,"last update":"Wed Oct 18 11:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":1.0529999999999999,"5min":0.59899999999999998,"15min":0.52900000000000003},"max":{"1min":2.1800000000000002,"5min":3.75,"15min":16.513999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.5129999999999999,"15min":1.502},"min":{"1min":1.0089999999999999,"5min":0.66300000000000003,"15min":0.54300000000000004},"max":{"1min":1.8720000000000001,"5min":6.5949999999999998,"15min":24.834},"last":1.3440000000000001}]},{"osd":7,"last update":"Wed Oct 18 11:39:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.591,"15min":1.47},"min":{"1min":1.111,"5min":0.499,"15min":0.499},"max":{"1min":2.1280000000000001,"5min":13.042,"15min":18.800000000000001},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.5700000000000001,"15min":1.5129999999999999},"min":{"1min":1.2330000000000001,"5min":0.64100000000000001,"15min":0.496},"max":{"1min":2.3340000000000001,"5min":6.1689999999999996,"15min":16.544},"last":1.3160000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509808,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94552,"kb_used_data":13456,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94277288,"statfs":{"total":96636764160,"available":96539942912,"internally_reserved":0,"allocated":13778944,"data_stored":17047576,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1259999999999999,"15min":1.0600000000000001},"min":{"1min":0.73199999999999998,"5min":0.40600000000000003,"15min":0.308},"max":{"1min":1.663,"5min":2.234,"15min":2.9249999999999998},"last":1.149},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.198,"15min":1.107},"min":{"1min":0.80900000000000005,"5min":0.41999999999999998,"15min":0.34300000000000003},"max":{"1min":1.6579999999999999,"5min":3.2919999999999998,"15min":3.964},"last":0.98799999999999999}]},{"osd":1,"last update":"Wed Oct 18 11:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.198,"15min":1.1910000000000001},"min":{"1min":0.70699999999999996,"5min":0.53700000000000003,"15min":0.40200000000000002},"max":{"1min":1.637,"5min":2.7280000000000002,"15min":4.3460000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.345,"15min":1.284},"min":{"1min":1.071,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9390000000000001,"5min":5.2629999999999999,"15min":5.2629999999999999},"last":1.3069999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4490000000000001,"15min":1.3560000000000001},"min":{"1min":1.1839999999999999,"5min":0.56000000000000005,"15min":0.44},"max":{"1min":1.8640000000000001,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":1.48},{"interface":"front","average":{"1min":1.524,"5min":1.5309999999999999,"15min":1.3959999999999999},"min":{"1min":1.0640000000000001,"5min":0.55400000000000005,"15min":0.53900000000000003},"max":{"1min":1.9390000000000001,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.427}]},{"osd":4,"last update":"Wed Oct 18 11:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2090000000000001,"15min":1.143},"min":{"1min":0.78000000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.7270000000000001,"5min":3.3759999999999999,"15min":3.3759999999999999},"last":1.694},{"interface":"front","average":{"1min":1.24,"5min":1.256,"15min":1.2090000000000001},"min":{"1min":0.86099999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.952,"5min":3.831,"15min":3.831},"last":1.839}]},{"osd":5,"last update":"Wed Oct 18 11:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.423,"15min":1.2709999999999999},"min":{"1min":0.90700000000000003,"5min":0.58799999999999997,"15min":0.46200000000000002},"max":{"1min":2.3340000000000001,"5min":5.0529999999999999,"15min":5.0529999999999999},"last":1.8700000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.369,"15min":1.27},"min":{"1min":0.77400000000000002,"5min":0.51200000000000001,"15min":0.441},"max":{"1min":1.8819999999999999,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":1.54}]},{"osd":6,"last update":"Wed Oct 18 11:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4099999999999999,"15min":1.323},"min":{"1min":0.997,"5min":0.60899999999999999,"15min":0.49399999999999999},"max":{"1min":2.0009999999999999,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.548,"15min":1.3779999999999999},"min":{"1min":0.97299999999999998,"5min":0.68100000000000005,"15min":0.50700000000000001},"max":{"1min":2.4009999999999998,"5min":5.133,"15min":5.133},"last":1.99}]},{"osd":7,"last update":"Wed Oct 18 11:39:20 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.5069999999999999,"15min":1.3839999999999999},"min":{"1min":1.0780000000000001,"5min":0.68100000000000005,"15min":0.48599999999999999},"max":{"1min":2.004,"5min":3.597,"15min":3.597},"last":1.7909999999999999},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5580000000000001,"15min":1.4379999999999999},"min":{"1min":1.071,"5min":0.65100000000000002,"15min":0.55900000000000005},"max":{"1min":2.0640000000000001,"5min":4.0430000000000001,"15min":4.0430000000000001},"last":1.746}]}]},{"osd":1,"up_from":15,"seq":64424509809,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153264,"kb_used_data":23592,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94218576,"statfs":{"total":96636764160,"available":96479821824,"internally_reserved":0,"allocated":24158208,"data_stored":30584690,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0189999999999999,"15min":1.087},"min":{"1min":0.69599999999999995,"5min":0.58499999999999996,"15min":0.313},"max":{"1min":1.806,"5min":1.806,"15min":10.836},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.2290000000000001,"15min":1.143},"min":{"1min":0.86699999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.877,"5min":2.9950000000000001,"15min":3.8410000000000002},"last":1.474}]},{"osd":2,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.212,"15min":1.1859999999999999},"min":{"1min":0.88300000000000001,"5min":0.40899999999999997,"15min":0.32900000000000001},"max":{"1min":1.7869999999999999,"5min":3.2389999999999999,"15min":4.4199999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.399,"5min":1.4019999999999999,"15min":1.333},"min":{"1min":0.92000000000000004,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":1.8500000000000001,"5min":8.6229999999999993,"15min":10.782},"last":1.5409999999999999}]},{"osd":3,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3220000000000001,"15min":1.397},"min":{"1min":1.0169999999999999,"5min":0.58899999999999997,"15min":0.55800000000000005},"max":{"1min":1.7629999999999999,"5min":2.8420000000000001,"15min":6.8150000000000004},"last":1.284},{"interface":"front","average":{"1min":1.429,"5min":1.3260000000000001,"15min":1.319},"min":{"1min":0.91600000000000004,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.9410000000000001,"5min":3.1200000000000001,"15min":3.79},"last":1.1839999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1990000000000001,"15min":1.1859999999999999},"min":{"1min":0.85199999999999998,"5min":0.45400000000000001,"15min":0.376},"max":{"1min":1.849,"5min":3.9510000000000001,"15min":4.3890000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.2330000000000001,"15min":1.2809999999999999},"min":{"1min":0.81999999999999995,"5min":0.63300000000000001,"15min":0.60899999999999999},"max":{"1min":1.694,"5min":2.6349999999999998,"15min":6.9950000000000001},"last":1.03}]},{"osd":5,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.3140000000000001,"15min":1.2649999999999999},"min":{"1min":0.84499999999999997,"5min":0.58599999999999997,"15min":0.495},"max":{"1min":1.95,"5min":4.2939999999999996,"15min":4.2939999999999996},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.319,"15min":1.3049999999999999},"min":{"1min":0.86599999999999999,"5min":0.54100000000000004,"15min":0.52900000000000003},"max":{"1min":1.962,"5min":2.1320000000000001,"15min":4.3419999999999996},"last":1.2290000000000001}]},{"osd":6,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3859999999999999,"15min":1.4039999999999999},"min":{"1min":1,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9330000000000001,"5min":2.7400000000000002,"15min":6.944},"last":1.147},{"interface":"front","average":{"1min":1.556,"5min":1.401,"15min":1.369},"min":{"1min":1.04,"5min":0.60099999999999998,"15min":0.55300000000000005},"max":{"1min":2.0680000000000001,"5min":3.3849999999999998,"15min":3.657},"last":1.2589999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.502,"15min":1.454},"min":{"1min":1.0649999999999999,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":2.161,"5min":3.27,"15min":3.722},"last":1.407},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.478,"15min":1.45},"min":{"1min":0.98099999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.0249999999999999,"5min":2.2589999999999999,"15min":4.2919999999999998},"last":1.363}]}]},{"osd":0,"up_from":15,"seq":64424509809,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106768,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94265072,"statfs":{"total":96636764160,"available":96527433728,"internally_reserved":0,"allocated":17768448,"data_stored":22732859,"data_compressed":1487303,"data_compressed_allocated":2297856,"data_compressed_original":7491584,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0209999999999999,"15min":1.048},"min":{"1min":0.53300000000000003,"5min":0.308,"15min":0.28999999999999998},"max":{"1min":1.643,"5min":5.2450000000000001,"15min":5.7380000000000004},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.337,"5min":1.123,"15min":1.1799999999999999},"min":{"1min":0.505,"5min":0.31,"15min":0.31},"max":{"1min":1.9650000000000001,"5min":1.9830000000000001,"15min":20.128},"last":1.585}]},{"osd":2,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.169,"15min":1.1879999999999999},"min":{"1min":0.59799999999999998,"5min":0.51200000000000001,"15min":0.40100000000000002},"max":{"1min":2.0840000000000001,"5min":2.2989999999999999,"15min":3.2839999999999998},"last":1.385},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.2729999999999999,"15min":1.288},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.31900000000000001},"max":{"1min":2.0529999999999999,"5min":8.2260000000000009,"15min":8.2260000000000009},"last":1.254}]},{"osd":3,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.272,"15min":1.272},"min":{"1min":0.72099999999999997,"5min":0.47699999999999998,"15min":0.44600000000000001},"max":{"1min":1.873,"5min":2.3570000000000002,"15min":8.9879999999999995},"last":1.548},{"interface":"front","average":{"1min":1.506,"5min":1.367,"15min":1.4119999999999999},"min":{"1min":0.64700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9710000000000001,"5min":2.3610000000000002,"15min":5.6219999999999999},"last":1.1699999999999999}]},{"osd":4,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.22},"min":{"1min":0.67600000000000005,"5min":0.497,"15min":0.36699999999999999},"max":{"1min":2.173,"5min":3.3769999999999998,"15min":3.3769999999999998},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.155,"15min":1.1599999999999999},"min":{"1min":0.79600000000000004,"5min":0.53800000000000003,"15min":0.51800000000000002},"max":{"1min":1.738,"5min":2.2280000000000002,"15min":3.6219999999999999},"last":1.444}]},{"osd":5,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.246,"15min":1.2509999999999999},"min":{"1min":0.873,"5min":0.61899999999999999,"15min":0.49099999999999999},"max":{"1min":1.9550000000000001,"5min":2.323,"15min":3.9489999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.3340000000000001,"15min":1.3109999999999999},"min":{"1min":1.002,"5min":0.59299999999999997,"15min":0.56200000000000006},"max":{"1min":2.2040000000000002,"5min":2.2280000000000002,"15min":2.8140000000000001},"last":1.2969999999999999}]},{"osd":6,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.3959999999999999,"15min":1.381},"min":{"1min":0.92800000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.7669999999999999},"last":1.482},{"interface":"front","average":{"1min":1.504,"5min":1.415,"15min":1.3640000000000001},"min":{"1min":0.72299999999999998,"5min":0.55000000000000004,"15min":0.44900000000000001},"max":{"1min":2.2789999999999999,"5min":3.4710000000000001,"15min":3.7669999999999999},"last":1.6839999999999999}]},{"osd":7,"last update":"Wed Oct 18 11:39:17 2023","interfaces":[{"interface":"back","average":{"1min":1.599,"5min":1.4990000000000001,"15min":1.4490000000000001},"min":{"1min":0.76300000000000001,"5min":0.59499999999999997,"15min":0.49199999999999999},"max":{"1min":2.3769999999999998,"5min":3.4289999999999998,"15min":3.915},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.4099999999999999,"15min":1.381},"min":{"1min":0.96899999999999997,"5min":0.66500000000000004,"15min":0.59999999999999998},"max":{"1min":2.1739999999999999,"5min":2.2829999999999999,"15min":4.0119999999999996},"last":1.841}]}]},{"osd":6,"up_from":14,"seq":60129542512,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98600,"kb_used_data":13344,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273240,"statfs":{"total":96636764160,"available":96535797760,"internally_reserved":0,"allocated":13664256,"data_stored":16262951,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 11:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.60499999999999998},"min":{"1min":0.51800000000000002,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":0.90000000000000002,"5min":3.387,"15min":3.387},"last":0.996},{"interface":"front","average":{"1min":0.748,"5min":0.67800000000000005,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.33300000000000002,"15min":0.31},"max":{"1min":1.093,"5min":1.587,"15min":1.587},"last":0.63}]},{"osd":1,"last update":"Wed Oct 18 11:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.69799999999999995,"15min":0.63700000000000001},"min":{"1min":0.55200000000000005,"5min":0.32300000000000001,"15min":0.25},"max":{"1min":0.98799999999999999,"5min":1.478,"15min":1.478},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.67500000000000004,"15min":0.64700000000000002},"min":{"1min":0.52700000000000002,"5min":0.35899999999999999,"15min":0.312},"max":{"1min":1.0580000000000001,"5min":1.554,"15min":1.669},"last":0.78400000000000003}]},{"osd":2,"last update":"Wed Oct 18 11:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.34999999999999998},"max":{"1min":1.0249999999999999,"5min":1.1850000000000001,"15min":1.712},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.52200000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"max":{"1min":1.0189999999999999,"5min":1.1000000000000001,"15min":1.1839999999999999},"last":0.92200000000000004}]},{"osd":3,"last update":"Wed Oct 18 11:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.59399999999999997,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":1.0389999999999999,"5min":1.3200000000000001,"15min":2.694},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69199999999999995,"15min":0.70099999999999996},"min":{"1min":0.47599999999999998,"5min":0.41899999999999998,"15min":0.34999999999999998},"max":{"1min":1.0800000000000001,"5min":1.179,"15min":2.1459999999999999},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Oct 18 11:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35099999999999998,"15min":0.35999999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.23400000000000001},"max":{"1min":0.49199999999999999,"5min":0.55600000000000005,"15min":0.63700000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.36899999999999999,"15min":0.37},"min":{"1min":0.28100000000000003,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":0.52200000000000002,"5min":0.57599999999999996,"15min":0.68600000000000005},"last":0.36299999999999999}]},{"osd":5,"last update":"Wed Oct 18 11:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35799999999999998,"15min":0.36799999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.252},"max":{"1min":0.55800000000000005,"5min":0.64700000000000002,"15min":0.85199999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39700000000000002},"min":{"1min":0.30099999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56000000000000005,"5min":0.65800000000000003,"15min":0.67000000000000004},"last":0.41199999999999998}]},{"osd":7,"last update":"Wed Oct 18 11:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.309,"5min":0.29099999999999998,"15min":0.26700000000000002},"max":{"1min":0.57999999999999996,"5min":0.63600000000000001,"15min":0.77600000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.41799999999999998},"min":{"1min":0.32200000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.68300000000000005,"15min":0.80000000000000004},"last":0.434}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32535,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17371136,"data_stored":22007641,"data_compressed":1454768,"data_compressed_allocated":2252800,"data_compressed_original":6918144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23826432,"data_stored":30449840,"data_compressed":1955504,"data_compressed_allocated":3002368,"data_compressed_original":9654272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13447168,"data_stored":16912726,"data_compressed":1101027,"data_compressed_allocated":1744896,"data_compressed_original":5238784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27611136,"data_stored":33841682,"data_compressed":1969877,"data_compressed_allocated":3170304,"data_compressed_original":9428992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20754432,"data_stored":26522789,"data_compressed":1704252,"data_compressed_allocated":2600960,"data_compressed_original":8396800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":23079032,"data_compressed":1413921,"data_compressed_allocated":2174976,"data_compressed_original":7041024,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13332480,"data_stored":16128101,"data_compressed":852376,"data_compressed_allocated":1343488,"data_compressed_original":4169728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24412160,"data_stored":31072225,"data_compressed":1977671,"data_compressed_allocated":3067904,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T11:39:40.344 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-18T11:39:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.575+0000 7f799b2c2640 1 Processor -- start 2023-10-18T11:39:40.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.575+0000 7f799b2c2640 1 -- start start 2023-10-18T11:39:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.576+0000 7f799b2c2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7994156ce0 0x7f79940c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.576+0000 7f799b2c2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f79940c24d0 0x7f79940659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.576+0000 7f799b2c2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7994157ca0 con 0x7f7994150f50 2023-10-18T11:39:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.576+0000 7f799b2c2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79940cd630 con 0x7f7994156ce0 2023-10-18T11:39:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.576+0000 7f799b2c2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7994157170 con 0x7f79940c24d0 2023-10-18T11:39:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.577+0000 7f799985f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f79940c24d0 0x7f79940659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.578+0000 7f799905e640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f7994150f50 0x7f79940ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:49190/0 (socket says 172.21.15.151:49190) 2023-10-18T11:39:40.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.578+0000 7f799905e640 1 -- 172.21.15.151:0/1165786695 learned_addr learned my addr 172.21.15.151:0/1165786695 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:39:40.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.578+0000 7f799885d640 1 --2- 172.21.15.151:0/1165786695 >> v2:172.21.15.151:3300/0 conn(0x7f7994156ce0 0x7f79940c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.581+0000 7f799885d640 1 -- 172.21.15.151:0/1165786695 >> v2:172.21.15.169:3300/0 conn(0x7f79940c24d0 msgr2=0x7f79940659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:39:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.581+0000 7f799885d640 1 --2- 172.21.15.151:0/1165786695 >> v2:172.21.15.169:3300/0 conn(0x7f79940c24d0 0x7f79940659d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.581+0000 7f799885d640 1 -- 172.21.15.151:0/1165786695 >> v1:172.21.15.169:6789/0 conn(0x7f7994150f50 legacy=0x7f79940ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.581+0000 7f799885d640 1 -- 172.21.15.151:0/1165786695 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7994157400 con 0x7f7994156ce0 2023-10-18T11:39:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.583+0000 7f799885d640 1 --2- 172.21.15.151:0/1165786695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7994156ce0 0x7f79940c1f90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f79940c6c90 tx=0x7f798402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc92e0e0ebc2fae server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:40.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.588+0000 7f798bfff640 1 -- 172.21.15.151:0/1165786695 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984031830 con 0x7f7994156ce0 2023-10-18T11:39:40.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.588+0000 7f798bfff640 1 -- 172.21.15.151:0/1165786695 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7984031990 con 0x7f7994156ce0 2023-10-18T11:39:40.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.588+0000 7f798bfff640 1 -- 172.21.15.151:0/1165786695 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984031d20 con 0x7f7994156ce0 2023-10-18T11:39:40.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.589+0000 7f799b2c2640 1 -- 172.21.15.151:0/1165786695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7994156ce0 msgr2=0x7f79940c1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:40.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.589+0000 7f799b2c2640 1 --2- 172.21.15.151:0/1165786695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7994156ce0 0x7f79940c1f90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f79940c6c90 tx=0x7f798402b8d0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.589+0000 7f799b2c2640 1 -- 172.21.15.151:0/1165786695 shutdown_connections 2023-10-18T11:39:40.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.589+0000 7f799b2c2640 1 --2- 172.21.15.151:0/1165786695 >> v2:172.21.15.169:3300/0 conn(0x7f79940c24d0 0x7f79940659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.589+0000 7f799b2c2640 1 --2- 172.21.15.151:0/1165786695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7994156ce0 0x7f79940c1f90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.589+0000 7f799b2c2640 1 -- 172.21.15.151:0/1165786695 >> 172.21.15.151:0/1165786695 conn(0x7f799406e210 msgr2=0x7f799406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:40.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.589+0000 7f799b2c2640 1 -- 172.21.15.151:0/1165786695 shutdown_connections 2023-10-18T11:39:40.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.589+0000 7f799b2c2640 1 -- 172.21.15.151:0/1165786695 wait complete. 2023-10-18T11:39:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.591+0000 7f799b2c2640 1 Processor -- start 2023-10-18T11:39:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.591+0000 7f799b2c2640 1 -- start start 2023-10-18T11:39:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.592+0000 7f799b2c2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79940c24d0 0x7f7994145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.592+0000 7f799b2c2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7994150f50 0x7f799406c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.592+0000 7f799b2c2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7994156ce0 0x7f7994143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.592+0000 7f799b2c2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79940ad810 con 0x7f7994150f50 2023-10-18T11:39:40.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.592+0000 7f799b2c2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7994145a70 con 0x7f7994156ce0 2023-10-18T11:39:40.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.592+0000 7f799b2c2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7994145490 con 0x7f79940c24d0 2023-10-18T11:39:40.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.593+0000 7f799905e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79940c24d0 0x7f7994145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:40.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.593+0000 7f799885d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7994150f50 0x7f799406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:40.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.593+0000 7f799985f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7994156ce0 0x7f7994143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:40.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.593+0000 7f799985f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7994156ce0 0x7f7994143000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:47518/0 (socket says 172.21.15.151:47518) 2023-10-18T11:39:40.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.593+0000 7f799985f640 1 -- 172.21.15.151:0/3715371578 learned_addr learned my addr 172.21.15.151:0/3715371578 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.597+0000 7f799985f640 1 -- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79940c24d0 msgr2=0x7f7994145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.597+0000 7f799985f640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79940c24d0 0x7f7994145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.597+0000 7f799985f640 1 -- 172.21.15.151:0/3715371578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7994150f50 msgr2=0x7f799406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.597+0000 7f799985f640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7994150f50 0x7f799406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.597+0000 7f799985f640 1 -- 172.21.15.151:0/3715371578 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984009400 con 0x7f7994156ce0 2023-10-18T11:39:40.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.599+0000 7f799985f640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7994156ce0 0x7f7994143000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f798c009d30 tx=0x7f798c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:40.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.602+0000 7f7989ffb640 1 -- 172.21.15.151:0/3715371578 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c009ba0 con 0x7f7994156ce0 2023-10-18T11:39:40.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.603+0000 7f7989ffb640 1 -- 172.21.15.151:0/3715371578 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c00f040 con 0x7f7994156ce0 2023-10-18T11:39:40.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.603+0000 7f7989ffb640 1 -- 172.21.15.151:0/3715371578 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0146c0 con 0x7f7994156ce0 2023-10-18T11:39:40.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.603+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79940ae3e0 con 0x7f7994156ce0 2023-10-18T11:39:40.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.603+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7994145700 con 0x7f7994156ce0 2023-10-18T11:39:40.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.604+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7994145c20 con 0x7f7994156ce0 2023-10-18T11:39:40.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.623+0000 7f7989ffb640 1 -- 172.21.15.151:0/3715371578 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f798c014820 con 0x7f7994156ce0 2023-10-18T11:39:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.624+0000 7f7989ffb640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f797806aec0 0x7f797806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.624+0000 7f799905e640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f797806aec0 0x7f797806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.625+0000 7f799905e640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f797806aec0 0x7f797806d380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7990007fd0 tx=0x7f7990007e80 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.626+0000 7f7989ffb640 1 -- 172.21.15.151:0/3715371578 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f798c059420 con 0x7f7994156ce0 2023-10-18T11:39:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:40.867+0000 7f7989ffb640 1 -- 172.21.15.151:0/3715371578 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f798c055760 con 0x7f7994156ce0 2023-10-18T11:39:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.065+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f7994145c20 con 0x7f7994156ce0 2023-10-18T11:39:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.276+0000 7f7989ffb640 1 -- 172.21.15.151:0/3715371578 <== mon.1 v2:172.21.15.169:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f798c05d4c0 con 0x7f7994156ce0 2023-10-18T11:39:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.276+0000 7f7989ffb640 1 -- 172.21.15.151:0/3715371578 <== mon.1 v2:172.21.15.169:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7994145c20 con 0x7f7994156ce0 2023-10-18T11:39:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f797806aec0 msgr2=0x7f797806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f797806aec0 0x7f797806d380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7990007fd0 tx=0x7f7990007e80 comp rx=0 tx=0).stop 2023-10-18T11:39:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7994156ce0 msgr2=0x7f7994143000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7994156ce0 0x7f7994143000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f798c009d30 tx=0x7f798c00c490 comp rx=0 tx=0).stop 2023-10-18T11:39:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 shutdown_connections 2023-10-18T11:39:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f797806aec0 0x7f797806d380 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7994156ce0 0x7f7994143000 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7994150f50 0x7f799406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 --2- 172.21.15.151:0/3715371578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79940c24d0 0x7f7994145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.282+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 >> 172.21.15.151:0/3715371578 conn(0x7f799406e210 msgr2=0x7f79940659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.283+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 shutdown_connections 2023-10-18T11:39:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.283+0000 7f799b2c2640 1 -- 172.21.15.151:0/3715371578 wait complete. 2023-10-18T11:39:41.317 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-18T11:39:41.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:39:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.512+0000 7f60a25f4640 1 Processor -- start 2023-10-18T11:39:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.512+0000 7f60a25f4640 1 -- start start 2023-10-18T11:39:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.513+0000 7f60a25f4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f609c06a240 0x7f609c0c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.514+0000 7f60a25f4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c0c7470 con 0x7f609c06faf0 2023-10-18T11:39:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.514+0000 7f60a25f4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c0c5670 con 0x7f609c06a620 2023-10-18T11:39:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.514+0000 7f60a25f4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0705f0 con 0x7f609c06a240 2023-10-18T11:39:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.514+0000 7f60a1df3640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f609c06a620 0x7f609c161740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:49200/0 (socket says 172.21.15.151:49200) 2023-10-18T11:39:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.514+0000 7f60a1df3640 1 -- 172.21.15.151:0/1974414454 learned_addr learned my addr 172.21.15.151:0/1974414454 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:39:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.514+0000 7f60a15f2640 1 --2- 172.21.15.151:0/1974414454 >> v2:172.21.15.151:3300/0 conn(0x7f609c06a240 0x7f609c0c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:41.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.517+0000 7f6093fff640 1 -- 172.21.15.151:0/1974414454 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739669330 0 0) 0x7f609c0c5670 con 0x7f609c06a620 2023-10-18T11:39:41.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.517+0000 7f6093fff640 1 -- 172.21.15.151:0/1974414454 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6088003520 con 0x7f609c06a620 2023-10-18T11:39:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.519+0000 7f60a15f2640 1 -- 172.21.15.151:0/1974414454 >> v1:172.21.15.169:6789/0 conn(0x7f609c06a620 legacy=0x7f609c161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.519+0000 7f60a15f2640 1 -- 172.21.15.151:0/1974414454 >> v1:172.21.15.151:6789/0 conn(0x7f609c06faf0 legacy=0x7f609c150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.519+0000 7f60a15f2640 1 -- 172.21.15.151:0/1974414454 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0c4dd0 con 0x7f609c06a240 2023-10-18T11:39:41.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.523+0000 7f60a15f2640 1 --2- 172.21.15.151:0/1974414454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 0x7f609c0c7900 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f60980097d0 tx=0x7f609802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231ad3a4e00f025b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:41.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.528+0000 7f6093fff640 1 -- 172.21.15.151:0/1974414454 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098030610 con 0x7f609c06a240 2023-10-18T11:39:41.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.529+0000 7f6093fff640 1 -- 172.21.15.151:0/1974414454 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6098030770 con 0x7f609c06a240 2023-10-18T11:39:41.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.529+0000 7f6093fff640 1 -- 172.21.15.151:0/1974414454 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098030b20 con 0x7f609c06a240 2023-10-18T11:39:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.529+0000 7f60a25f4640 1 -- 172.21.15.151:0/1974414454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 msgr2=0x7f609c0c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.529+0000 7f60a25f4640 1 --2- 172.21.15.151:0/1974414454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 0x7f609c0c7900 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f60980097d0 tx=0x7f609802b960 comp rx=0 tx=0).stop 2023-10-18T11:39:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.530+0000 7f60a25f4640 1 -- 172.21.15.151:0/1974414454 shutdown_connections 2023-10-18T11:39:41.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.530+0000 7f60a25f4640 1 --2- 172.21.15.151:0/1974414454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 0x7f609c0c7900 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:41.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.530+0000 7f60a25f4640 1 -- 172.21.15.151:0/1974414454 >> 172.21.15.151:0/1974414454 conn(0x7f609c0659d0 msgr2=0x7f609c065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:41.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.530+0000 7f60a25f4640 1 -- 172.21.15.151:0/1974414454 shutdown_connections 2023-10-18T11:39:41.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.530+0000 7f60a25f4640 1 -- 172.21.15.151:0/1974414454 wait complete. 2023-10-18T11:39:41.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.532+0000 7f60a25f4640 1 Processor -- start 2023-10-18T11:39:41.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.533+0000 7f60a25f4640 1 -- start start 2023-10-18T11:39:41.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.534+0000 7f60a25f4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 0x7f609c14b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:41.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.534+0000 7f60a25f4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609c06a620 0x7f609c1471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:41.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.534+0000 7f60a25f4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f609c06faf0 0x7f609c1476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.534+0000 7f60a25f4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0c25d0 con 0x7f609c06a240 2023-10-18T11:39:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.534+0000 7f60a25f4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c149bc0 con 0x7f609c06faf0 2023-10-18T11:39:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.534+0000 7f60a25f4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0ca160 con 0x7f609c06a620 2023-10-18T11:39:41.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.534+0000 7f60a15f2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 0x7f609c14b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:41.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.534+0000 7f60a1df3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f609c06faf0 0x7f609c1476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:41.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.535+0000 7f60a0df1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609c06a620 0x7f609c1471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:41.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.535+0000 7f60a15f2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 0x7f609c14b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36656/0 (socket says 172.21.15.151:36656) 2023-10-18T11:39:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.535+0000 7f60a15f2640 1 -- 172.21.15.151:0/2469584659 learned_addr learned my addr 172.21.15.151:0/2469584659 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.538+0000 7f60a1df3640 1 -- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609c06a620 msgr2=0x7f609c1471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.538+0000 7f60a1df3640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609c06a620 0x7f609c1471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.538+0000 7f60a1df3640 1 -- 172.21.15.151:0/2469584659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 msgr2=0x7f609c14b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.538+0000 7f60a1df3640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 0x7f609c14b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.538+0000 7f60a1df3640 1 -- 172.21.15.151:0/2469584659 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098009400 con 0x7f609c06faf0 2023-10-18T11:39:41.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.541+0000 7f60a1df3640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f609c06faf0 0x7f609c1476f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f609400cab0 tx=0x7f609400cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:41.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.543+0000 7f6091ffb640 1 -- 172.21.15.151:0/2469584659 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400ac30 con 0x7f609c06faf0 2023-10-18T11:39:41.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.543+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c0c1b40 con 0x7f609c06faf0 2023-10-18T11:39:41.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.543+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c1eef80 con 0x7f609c06faf0 2023-10-18T11:39:41.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.544+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c0c2710 con 0x7f609c06faf0 2023-10-18T11:39:41.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.545+0000 7f6091ffb640 1 -- 172.21.15.151:0/2469584659 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f609400ad90 con 0x7f609c06faf0 2023-10-18T11:39:41.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.545+0000 7f6091ffb640 1 -- 172.21.15.151:0/2469584659 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609401c640 con 0x7f609c06faf0 2023-10-18T11:39:41.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.794+0000 7f6091ffb640 1 -- 172.21.15.151:0/2469584659 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f609401c7a0 con 0x7f609c06faf0 2023-10-18T11:39:41.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.796+0000 7f6091ffb640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f608006ae70 0x7f608006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:41.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.797+0000 7f6091ffb640 1 -- 172.21.15.151:0/2469584659 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6094058d10 con 0x7f609c06faf0 2023-10-18T11:39:41.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.797+0000 7f60a15f2640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f608006ae70 0x7f608006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.798+0000 7f60a15f2640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f608006ae70 0x7f608006d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f609802b9a0 tx=0x7f6098008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:41.807+0000 7f6091ffb640 1 -- 172.21.15.151:0/2469584659 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6094055050 con 0x7f609c06faf0 2023-10-18T11:39:42.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.048+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f609c0c2710 con 0x7f609c06faf0 2023-10-18T11:39:42.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.062+0000 7f6091ffb640 1 -- 172.21.15.151:0/2469584659 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+6570 (secure 0 0 0) 0x7f609c0c2710 con 0x7f609c06faf0 2023-10-18T11:39:42.064 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:39:42.065 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":125,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2025487091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2025487091},{"type":"v1","addr":"172.21.15.169:6835","nonce":2025487091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T11:09:38.819021+0000","modified":"2023-10-18T11:39:31.872456+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4288,"mds_2":4244,"mds_3":4241,"mds_4":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"f","rank":4,"incarnation":17,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6837/872383111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":872383111},{"type":"v1","addr":"172.21.15.169:6837","nonce":872383111}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6839/520473080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":520473080},{"type":"v1","addr":"172.21.15.169:6839","nonce":520473080}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6835/2666139932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2666139932},{"type":"v1","addr":"172.21.15.151:6835","nonce":2666139932}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":15,"addr":"172.21.15.151:6833/251484638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":251484638},{"type":"v1","addr":"172.21.15.151:6833","nonce":251484638}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4294":{"gid":4294,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6837/909327926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":909327926},{"type":"v1","addr":"172.21.15.151:6837","nonce":909327926}]},"join_fscid":-1,"export_targets":[2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T11:39:42.065 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 125 2023-10-18T11:39:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.064+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f608006ae70 msgr2=0x7f608006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:42.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.064+0000 7f60a25f4640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f608006ae70 0x7f608006d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f609802b9a0 tx=0x7f6098008030 comp rx=0 tx=0).stop 2023-10-18T11:39:42.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.064+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f609c06faf0 msgr2=0x7f609c1476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:42.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.064+0000 7f60a25f4640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f609c06faf0 0x7f609c1476f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f609400cab0 tx=0x7f609400cf70 comp rx=0 tx=0).stop 2023-10-18T11:39:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.064+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 shutdown_connections 2023-10-18T11:39:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.064+0000 7f60a25f4640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f608006ae70 0x7f608006d330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.064+0000 7f60a25f4640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f609c06faf0 0x7f609c1476f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.064+0000 7f60a25f4640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f609c06a620 0x7f609c1471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.065+0000 7f60a25f4640 1 --2- 172.21.15.151:0/2469584659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c06a240 0x7f609c14b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.065+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 >> 172.21.15.151:0/2469584659 conn(0x7f609c0659d0 msgr2=0x7f609c155630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:42.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.065+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 shutdown_connections 2023-10-18T11:39:42.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.065+0000 7f60a25f4640 1 -- 172.21.15.151:0/2469584659 wait complete. 2023-10-18T11:39:42.083 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:39:42.092 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:39:42.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T11:39:42.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.332+0000 7fbe5c039640 1 Processor -- start 2023-10-18T11:39:42.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.332+0000 7fbe5c039640 1 -- start start 2023-10-18T11:39:42.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.334+0000 7fbe5c039640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbe540c7880 0x7fbe540c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:42.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.334+0000 7fbe5c039640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54153500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:42.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.334+0000 7fbe5c039640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe54159fe0 con 0x7fbe540c7c60 2023-10-18T11:39:42.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.334+0000 7fbe5c039640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe54153a40 con 0x7fbe540c7880 2023-10-18T11:39:42.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.334+0000 7fbe5c039640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540c60f0 con 0x7fbe541530c0 2023-10-18T11:39:42.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.335+0000 7fbe5a5d6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:42.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.335+0000 7fbe59dd5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbe540c7880 0x7fbe540c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:42.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.335+0000 7fbe5a5d6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:46038/0 (socket says 172.21.15.151:46038) 2023-10-18T11:39:42.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.336+0000 7fbe5a5d6640 1 -- 172.21.15.151:0/3601521915 learned_addr learned my addr 172.21.15.151:0/3601521915 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:42.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.338+0000 7fbe5a5d6640 1 -- 172.21.15.151:0/3601521915 >> v2:172.21.15.169:3300/0 conn(0x7fbe540c7880 msgr2=0x7fbe540c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:39:42.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.338+0000 7fbe5a5d6640 1 --2- 172.21.15.151:0/3601521915 >> v2:172.21.15.169:3300/0 conn(0x7fbe540c7880 0x7fbe540c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.338+0000 7fbe5a5d6640 1 -- 172.21.15.151:0/3601521915 >> v1:172.21.15.169:6789/0 conn(0x7fbe540c7c60 legacy=0x7fbe5415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:42.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.338+0000 7fbe5a5d6640 1 -- 172.21.15.151:0/3601521915 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe541593d0 con 0x7fbe541530c0 2023-10-18T11:39:42.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.340+0000 7fbe5a5d6640 1 --2- 172.21.15.151:0/3601521915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54153500 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009e50 tx=0x7fbe4c02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ba0a75d924d6e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:42.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.344+0000 7fbe58dd3640 1 -- 172.21.15.151:0/3601521915 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c02cb90 con 0x7fbe541530c0 2023-10-18T11:39:42.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.344+0000 7fbe58dd3640 1 -- 172.21.15.151:0/3601521915 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbe4c02ccf0 con 0x7fbe541530c0 2023-10-18T11:39:42.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.344+0000 7fbe58dd3640 1 -- 172.21.15.151:0/3601521915 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c034630 con 0x7fbe541530c0 2023-10-18T11:39:42.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.345+0000 7fbe5c039640 1 -- 172.21.15.151:0/3601521915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 msgr2=0x7fbe54153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:42.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.345+0000 7fbe5c039640 1 --2- 172.21.15.151:0/3601521915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54153500 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009e50 tx=0x7fbe4c02bff0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.345+0000 7fbe5c039640 1 -- 172.21.15.151:0/3601521915 shutdown_connections 2023-10-18T11:39:42.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.345+0000 7fbe5c039640 1 --2- 172.21.15.151:0/3601521915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54153500 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.345+0000 7fbe5c039640 1 --2- 172.21.15.151:0/3601521915 >> v2:172.21.15.169:3300/0 conn(0x7fbe540c7880 0x7fbe540c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.345+0000 7fbe5c039640 1 -- 172.21.15.151:0/3601521915 >> 172.21.15.151:0/3601521915 conn(0x7fbe54069f70 msgr2=0x7fbe5406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:42.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.345+0000 7fbe5c039640 1 -- 172.21.15.151:0/3601521915 shutdown_connections 2023-10-18T11:39:42.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.345+0000 7fbe5c039640 1 -- 172.21.15.151:0/3601521915 wait complete. 2023-10-18T11:39:42.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.347+0000 7fbe5c039640 1 Processor -- start 2023-10-18T11:39:42.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.347+0000 7fbe5c039640 1 -- start start 2023-10-18T11:39:42.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.349+0000 7fbe5c039640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe540c7880 0x7fbe540bc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:42.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.349+0000 7fbe5c039640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe540c7c60 0x7fbe540bc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.349+0000 7fbe5c039640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54070990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.349+0000 7fbe5c039640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54158770 con 0x7fbe540c7c60 2023-10-18T11:39:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.349+0000 7fbe5c039640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54070500 con 0x7fbe540c7880 2023-10-18T11:39:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.349+0000 7fbe5c039640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54146740 con 0x7fbe541530c0 2023-10-18T11:39:42.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.351+0000 7fbe59dd5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe540c7880 0x7fbe540bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:42.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.351+0000 7fbe59dd5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe540c7880 0x7fbe540bc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:47538/0 (socket says 172.21.15.151:47538) 2023-10-18T11:39:42.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.351+0000 7fbe59dd5640 1 -- 172.21.15.151:0/4195381572 learned_addr learned my addr 172.21.15.151:0/4195381572 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:42.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.353+0000 7fbe5a5d6640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:42.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.399+0000 7fbe59dd5640 1 -- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 msgr2=0x7fbe54070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:42.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.399+0000 7fbe59dd5640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.399+0000 7fbe59dd5640 1 -- 172.21.15.151:0/4195381572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe540c7c60 msgr2=0x7fbe540bc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:42.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.399+0000 7fbe59dd5640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe540c7c60 0x7fbe540bc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.399+0000 7fbe59dd5640 1 -- 172.21.15.151:0/4195381572 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c009b30 con 0x7fbe540c7880 2023-10-18T11:39:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.402+0000 7fbe59dd5640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe540c7880 0x7fbe540bc470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000e9e0 tx=0x7fbe5000eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:42.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.407+0000 7fbe4a7fc640 1 -- 172.21.15.151:0/4195381572 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50009670 con 0x7fbe540c7880 2023-10-18T11:39:42.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.408+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe54157240 con 0x7fbe540c7880 2023-10-18T11:39:42.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.408+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe54158490 con 0x7fbe540c7880 2023-10-18T11:39:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.409+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe540702d0 con 0x7fbe540c7880 2023-10-18T11:39:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.409+0000 7fbe4a7fc640 1 -- 172.21.15.151:0/4195381572 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbe50005990 con 0x7fbe540c7880 2023-10-18T11:39:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.410+0000 7fbe4a7fc640 1 -- 172.21.15.151:0/4195381572 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50005d00 con 0x7fbe540c7880 2023-10-18T11:39:42.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.671+0000 7fbe4a7fc640 1 -- 172.21.15.151:0/4195381572 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe5000c970 con 0x7fbe540c7880 2023-10-18T11:39:42.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.675+0000 7fbe4a7fc640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe3806ae70 0x7fbe3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:42.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.676+0000 7fbe4a7fc640 1 -- 172.21.15.151:0/4195381572 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe50089e40 con 0x7fbe540c7880 2023-10-18T11:39:42.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.676+0000 7fbe595d4640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe3806ae70 0x7fbe3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:42.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.677+0000 7fbe595d4640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe3806ae70 0x7fbe3806d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe44000f60 tx=0x7fbe440079b0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:42.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.682+0000 7fbe4a7fc640 1 -- 172.21.15.151:0/4195381572 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe50054be0 con 0x7fbe540c7880 2023-10-18T11:39:42.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.926+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe540702d0 con 0x7fbe540c7880 2023-10-18T11:39:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.939+0000 7fbe4a7fc640 1 -- 172.21.15.151:0/4195381572 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) v1 ==== 95+0+6568 (secure 0 0 0) 0x7fbe540702d0 con 0x7fbe540c7880 2023-10-18T11:39:42.942 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:39:42.942 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":126,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2025487091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2025487091},{"type":"v1","addr":"172.21.15.169:6835","nonce":2025487091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T11:09:38.819021+0000","modified":"2023-10-18T11:39:41.405398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4294,"mds_1":4288,"mds_2":4244,"mds_3":4241,"mds_4":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"f","rank":4,"incarnation":17,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6837/872383111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":872383111},{"type":"v1","addr":"172.21.15.169:6837","nonce":872383111}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":17,"addr":"172.21.15.169:6839/520473080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":520473080},{"type":"v1","addr":"172.21.15.169:6839","nonce":520473080}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4244":{"gid":4244,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6835/2666139932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2666139932},{"type":"v1","addr":"172.21.15.151:6835","nonce":2666139932}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4288":{"gid":4288,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":15,"addr":"172.21.15.151:6833/251484638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":251484638},{"type":"v1","addr":"172.21.15.151:6833","nonce":251484638}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4294":{"gid":4294,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6837/909327926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":909327926},{"type":"v1","addr":"172.21.15.151:6837","nonce":909327926}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T11:39:42.943 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 126 2023-10-18T11:39:42.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe3806ae70 msgr2=0x7fbe3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:42.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe3806ae70 0x7fbe3806d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe44000f60 tx=0x7fbe440079b0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe540c7880 msgr2=0x7fbe540bc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe540c7880 0x7fbe540bc470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000e9e0 tx=0x7fbe5000eea0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 shutdown_connections 2023-10-18T11:39:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe541530c0 0x7fbe54070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe540c7c60 0x7fbe540bc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fbe3806ae70 0x7fbe3806d330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 --2- 172.21.15.151:0/4195381572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe540c7880 0x7fbe540bc470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.942+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 >> 172.21.15.151:0/4195381572 conn(0x7fbe54069f70 msgr2=0x7fbe54141bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.943+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 shutdown_connections 2023-10-18T11:39:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:42.943+0000 7fbe5c039640 1 -- 172.21.15.151:0/4195381572 wait complete. 2023-10-18T11:39:42.965 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T11:39:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.166+0000 7f47ee973640 1 Processor -- start 2023-10-18T11:39:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.167+0000 7f47ee973640 1 -- start start 2023-10-18T11:39:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.168+0000 7f47ee973640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f47e806d760 0x7f47e8159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.168+0000 7f47ee973640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f47e8072060 0x7f47e806db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.169+0000 7f47ee973640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e815d3e0 con 0x7f47e80c5440 2023-10-18T11:39:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.169+0000 7f47ee973640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e806e080 con 0x7f47e806d760 2023-10-18T11:39:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.169+0000 7f47ee973640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e80c4fd0 con 0x7f47e8072060 2023-10-18T11:39:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.169+0000 7f47e77fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f47e8072060 0x7f47e806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.170+0000 7f47e77fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f47e8072060 0x7f47e806db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:47548/0 (socket says 172.21.15.151:47548) 2023-10-18T11:39:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.170+0000 7f47e77fe640 1 -- 172.21.15.151:0/2043447929 learned_addr learned my addr 172.21.15.151:0/2043447929 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.170+0000 7f47e7fff640 1 --2- 172.21.15.151:0/2043447929 >> v2:172.21.15.151:3300/0 conn(0x7f47e806d760 0x7f47e8159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:43.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.172+0000 7f47e77fe640 1 -- 172.21.15.151:0/2043447929 >> v2:172.21.15.151:3300/0 conn(0x7f47e806d760 msgr2=0x7f47e8159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:39:43.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.172+0000 7f47e77fe640 1 --2- 172.21.15.151:0/2043447929 >> v2:172.21.15.151:3300/0 conn(0x7f47e806d760 0x7f47e8159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.172+0000 7f47e77fe640 1 -- 172.21.15.151:0/2043447929 >> v1:172.21.15.151:6789/0 conn(0x7f47e80c5440 legacy=0x7f47e806ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:43.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.172+0000 7f47e77fe640 1 -- 172.21.15.151:0/2043447929 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e815c4f0 con 0x7f47e8072060 2023-10-18T11:39:43.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.174+0000 7f47e77fe640 1 --2- 172.21.15.151:0/2043447929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e8072060 0x7f47e806db40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47e80c6e20 tx=0x7f47dc02ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbd67867ab9f25fe server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.177+0000 7f47e6ffd640 1 -- 172.21.15.151:0/2043447929 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc02f850 con 0x7f47e8072060 2023-10-18T11:39:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.177+0000 7f47e6ffd640 1 -- 172.21.15.151:0/2043447929 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f47dc02f9b0 con 0x7f47e8072060 2023-10-18T11:39:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.177+0000 7f47e6ffd640 1 -- 172.21.15.151:0/2043447929 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc02fd60 con 0x7f47e8072060 2023-10-18T11:39:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.178+0000 7f47ee973640 1 -- 172.21.15.151:0/2043447929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e8072060 msgr2=0x7f47e806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.178+0000 7f47ee973640 1 --2- 172.21.15.151:0/2043447929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e8072060 0x7f47e806db40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47e80c6e20 tx=0x7f47dc02ba30 comp rx=0 tx=0).stop 2023-10-18T11:39:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.178+0000 7f47ee973640 1 -- 172.21.15.151:0/2043447929 shutdown_connections 2023-10-18T11:39:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.178+0000 7f47ee973640 1 --2- 172.21.15.151:0/2043447929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e8072060 0x7f47e806db40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.178+0000 7f47ee973640 1 --2- 172.21.15.151:0/2043447929 >> v2:172.21.15.151:3300/0 conn(0x7f47e806d760 0x7f47e8159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.178+0000 7f47ee973640 1 -- 172.21.15.151:0/2043447929 >> 172.21.15.151:0/2043447929 conn(0x7f47e80c6f10 msgr2=0x7f47e80c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.178+0000 7f47ee973640 1 -- 172.21.15.151:0/2043447929 shutdown_connections 2023-10-18T11:39:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.178+0000 7f47ee973640 1 -- 172.21.15.151:0/2043447929 wait complete. 2023-10-18T11:39:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.180+0000 7f47ee973640 1 Processor -- start 2023-10-18T11:39:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.180+0000 7f47ee973640 1 -- start start 2023-10-18T11:39:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.181+0000 7f47ee973640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e806d760 0x7f47e815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.181+0000 7f47ee973640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e8072060 0x7f47e81460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.181+0000 7f47ee973640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e80c5440 0x7f47e80ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.181+0000 7f47ee973640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81492e0 con 0x7f47e80c5440 2023-10-18T11:39:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.181+0000 7f47ee973640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e815b740 con 0x7f47e806d760 2023-10-18T11:39:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.181+0000 7f47ee973640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81e29b0 con 0x7f47e8072060 2023-10-18T11:39:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.182+0000 7f47e7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e806d760 0x7f47e815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:43.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.182+0000 7f47ecf10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e80c5440 0x7f47e80ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:43.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.182+0000 7f47e77fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e8072060 0x7f47e81460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:43.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.182+0000 7f47ecf10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e80c5440 0x7f47e80ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36674/0 (socket says 172.21.15.151:36674) 2023-10-18T11:39:43.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.182+0000 7f47ecf10640 1 -- 172.21.15.151:0/1103811787 learned_addr learned my addr 172.21.15.151:0/1103811787 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.185+0000 7f47e7fff640 1 -- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e8072060 msgr2=0x7f47e81460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.185+0000 7f47e7fff640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e8072060 0x7f47e81460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.185+0000 7f47e7fff640 1 -- 172.21.15.151:0/1103811787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e80c5440 msgr2=0x7f47e80ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.185+0000 7f47e7fff640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e80c5440 0x7f47e80ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.185+0000 7f47e7fff640 1 -- 172.21.15.151:0/1103811787 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc0094d0 con 0x7f47e806d760 2023-10-18T11:39:43.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.188+0000 7f47e7fff640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e806d760 0x7f47e815b200 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f47d800d5f0 tx=0x7f47d800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.191+0000 7f47e4ff9640 1 -- 172.21.15.151:0/1103811787 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80125f0 con 0x7f47e806d760 2023-10-18T11:39:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.191+0000 7f47e4ff9640 1 -- 172.21.15.151:0/1103811787 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f47d8012750 con 0x7f47e806d760 2023-10-18T11:39:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.191+0000 7f47e4ff9640 1 -- 172.21.15.151:0/1103811787 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8012b20 con 0x7f47e806d760 2023-10-18T11:39:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.191+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e81575f0 con 0x7f47e806d760 2023-10-18T11:39:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.191+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e8157b50 con 0x7f47e806d760 2023-10-18T11:39:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.193+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e80c2dc0 con 0x7f47e806d760 2023-10-18T11:39:43.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.211+0000 7f47e4ff9640 1 -- 172.21.15.151:0/1103811787 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f47d8012c80 con 0x7f47e806d760 2023-10-18T11:39:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.214+0000 7f47e4ff9640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47d406aec0 0x7f47d406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.214+0000 7f47e4ff9640 1 -- 172.21.15.151:0/1103811787 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f47d8059320 con 0x7f47e806d760 2023-10-18T11:39:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.214+0000 7f47e77fe640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47d406aec0 0x7f47d406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.215+0000 7f47e77fe640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47d406aec0 0x7f47d406d380 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f47dc036000 tx=0x7f47dc008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.462+0000 7f47e4ff9640 1 -- 172.21.15.151:0/1103811787 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47d80555d0 con 0x7f47e806d760 2023-10-18T11:39:43.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.665+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47e815cd60 con 0x7f47e806d760 2023-10-18T11:39:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.863+0000 7f47e4ff9640 1 -- 172.21.15.151:0/1103811787 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f47d8057500 con 0x7f47e806d760 2023-10-18T11:39:43.867 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-18T11:39:43.867 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"fsid":"31f501b1-61b9-452b-813c-bb68ad49056d","created":"2023-10-18T11:08:57.588453+0000","modified":"2023-10-18T11:10:10.077988+0000","last_up_change":"2023-10-18T11:09:14.798955+0000","last_in_change":"2023-10-18T11:09:05.157594+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T11:09:16.833723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T11:09:34.803213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T11:09:37.000724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T11:09:43.858153+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bae2190-379d-42cd-9dc8-4a0b615d9c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6825","nonce":4132618362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6827","nonce":4132618362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6831","nonce":4132618362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":4132618362},{"type":"v1","addr":"172.21.15.151:6829","nonce":4132618362}]},"public_addr":"172.21.15.151:6825/4132618362","cluster_addr":"172.21.15.151:6827/4132618362","heartbeat_back_addr":"172.21.15.151:6831/4132618362","heartbeat_front_addr":"172.21.15.151:6829/4132618362","state":["exists","up"]},{"osd":1,"uuid":"93a85388-7db1-4ac8-b1a8-ce3ee49aff61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6801","nonce":3389651909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6803","nonce":3389651909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6807","nonce":3389651909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3389651909},{"type":"v1","addr":"172.21.15.151:6805","nonce":3389651909}]},"public_addr":"172.21.15.151:6801/3389651909","cluster_addr":"172.21.15.151:6803/3389651909","heartbeat_back_addr":"172.21.15.151:6807/3389651909","heartbeat_front_addr":"172.21.15.151:6805/3389651909","state":["exists","up"]},{"osd":2,"uuid":"f921a096-a8f1-4d85-9974-c6f873ec1948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6809","nonce":2359515345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6811","nonce":2359515345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6815","nonce":2359515345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2359515345},{"type":"v1","addr":"172.21.15.151:6813","nonce":2359515345}]},"public_addr":"172.21.15.151:6809/2359515345","cluster_addr":"172.21.15.151:6811/2359515345","heartbeat_back_addr":"172.21.15.151:6815/2359515345","heartbeat_front_addr":"172.21.15.151:6813/2359515345","state":["exists","up"]},{"osd":3,"uuid":"3137ce35-4107-49be-ae80-3f8a3e82d70c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6817","nonce":2813876037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6819","nonce":2813876037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6823","nonce":2813876037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2813876037},{"type":"v1","addr":"172.21.15.151:6821","nonce":2813876037}]},"public_addr":"172.21.15.151:6817/2813876037","cluster_addr":"172.21.15.151:6819/2813876037","heartbeat_back_addr":"172.21.15.151:6823/2813876037","heartbeat_front_addr":"172.21.15.151:6821/2813876037","state":["exists","up"]},{"osd":4,"uuid":"730e6e60-5cde-4954-8d8c-aae9c0ac7fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6801","nonce":2104783334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6803","nonce":2104783334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6807","nonce":2104783334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2104783334},{"type":"v1","addr":"172.21.15.169:6805","nonce":2104783334}]},"public_addr":"172.21.15.169:6801/2104783334","cluster_addr":"172.21.15.169:6803/2104783334","heartbeat_back_addr":"172.21.15.169:6807/2104783334","heartbeat_front_addr":"172.21.15.169:6805/2104783334","state":["exists","up"]},{"osd":5,"uuid":"bb556210-8cf7-4209-afba-79cf6d8001e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6810","nonce":2415009442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6815","nonce":2415009442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6823","nonce":2415009442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":2415009442},{"type":"v1","addr":"172.21.15.169:6819","nonce":2415009442}]},"public_addr":"172.21.15.169:6810/2415009442","cluster_addr":"172.21.15.169:6815/2415009442","heartbeat_back_addr":"172.21.15.169:6823/2415009442","heartbeat_front_addr":"172.21.15.169:6819/2415009442","state":["exists","up"]},{"osd":6,"uuid":"b9baf093-0094-46c4-950d-6f5e871db091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6811","nonce":1118238952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6814","nonce":1118238952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6821","nonce":1118238952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1118238952},{"type":"v1","addr":"172.21.15.169:6818","nonce":1118238952}]},"public_addr":"172.21.15.169:6811/1118238952","cluster_addr":"172.21.15.169:6814/1118238952","heartbeat_back_addr":"172.21.15.169:6821/1118238952","heartbeat_front_addr":"172.21.15.169:6818/1118238952","state":["exists","up"]},{"osd":7,"uuid":"41020b58-5044-4f0d-9d6c-515548f2d300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6825","nonce":3969633295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6827","nonce":3969633295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6831","nonce":3969633295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3969633295},{"type":"v1","addr":"172.21.15.169:6829","nonce":3969633295}]},"public_addr":"172.21.15.169:6825/3969633295","cluster_addr":"172.21.15.169:6827/3969633295","heartbeat_back_addr":"172.21.15.169:6831/3969633295","heartbeat_front_addr":"172.21.15.169:6829/3969633295","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.943677+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.628187+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.667080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.852673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.486336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.589286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.561319+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T11:09:10.604786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T11:39:43.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47d406aec0 msgr2=0x7f47d406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:43.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47d406aec0 0x7f47d406d380 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f47dc036000 tx=0x7f47dc008030 comp rx=0 tx=0).stop 2023-10-18T11:39:43.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e806d760 msgr2=0x7f47e815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:43.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e806d760 0x7f47e815b200 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f47d800d5f0 tx=0x7f47d800dab0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 shutdown_connections 2023-10-18T11:39:43.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e80c5440 0x7f47e80ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47e8072060 0x7f47e81460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f47d406aec0 0x7f47d406d380 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 --2- 172.21.15.151:0/1103811787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47e806d760 0x7f47e815b200 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:43.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 >> 172.21.15.151:0/1103811787 conn(0x7f47e80c6f10 msgr2=0x7f47e8148180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:43.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 shutdown_connections 2023-10-18T11:39:43.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:43.868+0000 7f47ee973640 1 -- 172.21.15.151:0/1103811787 wait complete. 2023-10-18T11:39:43.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-18T11:39:44.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.233+0000 7fdeb43b6640 1 Processor -- start 2023-10-18T11:39:44.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.233+0000 7fdeb43b6640 1 -- start start 2023-10-18T11:39:44.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.235+0000 7fdeb43b6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdeac1510a0 0x7fdeac0c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:44.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.235+0000 7fdeb43b6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac157770 0x7fdeac06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:44.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.235+0000 7fdeb43b6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac06d430 con 0x7fdeac06de00 2023-10-18T11:39:44.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.235+0000 7fdeb43b6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac151480 con 0x7fdeac1510a0 2023-10-18T11:39:44.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.235+0000 7fdeb43b6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c27d0 con 0x7fdeac157770 2023-10-18T11:39:44.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.235+0000 7fdeb2152640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdeac1510a0 0x7fdeac0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:44.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.235+0000 7fdeb1951640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac157770 0x7fdeac06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:44.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.236+0000 7fdeb1951640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac157770 0x7fdeac06d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.151:46058/0 (socket says 172.21.15.151:46058) 2023-10-18T11:39:44.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.236+0000 7fdeb1951640 1 -- 172.21.15.151:0/1995379522 learned_addr learned my addr 172.21.15.151:0/1995379522 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:44.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.238+0000 7fdeb1951640 1 -- 172.21.15.151:0/1995379522 >> v2:172.21.15.169:3300/0 conn(0x7fdeac1510a0 msgr2=0x7fdeac0c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:39:44.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.238+0000 7fdeb1951640 1 --2- 172.21.15.151:0/1995379522 >> v2:172.21.15.169:3300/0 conn(0x7fdeac1510a0 0x7fdeac0c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:44.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.238+0000 7fdeb1951640 1 -- 172.21.15.151:0/1995379522 >> v1:172.21.15.169:6789/0 conn(0x7fdeac06de00 legacy=0x7fdeac0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:44.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.238+0000 7fdeb1951640 1 -- 172.21.15.151:0/1995379522 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0c2a90 con 0x7fdeac157770 2023-10-18T11:39:44.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.241+0000 7fdeb1951640 1 --2- 172.21.15.151:0/1995379522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac157770 0x7fdeac06d8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009870 tx=0x7fde9c02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6abfee5f12abcc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:44.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.244+0000 7fdeb1150640 1 -- 172.21.15.151:0/1995379522 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c02f840 con 0x7fdeac157770 2023-10-18T11:39:44.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.244+0000 7fdeb1150640 1 -- 172.21.15.151:0/1995379522 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde9c02f9a0 con 0x7fdeac157770 2023-10-18T11:39:44.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.244+0000 7fdeb1150640 1 -- 172.21.15.151:0/1995379522 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c02fd50 con 0x7fdeac157770 2023-10-18T11:39:44.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.245+0000 7fdeb43b6640 1 -- 172.21.15.151:0/1995379522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac157770 msgr2=0x7fdeac06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:44.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.245+0000 7fdeb43b6640 1 --2- 172.21.15.151:0/1995379522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac157770 0x7fdeac06d8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009870 tx=0x7fde9c02ba20 comp rx=0 tx=0).stop 2023-10-18T11:39:44.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.245+0000 7fdeb43b6640 1 -- 172.21.15.151:0/1995379522 shutdown_connections 2023-10-18T11:39:44.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.245+0000 7fdeb43b6640 1 --2- 172.21.15.151:0/1995379522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac157770 0x7fdeac06d8c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:44.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.245+0000 7fdeb43b6640 1 --2- 172.21.15.151:0/1995379522 >> v2:172.21.15.169:3300/0 conn(0x7fdeac1510a0 0x7fdeac0c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:44.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.245+0000 7fdeb43b6640 1 -- 172.21.15.151:0/1995379522 >> 172.21.15.151:0/1995379522 conn(0x7fdeac069f70 msgr2=0x7fdeac06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:44.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.245+0000 7fdeb43b6640 1 -- 172.21.15.151:0/1995379522 shutdown_connections 2023-10-18T11:39:44.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.245+0000 7fdeb43b6640 1 -- 172.21.15.151:0/1995379522 wait complete. 2023-10-18T11:39:44.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.247+0000 7fdeb43b6640 1 Processor -- start 2023-10-18T11:39:44.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.247+0000 7fdeb43b6640 1 -- start start 2023-10-18T11:39:44.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.248+0000 7fdeb43b6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac06de00 0x7fdeac070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:44.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.248+0000 7fdeb43b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeac1510a0 0x7fdeac1ea540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:44.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.248+0000 7fdeb43b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeac157770 0x7fdeac1eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:44.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.248+0000 7fdeb43b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0ca400 con 0x7fdeac1510a0 2023-10-18T11:39:44.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.248+0000 7fdeb43b6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c8c40 con 0x7fdeac157770 2023-10-18T11:39:44.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.248+0000 7fdeb43b6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c87b0 con 0x7fdeac06de00 2023-10-18T11:39:44.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.249+0000 7fdeb1951640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeac1510a0 0x7fdeac1ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:44.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.249+0000 7fdeb2152640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac06de00 0x7fdeac070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:44.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.249+0000 7fdeb2953640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeac157770 0x7fdeac1eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:44.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.249+0000 7fdeb1951640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeac1510a0 0x7fdeac1ea540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36680/0 (socket says 172.21.15.151:36680) 2023-10-18T11:39:44.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.249+0000 7fdeb1951640 1 -- 172.21.15.151:0/2785810282 learned_addr learned my addr 172.21.15.151:0/2785810282 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:44.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.252+0000 7fdeb2152640 1 -- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeac157770 msgr2=0x7fdeac1eaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:44.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.252+0000 7fdeb2152640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeac157770 0x7fdeac1eaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:44.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.252+0000 7fdeb2152640 1 -- 172.21.15.151:0/2785810282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeac1510a0 msgr2=0x7fdeac1ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:44.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.252+0000 7fdeb2152640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeac1510a0 0x7fdeac1ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:44.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.252+0000 7fdeb2152640 1 -- 172.21.15.151:0/2785810282 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c0094d0 con 0x7fdeac06de00 2023-10-18T11:39:44.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.255+0000 7fdeb2152640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac06de00 0x7fdeac070390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e880 tx=0x7fdea800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:44.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.258+0000 7fdea2ffd640 1 -- 172.21.15.151:0/2785810282 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800c940 con 0x7fdeac06de00 2023-10-18T11:39:44.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.258+0000 7fdea2ffd640 1 -- 172.21.15.151:0/2785810282 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdea800caa0 con 0x7fdeac06de00 2023-10-18T11:39:44.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.258+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac0c8480 con 0x7fdeac06de00 2023-10-18T11:39:44.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.258+0000 7fdea2ffd640 1 -- 172.21.15.151:0/2785810282 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800ce70 con 0x7fdeac06de00 2023-10-18T11:39:44.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.259+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac1ee640 con 0x7fdeac06de00 2023-10-18T11:39:44.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.260+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac04e160 con 0x7fdeac06de00 2023-10-18T11:39:44.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.279+0000 7fdea2ffd640 1 -- 172.21.15.151:0/2785810282 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdea8013470 con 0x7fdeac06de00 2023-10-18T11:39:44.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.280+0000 7fdea2ffd640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fde9006aec0 0x7fde9006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.281+0000 7fdeb1951640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fde9006aec0 0x7fde9006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.282+0000 7fdeb1951640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fde9006aec0 0x7fde9006d380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde9c02ba60 tx=0x7fde9c008030 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.506+0000 7fdea2ffd640 1 -- 172.21.15.151:0/2785810282 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdea8058d60 con 0x7fdeac06de00 2023-10-18T11:39:44.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.516+0000 7fdea2ffd640 1 -- 172.21.15.151:0/2785810282 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdea80550a0 con 0x7fdeac06de00 2023-10-18T11:39:44.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:44.760+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdeac0c6ae0 con 0x7fdeac06de00 2023-10-18T11:39:45.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.287+0000 7fdea2ffd640 1 -- 172.21.15.151:0/2785810282 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v127) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdea8021020 con 0x7fdeac06de00 2023-10-18T11:39:45.290 INFO:teuthology.orchestra.run.smithi151.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-18T11:39:45.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.290+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fde9006aec0 msgr2=0x7fde9006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:45.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.290+0000 7fdeb43b6640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fde9006aec0 0x7fde9006d380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde9c02ba60 tx=0x7fde9c008030 comp rx=0 tx=0).stop 2023-10-18T11:39:45.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.290+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac06de00 msgr2=0x7fdeac070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:45.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.290+0000 7fdeb43b6640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac06de00 0x7fdeac070390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e880 tx=0x7fdea800ed40 comp rx=0 tx=0).stop 2023-10-18T11:39:45.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.291+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 shutdown_connections 2023-10-18T11:39:45.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.291+0000 7fdeb43b6640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fde9006aec0 0x7fde9006d380 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:45.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.291+0000 7fdeb43b6640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeac157770 0x7fdeac1eaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:45.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.291+0000 7fdeb43b6640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeac1510a0 0x7fdeac1ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:45.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.291+0000 7fdeb43b6640 1 --2- 172.21.15.151:0/2785810282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdeac06de00 0x7fdeac070390 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e880 tx=0x7fdea800ed40 comp rx=0 tx=0).stop 2023-10-18T11:39:45.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.291+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 >> 172.21.15.151:0/2785810282 conn(0x7fdeac069f70 msgr2=0x7fdeac14f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:45.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.291+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 shutdown_connections 2023-10-18T11:39:45.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.291+0000 7fdeb43b6640 1 -- 172.21.15.151:0/2785810282 wait complete. 2023-10-18T11:39:45.316 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-18T11:39:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.511+0000 7fb70359e640 1 Processor -- start 2023-10-18T11:39:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.511+0000 7fb70359e640 1 -- start start 2023-10-18T11:39:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.512+0000 7fb70359e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 0x7fb70415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.513+0000 7fb70359e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb704157be0 con 0x7fb704069d90 2023-10-18T11:39:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.513+0000 7fb70359e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7040c8100 con 0x7fb704157750 2023-10-18T11:39:45.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.513+0000 7fb70359e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040c8360 con 0x7fb704150c50 2023-10-18T11:39:45.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.513+0000 7fb70259c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 0x7fb70415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:45.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.513+0000 7fb702d9d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fb704157750 0x7fb704161580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:49218/0 (socket says 172.21.15.151:49218) 2023-10-18T11:39:45.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.513+0000 7fb701d9b640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb704069d90 0x7fb70406d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:36834/0 (socket says 172.21.15.151:36834) 2023-10-18T11:39:45.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.513+0000 7fb702d9d640 1 -- 172.21.15.151:0/3374237530 learned_addr learned my addr 172.21.15.151:0/3374237530 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:39:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.516+0000 7fb70259c640 1 -- 172.21.15.151:0/3374237530 >> v1:172.21.15.169:6789/0 conn(0x7fb704157750 legacy=0x7fb704161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.516+0000 7fb70259c640 1 -- 172.21.15.151:0/3374237530 >> v1:172.21.15.151:6789/0 conn(0x7fb704069d90 legacy=0x7fb70406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.516+0000 7fb70259c640 1 -- 172.21.15.151:0/3374237530 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7040c8640 con 0x7fb704150c50 2023-10-18T11:39:45.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.519+0000 7fb70259c640 1 --2- 172.21.15.151:0/3374237530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 0x7fb70415a1f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40097d0 tx=0x7fb6f402b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93331e5eb553c6ff server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:45.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.523+0000 7fb70159a640 1 -- 172.21.15.151:0/3374237530 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4030890 con 0x7fb704150c50 2023-10-18T11:39:45.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.523+0000 7fb70159a640 1 -- 172.21.15.151:0/3374237530 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb6f40309f0 con 0x7fb704150c50 2023-10-18T11:39:45.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.523+0000 7fb70159a640 1 -- 172.21.15.151:0/3374237530 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4030da0 con 0x7fb704150c50 2023-10-18T11:39:45.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.523+0000 7fb70359e640 1 -- 172.21.15.151:0/3374237530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 msgr2=0x7fb70415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:45.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.523+0000 7fb70359e640 1 --2- 172.21.15.151:0/3374237530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 0x7fb70415a1f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40097d0 tx=0x7fb6f402b9d0 comp rx=0 tx=0).stop 2023-10-18T11:39:45.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.523+0000 7fb70359e640 1 -- 172.21.15.151:0/3374237530 shutdown_connections 2023-10-18T11:39:45.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.523+0000 7fb70359e640 1 --2- 172.21.15.151:0/3374237530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 0x7fb70415a1f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:45.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.523+0000 7fb70359e640 1 -- 172.21.15.151:0/3374237530 >> 172.21.15.151:0/3374237530 conn(0x7fb70406c860 msgr2=0x7fb70406cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:45.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.524+0000 7fb70359e640 1 -- 172.21.15.151:0/3374237530 shutdown_connections 2023-10-18T11:39:45.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.524+0000 7fb70359e640 1 -- 172.21.15.151:0/3374237530 wait complete. 2023-10-18T11:39:45.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.525+0000 7fb70359e640 1 Processor -- start 2023-10-18T11:39:45.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.526+0000 7fb70359e640 1 -- start start 2023-10-18T11:39:45.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.526+0000 7fb70359e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb704069d90 0x7fb7040c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:45.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.526+0000 7fb70359e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 0x7fb7040c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:45.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.527+0000 7fb70359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb704157750 0x7fb704151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:45.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.527+0000 7fb70359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb704153610 con 0x7fb704157750 2023-10-18T11:39:45.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.527+0000 7fb70359e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb704152a60 con 0x7fb704069d90 2023-10-18T11:39:45.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.527+0000 7fb70359e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040c7380 con 0x7fb704150c50 2023-10-18T11:39:45.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.527+0000 7fb70259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb704069d90 0x7fb7040c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:45.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.527+0000 7fb701d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 0x7fb7040c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:45.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.527+0000 7fb702d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb704157750 0x7fb704151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:45.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.528+0000 7fb70259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb704069d90 0x7fb7040c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:47590/0 (socket says 172.21.15.151:47590) 2023-10-18T11:39:45.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.528+0000 7fb70259c640 1 -- 172.21.15.151:0/3139985906 learned_addr learned my addr 172.21.15.151:0/3139985906 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.531+0000 7fb70259c640 1 -- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 msgr2=0x7fb7040c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.531+0000 7fb70259c640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 0x7fb7040c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:45.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.531+0000 7fb70259c640 1 -- 172.21.15.151:0/3139985906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb704157750 msgr2=0x7fb704151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:45.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.531+0000 7fb70259c640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb704157750 0x7fb704151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:45.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.531+0000 7fb70259c640 1 -- 172.21.15.151:0/3139985906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4009400 con 0x7fb704069d90 2023-10-18T11:39:45.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.533+0000 7fb70259c640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb704069d90 0x7fb7040c52f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40098f0 tx=0x7fb6f4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:45.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.538+0000 7fb6f2ffd640 1 -- 172.21.15.151:0/3139985906 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f403e040 con 0x7fb704069d90 2023-10-18T11:39:45.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.538+0000 7fb6f2ffd640 1 -- 172.21.15.151:0/3139985906 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb6f40443f0 con 0x7fb704069d90 2023-10-18T11:39:45.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.538+0000 7fb6f2ffd640 1 -- 172.21.15.151:0/3139985906 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f40447c0 con 0x7fb704069d90 2023-10-18T11:39:45.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.538+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7040c5830 con 0x7fb704069d90 2023-10-18T11:39:45.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.538+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7040c34e0 con 0x7fb704069d90 2023-10-18T11:39:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.539+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb704068fd0 con 0x7fb704069d90 2023-10-18T11:39:45.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.564+0000 7fb6f2ffd640 1 -- 172.21.15.151:0/3139985906 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb6f402f3e0 con 0x7fb704069d90 2023-10-18T11:39:45.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.565+0000 7fb6f2ffd640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb6e406aec0 0x7fb6e406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:45.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.566+0000 7fb701d9b640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb6e406aec0 0x7fb6e406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:45.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.567+0000 7fb701d9b640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb6e406aec0 0x7fb6e406d380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb7040c0360 tx=0x7fb6f8000ed0 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:45.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.845+0000 7fb6f2ffd640 1 -- 172.21.15.151:0/3139985906 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fb6f407b4d0 con 0x7fb704069d90 2023-10-18T11:39:45.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:45.857+0000 7fb6f2ffd640 1 -- 172.21.15.151:0/3139985906 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6f4077810 con 0x7fb704069d90 2023-10-18T11:39:46.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:46.110+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb704153bc0 con 0x7fb704069d90 2023-10-18T11:39:46.417 INFO:tasks.ceph.mds.f.smithi169.stderr:==00:00:30:23.142 122774== 2023-10-18T11:39:46.418 INFO:tasks.ceph.mds.f.smithi169.stderr:==00:00:30:23.142 122774== Exit program on first error (--exit-on-first-error=yes) 2023-10-18T11:39:46.560 INFO:tasks.ceph.mds.d.smithi169.stderr:==00:00:30:23.289 122773== 2023-10-18T11:39:46.561 INFO:tasks.ceph.mds.d.smithi169.stderr:==00:00:30:23.289 122773== Exit program on first error (--exit-on-first-error=yes) 2023-10-18T11:39:46.585 INFO:tasks.ceph.mds.c.smithi151.stderr:==00:00:30:23.237 91112== 2023-10-18T11:39:46.585 INFO:tasks.ceph.mds.c.smithi151.stderr:==00:00:30:23.237 91112== Exit program on first error (--exit-on-first-error=yes) 2023-10-18T11:39:46.616 INFO:tasks.ceph.mds.d.smithi169.stderr:daemon-helper: command failed with exit status 42 2023-10-18T11:39:46.616 INFO:tasks.ceph.mds.f.smithi169.stderr:daemon-helper: command failed with exit status 42 2023-10-18T11:39:46.661 INFO:tasks.ceph.mds.a.smithi151.stderr:==00:00:30:23.308 91111== 2023-10-18T11:39:46.662 INFO:tasks.ceph.mds.a.smithi151.stderr:==00:00:30:23.308 91111== Exit program on first error (--exit-on-first-error=yes) 2023-10-18T11:39:46.715 INFO:tasks.ceph.mds.e.smithi151.stderr:==00:00:30:23.363 91113== 2023-10-18T11:39:46.715 INFO:tasks.ceph.mds.e.smithi151.stderr:==00:00:30:23.363 91113== Exit program on first error (--exit-on-first-error=yes) 2023-10-18T11:39:46.730 INFO:tasks.ceph.mds.c.smithi151.stderr:daemon-helper: command failed with exit status 42 2023-10-18T11:39:46.731 INFO:tasks.ceph.mds.a.smithi151.stderr:daemon-helper: command failed with exit status 42 2023-10-18T11:39:46.931 INFO:tasks.ceph.mds.e.smithi151.stderr:daemon-helper: command failed with exit status 42 2023-10-18T11:39:47.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.205+0000 7fb6f2ffd640 1 -- 172.21.15.151:0/3139985906 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v128) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb6f40340a0 con 0x7fb704069d90 2023-10-18T11:39:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb6e406aec0 msgr2=0x7fb6e406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb6e406aec0 0x7fb6e406d380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb7040c0360 tx=0x7fb6f8000ed0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb704069d90 msgr2=0x7fb7040c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb704069d90 0x7fb7040c52f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40098f0 tx=0x7fb6f4004730 comp rx=0 tx=0).stop 2023-10-18T11:39:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 shutdown_connections 2023-10-18T11:39:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb704157750 0x7fb704151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb704150c50 0x7fb7040c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb6e406aec0 0x7fb6e406d380 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 --2- 172.21.15.151:0/3139985906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb704069d90 0x7fb7040c52f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 >> 172.21.15.151:0/3139985906 conn(0x7fb70406c860 msgr2=0x7fb704159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 shutdown_connections 2023-10-18T11:39:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.208+0000 7fb70359e640 1 -- 172.21.15.151:0/3139985906 wait complete. 2023-10-18T11:39:47.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-18T11:39:47.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.434+0000 7f6b1f3e7640 1 Processor -- start 2023-10-18T11:39:47.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.434+0000 7f6b1f3e7640 1 -- start start 2023-10-18T11:39:47.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.436+0000 7f6b1f3e7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6b180715d0 0x7f6b180c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:47.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.436+0000 7f6b1f3e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b1815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:47.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.436+0000 7f6b1f3e7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b180c6450 con 0x7f6b181532a0 2023-10-18T11:39:47.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.436+0000 7f6b1f3e7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b180c5ae0 con 0x7f6b180715d0 2023-10-18T11:39:47.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.436+0000 7f6b1f3e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180c54a0 con 0x7f6b1815c5d0 2023-10-18T11:39:47.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.437+0000 7f6b1d183640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f6b181532a0 0x7f6b1806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:49232/0 (socket says 172.21.15.151:49232) 2023-10-18T11:39:47.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.437+0000 7f6b1d183640 1 -- 172.21.15.151:0/2793399903 learned_addr learned my addr 172.21.15.151:0/2793399903 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:39:47.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.437+0000 7f6b1d984640 1 --2- 172.21.15.151:0/2793399903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b1815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:47.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.437+0000 7f6b1c982640 1 --2- 172.21.15.151:0/2793399903 >> v2:172.21.15.151:3300/0 conn(0x7f6b180715d0 0x7f6b180c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:47.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.439+0000 7f6b0ffff640 1 -- 172.21.15.151:0/2793399903 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245452257 0 0) 0x7f6b180c6450 con 0x7f6b181532a0 2023-10-18T11:39:47.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.440+0000 7f6b0ffff640 1 -- 172.21.15.151:0/2793399903 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b04003520 con 0x7f6b181532a0 2023-10-18T11:39:47.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.440+0000 7f6b1d984640 1 -- 172.21.15.151:0/2793399903 >> v2:172.21.15.151:3300/0 conn(0x7f6b180715d0 msgr2=0x7f6b180c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:39:47.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.440+0000 7f6b1d984640 1 --2- 172.21.15.151:0/2793399903 >> v2:172.21.15.151:3300/0 conn(0x7f6b180715d0 0x7f6b180c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.440+0000 7f6b1d984640 1 -- 172.21.15.151:0/2793399903 >> v1:172.21.15.169:6789/0 conn(0x7f6b181532a0 legacy=0x7f6b1806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:47.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.440+0000 7f6b1d984640 1 -- 172.21.15.151:0/2793399903 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180c5780 con 0x7f6b1815c5d0 2023-10-18T11:39:47.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.454+0000 7f6b1d984640 1 --2- 172.21.15.151:0/2793399903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b1815ca60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009d90 tx=0x7f6b1002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba34ae0cc84dc2f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:47.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.462+0000 7f6b0ffff640 1 -- 172.21.15.151:0/2793399903 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1002cce0 con 0x7f6b1815c5d0 2023-10-18T11:39:47.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.462+0000 7f6b0ffff640 1 -- 172.21.15.151:0/2793399903 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6b1002ce40 con 0x7f6b1815c5d0 2023-10-18T11:39:47.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.462+0000 7f6b0ffff640 1 -- 172.21.15.151:0/2793399903 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10034680 con 0x7f6b1815c5d0 2023-10-18T11:39:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.463+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/2793399903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 msgr2=0x7f6b1815ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.463+0000 7f6b1f3e7640 1 --2- 172.21.15.151:0/2793399903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b1815ca60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009d90 tx=0x7f6b1002bf30 comp rx=0 tx=0).stop 2023-10-18T11:39:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.463+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/2793399903 shutdown_connections 2023-10-18T11:39:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.463+0000 7f6b1f3e7640 1 --2- 172.21.15.151:0/2793399903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b1815ca60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.463+0000 7f6b1f3e7640 1 --2- 172.21.15.151:0/2793399903 >> v2:172.21.15.151:3300/0 conn(0x7f6b180715d0 0x7f6b180c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.463+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/2793399903 >> 172.21.15.151:0/2793399903 conn(0x7f6b18069f70 msgr2=0x7f6b1806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.464+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/2793399903 shutdown_connections 2023-10-18T11:39:47.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.464+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/2793399903 wait complete. 2023-10-18T11:39:47.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.466+0000 7f6b1f3e7640 1 Processor -- start 2023-10-18T11:39:47.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.466+0000 7f6b1f3e7640 1 -- start start 2023-10-18T11:39:47.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.467+0000 7f6b1f3e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b180715d0 0x7f6b18147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:47.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.467+0000 7f6b1f3e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b181532a0 0x7f6b18147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:47.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.467+0000 7f6b1f3e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b181f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:47.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.467+0000 7f6b1f3e7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181f1a50 con 0x7f6b181532a0 2023-10-18T11:39:47.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.467+0000 7f6b1f3e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181f1520 con 0x7f6b180715d0 2023-10-18T11:39:47.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.467+0000 7f6b1f3e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180c1cf0 con 0x7f6b1815c5d0 2023-10-18T11:39:47.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.467+0000 7f6b1d183640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b180715d0 0x7f6b18147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:47.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.467+0000 7f6b1d984640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b181f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:47.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.468+0000 7f6b1d183640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b180715d0 0x7f6b18147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:47602/0 (socket says 172.21.15.151:47602) 2023-10-18T11:39:47.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.468+0000 7f6b1d183640 1 -- 172.21.15.151:0/3037037998 learned_addr learned my addr 172.21.15.151:0/3037037998 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:47.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.471+0000 7f6b1d984640 1 -- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b180715d0 msgr2=0x7f6b18147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:47.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.471+0000 7f6b1d984640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b180715d0 0x7f6b18147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.471+0000 7f6b1d984640 1 -- 172.21.15.151:0/3037037998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b181532a0 msgr2=0x7f6b18147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:47.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.471+0000 7f6b1d984640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b181532a0 0x7f6b18147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:47.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.471+0000 7f6b1d984640 1 -- 172.21.15.151:0/3037037998 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10009a70 con 0x7f6b1815c5d0 2023-10-18T11:39:47.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.471+0000 7f6b1d183640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b180715d0 0x7f6b18147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T11:39:47.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.474+0000 7f6b1d984640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b181f1c00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b10033000 tx=0x7f6b10004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:47.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.476+0000 7f6b0dffb640 1 -- 172.21.15.151:0/3037037998 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1003d600 con 0x7f6b1815c5d0 2023-10-18T11:39:47.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.476+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b181f2830 con 0x7f6b1815c5d0 2023-10-18T11:39:47.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.477+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b180c1980 con 0x7f6b1815c5d0 2023-10-18T11:39:47.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.478+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b180c17e0 con 0x7f6b1815c5d0 2023-10-18T11:39:47.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.480+0000 7f6b0dffb640 1 -- 172.21.15.151:0/3037037998 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6b10009450 con 0x7f6b1815c5d0 2023-10-18T11:39:47.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.480+0000 7f6b0dffb640 1 -- 172.21.15.151:0/3037037998 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1003d980 con 0x7f6b1815c5d0 2023-10-18T11:39:47.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.728+0000 7f6b0dffb640 1 -- 172.21.15.151:0/3037037998 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b1003b040 con 0x7f6b1815c5d0 2023-10-18T11:39:47.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.730+0000 7f6b0dffb640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6afc06ae70 0x7f6afc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:47.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.730+0000 7f6b0dffb640 1 -- 172.21.15.151:0/3037037998 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f6b100ac0f0 con 0x7f6b1815c5d0 2023-10-18T11:39:47.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.731+0000 7f6b1d183640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6afc06ae70 0x7f6afc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:47.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.732+0000 7f6b1d183640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6afc06ae70 0x7f6afc06d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b140011e0 tx=0x7f6b14009040 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:47.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.740+0000 7f6b0dffb640 1 -- 172.21.15.151:0/3037037998 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b10076db0 con 0x7f6b1815c5d0 2023-10-18T11:39:47.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:47.937+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6b180c17e0 con 0x7f6b1815c5d0 2023-10-18T11:39:49.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.015+0000 7f6b0dffb640 1 -- 172.21.15.151:0/3037037998 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6b180c17e0 con 0x7f6b1815c5d0 2023-10-18T11:39:49.018 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_metadata' removed 2023-10-18T11:39:49.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.019+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6afc06ae70 msgr2=0x7f6afc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.019+0000 7f6b1f3e7640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6afc06ae70 0x7f6afc06d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b140011e0 tx=0x7f6b14009040 comp rx=0 tx=0).stop 2023-10-18T11:39:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.019+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 msgr2=0x7f6b181f1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.019+0000 7f6b1f3e7640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b181f1c00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b10033000 tx=0x7f6b10004a40 comp rx=0 tx=0).stop 2023-10-18T11:39:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.020+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 shutdown_connections 2023-10-18T11:39:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.020+0000 7f6b1f3e7640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6b1815c5d0 0x7f6b181f1c00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:49.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.020+0000 7f6b1f3e7640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b181532a0 0x7f6b18147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:49.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.020+0000 7f6b1f3e7640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7f6afc06ae70 0x7f6afc06d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:49.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.020+0000 7f6b1f3e7640 1 --2- 172.21.15.151:0/3037037998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b180715d0 0x7f6b18147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:49.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.020+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 >> 172.21.15.151:0/3037037998 conn(0x7f6b18069f70 msgr2=0x7f6b180bdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:49.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.020+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 shutdown_connections 2023-10-18T11:39:49.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.020+0000 7f6b1f3e7640 1 -- 172.21.15.151:0/3037037998 wait complete. 2023-10-18T11:39:49.050 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-18T11:39:49.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.247+0000 7fa7433b8640 1 Processor -- start 2023-10-18T11:39:49.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.247+0000 7fa7433b8640 1 -- start start 2023-10-18T11:39:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.249+0000 7fa7433b8640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa73c069d90 0x7fa73c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.249+0000 7fa7433b8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 0x7fa73c161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.249+0000 7fa7433b8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c157be0 con 0x7fa73c150c50 2023-10-18T11:39:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.249+0000 7fa7433b8640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0c8100 con 0x7fa73c069d90 2023-10-18T11:39:49.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.249+0000 7fa7433b8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c8360 con 0x7fa73c157750 2023-10-18T11:39:49.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.249+0000 7fa7423b6640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fa73c150c50 0x7fa73c06d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:33528/0 (socket says 172.21.15.151:33528) 2023-10-18T11:39:49.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.249+0000 7fa7423b6640 1 -- 172.21.15.151:0/3425831023 learned_addr learned my addr 172.21.15.151:0/3425831023 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:39:49.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.249+0000 7fa742bb7640 1 --2- 172.21.15.151:0/3425831023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 0x7fa73c161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:49.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.249+0000 7fa741bb5640 1 --2- 172.21.15.151:0/3425831023 >> v2:172.21.15.151:3300/0 conn(0x7fa73c069d90 0x7fa73c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.252+0000 7fa7413b4640 1 -- 172.21.15.151:0/3425831023 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600506363 0 0) 0x7fa73c157be0 con 0x7fa73c150c50 2023-10-18T11:39:49.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.252+0000 7fa7413b4640 1 -- 172.21.15.151:0/3425831023 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa728003520 con 0x7fa73c150c50 2023-10-18T11:39:49.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.252+0000 7fa742bb7640 1 -- 172.21.15.151:0/3425831023 >> v2:172.21.15.151:3300/0 conn(0x7fa73c069d90 msgr2=0x7fa73c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:39:49.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.252+0000 7fa742bb7640 1 --2- 172.21.15.151:0/3425831023 >> v2:172.21.15.151:3300/0 conn(0x7fa73c069d90 0x7fa73c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:49.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.252+0000 7fa742bb7640 1 -- 172.21.15.151:0/3425831023 >> v1:172.21.15.169:6789/0 conn(0x7fa73c150c50 legacy=0x7fa73c06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:49.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.252+0000 7fa742bb7640 1 -- 172.21.15.151:0/3425831023 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0c8640 con 0x7fa73c157750 2023-10-18T11:39:49.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.254+0000 7fa742bb7640 1 --2- 172.21.15.151:0/3425831023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 0x7fa73c161580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa734009d90 tx=0x7fa73402bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=998b1d41123120d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:49.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.258+0000 7fa7413b4640 1 -- 172.21.15.151:0/3425831023 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73402ccf0 con 0x7fa73c157750 2023-10-18T11:39:49.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.258+0000 7fa7413b4640 1 -- 172.21.15.151:0/3425831023 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa73402ce50 con 0x7fa73c157750 2023-10-18T11:39:49.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.258+0000 7fa7413b4640 1 -- 172.21.15.151:0/3425831023 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734034680 con 0x7fa73c157750 2023-10-18T11:39:49.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.259+0000 7fa7433b8640 1 -- 172.21.15.151:0/3425831023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 msgr2=0x7fa73c161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:49.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.259+0000 7fa7433b8640 1 --2- 172.21.15.151:0/3425831023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 0x7fa73c161580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa734009d90 tx=0x7fa73402bf40 comp rx=0 tx=0).stop 2023-10-18T11:39:49.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.259+0000 7fa7433b8640 1 -- 172.21.15.151:0/3425831023 shutdown_connections 2023-10-18T11:39:49.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.259+0000 7fa7433b8640 1 --2- 172.21.15.151:0/3425831023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 0x7fa73c161580 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:49.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.259+0000 7fa7433b8640 1 --2- 172.21.15.151:0/3425831023 >> v2:172.21.15.151:3300/0 conn(0x7fa73c069d90 0x7fa73c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:49.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.259+0000 7fa7433b8640 1 -- 172.21.15.151:0/3425831023 >> 172.21.15.151:0/3425831023 conn(0x7fa73c06c860 msgr2=0x7fa73c06cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:49.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.259+0000 7fa7433b8640 1 -- 172.21.15.151:0/3425831023 shutdown_connections 2023-10-18T11:39:49.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.259+0000 7fa7433b8640 1 -- 172.21.15.151:0/3425831023 wait complete. 2023-10-18T11:39:49.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.261+0000 7fa7433b8640 1 Processor -- start 2023-10-18T11:39:49.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.261+0000 7fa7433b8640 1 -- start start 2023-10-18T11:39:49.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.262+0000 7fa7433b8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa73c069d90 0x7fa73c14c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.262+0000 7fa7433b8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa73c150c50 0x7fa73c1e5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.262+0000 7fa7433b8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 0x7fa73c1e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.262+0000 7fa7433b8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c159dd0 con 0x7fa73c150c50 2023-10-18T11:39:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.262+0000 7fa7433b8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c14cb70 con 0x7fa73c069d90 2023-10-18T11:39:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.262+0000 7fa7433b8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c15a150 con 0x7fa73c157750 2023-10-18T11:39:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.263+0000 7fa741bb5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa73c150c50 0x7fa73c1e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.264+0000 7fa741bb5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa73c150c50 0x7fa73c1e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35050/0 (socket says 172.21.15.151:35050) 2023-10-18T11:39:49.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.264+0000 7fa741bb5640 1 -- 172.21.15.151:0/2880163791 learned_addr learned my addr 172.21.15.151:0/2880163791 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:49.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.264+0000 7fa7423b6640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa73c069d90 0x7fa73c14c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:49.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.265+0000 7fa742bb7640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 0x7fa73c1e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:49.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.268+0000 7fa741bb5640 1 -- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 msgr2=0x7fa73c1e5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.268+0000 7fa741bb5640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 0x7fa73c1e5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.268+0000 7fa741bb5640 1 -- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa73c069d90 msgr2=0x7fa73c14c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.268+0000 7fa741bb5640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa73c069d90 0x7fa73c14c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.268+0000 7fa741bb5640 1 -- 172.21.15.151:0/2880163791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009a70 con 0x7fa73c150c50 2023-10-18T11:39:49.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.272+0000 7fa741bb5640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa73c150c50 0x7fa73c1e5800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00e9b0 tx=0x7fa72c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:49.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.281+0000 7fa732ffd640 1 -- 172.21.15.151:0/2880163791 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c009670 con 0x7fa73c150c50 2023-10-18T11:39:49.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.281+0000 7fa732ffd640 1 -- 172.21.15.151:0/2880163791 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa72c00c9a0 con 0x7fa73c150c50 2023-10-18T11:39:49.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.281+0000 7fa732ffd640 1 -- 172.21.15.151:0/2880163791 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00cd70 con 0x7fa73c150c50 2023-10-18T11:39:49.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.281+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c15a430 con 0x7fa73c150c50 2023-10-18T11:39:49.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.281+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c14e920 con 0x7fa73c150c50 2023-10-18T11:39:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.282+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c068fd0 con 0x7fa73c150c50 2023-10-18T11:39:49.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.745+0000 7fa732ffd640 1 -- 172.21.15.151:0/2880163791 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa72c013470 con 0x7fa73c150c50 2023-10-18T11:39:49.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.748+0000 7fa732ffd640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa72006aec0 0x7fa72006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:49.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.749+0000 7fa7423b6640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa72006aec0 0x7fa72006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:49.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.750+0000 7fa7423b6640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa72006aec0 0x7fa72006d380 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa7380011e0 tx=0x7fa738007d30 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:49.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.780+0000 7fa732ffd640 1 -- 172.21.15.151:0/2880163791 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6655+0+0 (secure 0 0 0) 0x7fa72c058e40 con 0x7fa73c150c50 2023-10-18T11:39:49.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:49.781+0000 7fa732ffd640 1 -- 172.21.15.151:0/2880163791 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa72c0550f0 con 0x7fa73c150c50 2023-10-18T11:39:50.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.008+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa73c1545b0 con 0x7fa73c150c50 2023-10-18T11:39:50.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-18T11:39:50.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-18T11:39:50.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-10-18T11:39:50.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-18T11:39:50.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-10-18T11:39:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.979+0000 7fa732ffd640 1 -- 172.21.15.151:0/2880163791 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa72c021020 con 0x7fa73c150c50 2023-10-18T11:39:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_data' removed 2023-10-18T11:39:50.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa72006aec0 msgr2=0x7fa72006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:50.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa72006aec0 0x7fa72006d380 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa7380011e0 tx=0x7fa738007d30 comp rx=0 tx=0).stop 2023-10-18T11:39:50.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa73c150c50 msgr2=0x7fa73c1e5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:50.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa73c150c50 0x7fa73c1e5800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00e9b0 tx=0x7fa72c00ee70 comp rx=0 tx=0).stop 2023-10-18T11:39:50.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 shutdown_connections 2023-10-18T11:39:50.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa73c157750 0x7fa73c1e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:50.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa73c150c50 0x7fa73c1e5800 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:50.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fa72006aec0 0x7fa72006d380 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:50.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 --2- 172.21.15.151:0/2880163791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa73c069d90 0x7fa73c14c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:50.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 >> 172.21.15.151:0/2880163791 conn(0x7fa73c06c860 msgr2=0x7fa73c155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:50.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 shutdown_connections 2023-10-18T11:39:50.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:50.983+0000 7fa7433b8640 1 -- 172.21.15.151:0/2880163791 wait complete. 2023-10-18T11:39:51.010 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-18T11:39:51.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.215+0000 7fb03bfff640 1 Processor -- start 2023-10-18T11:39:51.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.215+0000 7fb03bfff640 1 -- start start 2023-10-18T11:39:51.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.216+0000 7fb03bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c14fc20 0x7fb03c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:51.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.217+0000 7fb03bfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb03c0706b0 0x7fb03c06d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:51.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.217+0000 7fb03bfff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c0c35d0 con 0x7fb03c070ad0 2023-10-18T11:39:51.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.217+0000 7fb03bfff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c070f60 con 0x7fb03c0706b0 2023-10-18T11:39:51.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.217+0000 7fb03bfff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0c3890 con 0x7fb03c14fc20 2023-10-18T11:39:51.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.217+0000 7fb03b7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fb03c070ad0 0x7fb03c155bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.151:33532/0 (socket says 172.21.15.151:33532) 2023-10-18T11:39:51.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.217+0000 7fb03b7fe640 1 -- 172.21.15.151:0/3760081374 learned_addr learned my addr 172.21.15.151:0/3760081374 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-18T11:39:51.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.217+0000 7fb03affd640 1 --2- 172.21.15.151:0/3760081374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c14fc20 0x7fb03c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:51.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.217+0000 7fb0327fc640 1 --2- 172.21.15.151:0/3760081374 >> v2:172.21.15.151:3300/0 conn(0x7fb03c0706b0 0x7fb03c06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:51.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.220+0000 7fb03a7fc640 1 -- 172.21.15.151:0/3760081374 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914116131 0 0) 0x7fb03c0c35d0 con 0x7fb03c070ad0 2023-10-18T11:39:51.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.220+0000 7fb03a7fc640 1 -- 172.21.15.151:0/3760081374 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb028003520 con 0x7fb03c070ad0 2023-10-18T11:39:51.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.220+0000 7fb03affd640 1 -- 172.21.15.151:0/3760081374 >> v2:172.21.15.151:3300/0 conn(0x7fb03c0706b0 msgr2=0x7fb03c06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T11:39:51.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.220+0000 7fb03affd640 1 --2- 172.21.15.151:0/3760081374 >> v2:172.21.15.151:3300/0 conn(0x7fb03c0706b0 0x7fb03c06d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:51.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.220+0000 7fb03affd640 1 -- 172.21.15.151:0/3760081374 >> v1:172.21.15.169:6789/0 conn(0x7fb03c070ad0 legacy=0x7fb03c155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:51.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.220+0000 7fb03affd640 1 -- 172.21.15.151:0/3760081374 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c0c3b70 con 0x7fb03c14fc20 2023-10-18T11:39:51.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.223+0000 7fb03affd640 1 --2- 172.21.15.151:0/3760081374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c14fc20 0x7fb03c0c9a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0097a0 tx=0x7fb02c02db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f516dd018bb7f7d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:51.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.226+0000 7fb03a7fc640 1 -- 172.21.15.151:0/3760081374 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c02e920 con 0x7fb03c14fc20 2023-10-18T11:39:51.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.227+0000 7fb03a7fc640 1 -- 172.21.15.151:0/3760081374 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb02c02ea80 con 0x7fb03c14fc20 2023-10-18T11:39:51.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.227+0000 7fb03a7fc640 1 -- 172.21.15.151:0/3760081374 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c02ee30 con 0x7fb03c14fc20 2023-10-18T11:39:51.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.227+0000 7fb03bfff640 1 -- 172.21.15.151:0/3760081374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c14fc20 msgr2=0x7fb03c0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:51.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.227+0000 7fb03bfff640 1 --2- 172.21.15.151:0/3760081374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c14fc20 0x7fb03c0c9a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0097a0 tx=0x7fb02c02db70 comp rx=0 tx=0).stop 2023-10-18T11:39:51.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.228+0000 7fb03bfff640 1 -- 172.21.15.151:0/3760081374 shutdown_connections 2023-10-18T11:39:51.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.228+0000 7fb03bfff640 1 --2- 172.21.15.151:0/3760081374 >> v2:172.21.15.151:3300/0 conn(0x7fb03c0706b0 0x7fb03c06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:51.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.228+0000 7fb03bfff640 1 --2- 172.21.15.151:0/3760081374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c14fc20 0x7fb03c0c9a70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:51.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.228+0000 7fb03bfff640 1 -- 172.21.15.151:0/3760081374 >> 172.21.15.151:0/3760081374 conn(0x7fb03c06c860 msgr2=0x7fb03c06cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:51.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.228+0000 7fb03bfff640 1 -- 172.21.15.151:0/3760081374 shutdown_connections 2023-10-18T11:39:51.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.228+0000 7fb03bfff640 1 -- 172.21.15.151:0/3760081374 wait complete. 2023-10-18T11:39:51.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.230+0000 7fb03bfff640 1 Processor -- start 2023-10-18T11:39:51.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.230+0000 7fb03bfff640 1 -- start start 2023-10-18T11:39:51.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.231+0000 7fb03bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb03c0706b0 0x7fb03c152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:51.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.231+0000 7fb03bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb03c14fc20 0x7fb03c155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:51.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.231+0000 7fb03bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c149620 0x7fb03c1f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:51.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.231+0000 7fb03bfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c1f1db0 con 0x7fb03c0706b0 2023-10-18T11:39:51.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.231+0000 7fb03bfff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c1ee610 con 0x7fb03c14fc20 2023-10-18T11:39:51.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.231+0000 7fb03bfff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c148a10 con 0x7fb03c149620 2023-10-18T11:39:51.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.232+0000 7fb0327fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb03c14fc20 0x7fb03c155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:51.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.232+0000 7fb03b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c149620 0x7fb03c1f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:51.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.232+0000 7fb03affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb03c0706b0 0x7fb03c152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:51.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.232+0000 7fb0327fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb03c14fc20 0x7fb03c155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.151:47140/0 (socket says 172.21.15.151:47140) 2023-10-18T11:39:51.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.232+0000 7fb0327fc640 1 -- 172.21.15.151:0/1699896474 learned_addr learned my addr 172.21.15.151:0/1699896474 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-18T11:39:51.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.236+0000 7fb03b7fe640 1 -- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb03c14fc20 msgr2=0x7fb03c155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:51.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.236+0000 7fb03b7fe640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb03c14fc20 0x7fb03c155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:51.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.236+0000 7fb03b7fe640 1 -- 172.21.15.151:0/1699896474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb03c0706b0 msgr2=0x7fb03c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:51.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.236+0000 7fb03b7fe640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb03c0706b0 0x7fb03c152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:51.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.236+0000 7fb03b7fe640 1 -- 172.21.15.151:0/1699896474 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c009400 con 0x7fb03c149620 2023-10-18T11:39:51.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.238+0000 7fb03b7fe640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c149620 0x7fb03c1f2240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb03400ca80 tx=0x7fb03400cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:51.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.242+0000 7fb038ff9640 1 -- 172.21.15.151:0/1699896474 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03400ac30 con 0x7fb03c149620 2023-10-18T11:39:51.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.242+0000 7fb038ff9640 1 -- 172.21.15.151:0/1699896474 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb03400ad90 con 0x7fb03c149620 2023-10-18T11:39:51.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.242+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c148cf0 con 0x7fb03c149620 2023-10-18T11:39:51.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.242+0000 7fb038ff9640 1 -- 172.21.15.151:0/1699896474 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034012620 con 0x7fb03c149620 2023-10-18T11:39:51.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.242+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c153110 con 0x7fb03c149620 2023-10-18T11:39:51.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.243+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c0c2ea0 con 0x7fb03c149620 2023-10-18T11:39:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.499+0000 7fb038ff9640 1 -- 172.21.15.151:0/1699896474 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 7) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb034007070 con 0x7fb03c149620 2023-10-18T11:39:51.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.501+0000 7fb038ff9640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb01c06aef0 0x7fb01c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T11:39:51.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.502+0000 7fb038ff9640 1 -- 172.21.15.151:0/1699896474 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fb034089b60 con 0x7fb03c149620 2023-10-18T11:39:51.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.502+0000 7fb03affd640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb01c06aef0 0x7fb01c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T11:39:51.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.503+0000 7fb03affd640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb01c06aef0 0x7fb01c06d3b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb02c038000 tx=0x7fb02c032000 comp rx=0 tx=0).ready entity=mgr.4153 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T11:39:51.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.510+0000 7fb038ff9640 1 -- 172.21.15.151:0/1699896474 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb034054ae0 con 0x7fb03c149620 2023-10-18T11:39:51.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:51.709+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb03c149210 con 0x7fb03c149620 2023-10-18T11:39:52.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.406+0000 7fb038ff9640 1 -- 172.21.15.151:0/1699896474 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7fb03c149210 con 0x7fb03c149620 2023-10-18T11:39:52.409 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_data_ec' removed 2023-10-18T11:39:52.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb01c06aef0 msgr2=0x7fb01c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:52.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb01c06aef0 0x7fb01c06d3b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb02c038000 tx=0x7fb02c032000 comp rx=0 tx=0).stop 2023-10-18T11:39:52.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c149620 msgr2=0x7fb03c1f2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T11:39:52.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c149620 0x7fb03c1f2240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb03400ca80 tx=0x7fb03400cf40 comp rx=0 tx=0).stop 2023-10-18T11:39:52.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 shutdown_connections 2023-10-18T11:39:52.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb03c149620 0x7fb03c1f2240 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:52.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:6832/3214727900,v1:172.21.15.169:6833/3214727900] conn(0x7fb01c06aef0 0x7fb01c06d3b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:52.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb03c14fc20 0x7fb03c155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:52.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 --2- 172.21.15.151:0/1699896474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb03c0706b0 0x7fb03c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T11:39:52.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 >> 172.21.15.151:0/1699896474 conn(0x7fb03c06c860 msgr2=0x7fb03c06fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T11:39:52.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 shutdown_connections 2023-10-18T11:39:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-18T11:39:52.410+0000 7fb03bfff640 1 -- 172.21.15.151:0/1699896474 wait complete. 2023-10-18T11:39:52.443 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-18T11:39:52.443 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-18T11:39:52.443 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:39:52.444 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-18T11:39:52.444 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi151 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a" 2023-10-18T11:39:52.445 INFO:tasks.ceph.mds.a:Stopped 2023-10-18T11:39:52.445 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-18T11:39:52.445 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:39:52.446 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-18T11:39:52.446 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi151 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2023-10-18T11:39:52.446 INFO:tasks.ceph.mds.c:Stopped 2023-10-18T11:39:52.447 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-10-18T11:39:52.447 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:39:52.447 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-18T11:39:52.448 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi151 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2023-10-18T11:39:52.448 INFO:tasks.ceph.mds.e:Stopped 2023-10-18T11:39:52.448 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-18T11:39:52.449 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:39:52.468 INFO:tasks.ceph.mds.b.smithi169.stderr:2023-10-18T11:39:52.451+0000 b5ab640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 122766) UID: 0 2023-10-18T11:39:52.468 INFO:tasks.ceph.mds.b.smithi169.stderr:2023-10-18T11:39:52.454+0000 b5ab640 -1 mds.b *** got signal Terminated *** 2023-10-18T11:39:57.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-18T11:39:57.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~6s 2023-10-18T11:39:57.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~6s 2023-10-18T11:39:57.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-18T11:39:57.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-18T11:39:57.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-10-18T11:39:58.551 INFO:tasks.ceph.mds.b:Stopped 2023-10-18T11:39:58.552 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-18T11:39:58.552 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:39:58.552 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-18T11:39:58.553 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi169 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2023-10-18T11:39:58.553 INFO:tasks.ceph.mds.d:Stopped 2023-10-18T11:39:58.553 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-10-18T11:39:58.554 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:39:58.554 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-18T11:39:58.554 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi169 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2023-10-18T11:39:58.555 INFO:tasks.ceph.mds.f:Stopped 2023-10-18T11:39:58.555 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-18T11:39:58.556 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-18T11:39:58.556 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:39:58.557 INFO:tasks.ceph.osd.0.smithi151.stderr:2023-10-18T11:39:58.555+0000 7f2192831640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 87292) UID: 0 2023-10-18T11:39:58.558 INFO:tasks.ceph.osd.0.smithi151.stderr:2023-10-18T11:39:58.555+0000 7f2192831640 -1 osd.0 36 *** Got signal Terminated *** 2023-10-18T11:40:03.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-18T11:40:03.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-18T11:40:03.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-10-18T11:40:03.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-18T11:40:04.658 INFO:tasks.ceph.osd.0:Stopped 2023-10-18T11:40:04.659 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-18T11:40:04.659 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:04.660 INFO:tasks.ceph.osd.1.smithi151.stderr:2023-10-18T11:40:04.658+0000 7f9eca787640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 87291) UID: 0 2023-10-18T11:40:04.660 INFO:tasks.ceph.osd.1.smithi151.stderr:2023-10-18T11:40:04.658+0000 7f9eca787640 -1 osd.1 38 *** Got signal Terminated *** 2023-10-18T11:40:07.518 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:31:23.686 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:40:07.523 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:31:23.691 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:40:07.532 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:31:23.626 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:40:07.559 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:31:23.727 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:40:07.561 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:31:23.729 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:40:07.566 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:31:23.661 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:40:07.567 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:31:23.735 118447== Warning: unimplemented fcntl command: 1036 2023-10-18T11:40:07.602 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:31:23.771 118448== Warning: unimplemented fcntl command: 1036 2023-10-18T11:40:07.777 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:31:23.871 87020== Warning: unimplemented fcntl command: 1036 2023-10-18T11:40:09.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-18T11:40:09.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-18T11:40:10.761 INFO:tasks.ceph.osd.1:Stopped 2023-10-18T11:40:10.762 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-18T11:40:10.762 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:10.763 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-10-18T11:40:10.761+0000 7f56f49a0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 87295) UID: 0 2023-10-18T11:40:10.764 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-10-18T11:40:10.761+0000 7f56f49a0640 -1 osd.2 39 *** Got signal Terminated *** 2023-10-18T11:40:12.205 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:40:12.214 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:40:15.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-18T11:40:15.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-18T11:40:16.864 INFO:tasks.ceph.osd.2:Stopped 2023-10-18T11:40:16.865 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-18T11:40:16.865 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:16.866 INFO:tasks.ceph.osd.3.smithi151.stderr:2023-10-18T11:40:16.864+0000 7f2dcbd76640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 87298) UID: 0 2023-10-18T11:40:16.867 INFO:tasks.ceph.osd.3.smithi151.stderr:2023-10-18T11:40:16.864+0000 7f2dcbd76640 -1 osd.3 40 *** Got signal Terminated *** 2023-10-18T11:40:21.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-18T11:40:21.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-18T11:40:22.967 INFO:tasks.ceph.osd.3:Stopped 2023-10-18T11:40:22.968 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-18T11:40:22.968 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:22.969 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-10-18T11:40:22.966+0000 7f5e5413c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 119066) UID: 0 2023-10-18T11:40:22.969 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-10-18T11:40:22.966+0000 7f5e5413c640 -1 osd.4 41 *** Got signal Terminated *** 2023-10-18T11:40:27.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-18T11:40:27.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-18T11:40:29.070 INFO:tasks.ceph.osd.4:Stopped 2023-10-18T11:40:29.070 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-18T11:40:29.071 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:29.071 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-10-18T11:40:29.069+0000 7fd165337640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 119069) UID: 0 2023-10-18T11:40:29.072 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-10-18T11:40:29.069+0000 7fd165337640 -1 osd.5 42 *** Got signal Terminated *** 2023-10-18T11:40:32.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-18T11:40:32.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-18T11:40:35.172 INFO:tasks.ceph.osd.5:Stopped 2023-10-18T11:40:35.173 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-18T11:40:35.173 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:35.174 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-10-18T11:40:35.172+0000 7f9fcf8b8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 119072) UID: 0 2023-10-18T11:40:35.174 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-10-18T11:40:35.172+0000 7f9fcf8b8640 -1 osd.6 43 *** Got signal Terminated *** 2023-10-18T11:40:38.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-18T11:40:38.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-18T11:40:41.276 INFO:tasks.ceph.osd.6:Stopped 2023-10-18T11:40:41.277 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-18T11:40:41.277 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:41.278 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-10-18T11:40:41.276+0000 7f051ed61640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 119070) UID: 0 2023-10-18T11:40:41.278 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-10-18T11:40:41.276+0000 7f051ed61640 -1 osd.7 43 *** Got signal Terminated *** 2023-10-18T11:40:42.422 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:40:42.431 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:40:43.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-18T11:40:43.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-18T11:40:47.379 INFO:tasks.ceph.osd.7:Stopped 2023-10-18T11:40:47.380 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-18T11:40:47.380 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-18T11:40:47.380 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:47.454 INFO:tasks.ceph.mgr.y:Stopped 2023-10-18T11:40:47.454 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-18T11:40:47.455 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:47.456 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-10-18T11:40:47.453+0000 7f7b89a89640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 118445) UID: 0 2023-10-18T11:40:47.484 INFO:tasks.ceph.mgr.x:Stopped 2023-10-18T11:40:47.485 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-18T11:40:47.485 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-18T11:40:47.486 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:47.538 INFO:tasks.ceph.mon.a.smithi151.stderr:2023-10-18T11:40:47.505+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 87011) UID: 0 2023-10-18T11:40:47.539 INFO:tasks.ceph.mon.a.smithi151.stderr:2023-10-18T11:40:47.509+0000 9f5c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-18T11:40:48.341 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:32:04.436 87020== 2023-10-18T11:40:48.342 INFO:tasks.ceph.mon.a.smithi151.stderr:==00:00:32:04.436 87020== Exit program on first error (--exit-on-first-error=yes) 2023-10-18T11:40:48.391 INFO:tasks.ceph.mon.a.smithi151.stderr:daemon-helper: command failed with exit status 42 2023-10-18T11:40:49.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-18T11:40:49.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-18T11:40:53.588 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-18T11:40:53.589 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi151 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-10-18T11:40:53.589 INFO:tasks.ceph.mon.a:Stopped 2023-10-18T11:40:53.590 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-18T11:40:53.590 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:40:53.605 INFO:tasks.ceph.mon.b.smithi169.stderr:2023-10-18T11:40:53.592+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 118438) UID: 0 2023-10-18T11:40:53.606 INFO:tasks.ceph.mon.b.smithi169.stderr:2023-10-18T11:40:53.594+0000 9f5c640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-10-18T11:40:54.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-18T11:41:00.559 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:32:16.727 118447== 2023-10-18T11:41:00.559 INFO:tasks.ceph.mon.b.smithi169.stderr:==00:00:32:16.727 118447== Exit program on first error (--exit-on-first-error=yes) 2023-10-18T11:41:00.569 INFO:tasks.ceph.mon.b.smithi169.stderr:daemon-helper: command failed with exit status 42 2023-10-18T11:41:04.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-18T11:41:05.794 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-18T11:41:05.794 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi169 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-10-18T11:41:05.795 INFO:tasks.ceph.mon.b:Stopped 2023-10-18T11:41:05.796 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-18T11:41:05.796 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T11:41:05.811 INFO:tasks.ceph.mon.c.smithi169.stderr:2023-10-18T11:41:05.798+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 118442) UID: 0 2023-10-18T11:41:05.811 INFO:tasks.ceph.mon.c.smithi169.stderr:2023-10-18T11:41:05.799+0000 9f5c640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-10-18T11:41:06.281 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:32:22.449 118448== 2023-10-18T11:41:06.281 INFO:tasks.ceph.mon.c.smithi169.stderr:==00:00:32:22.449 118448== Exit program on first error (--exit-on-first-error=yes) 2023-10-18T11:41:06.291 INFO:tasks.ceph.mon.c.smithi169.stderr:daemon-helper: command failed with exit status 42 2023-10-18T11:41:09.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-18T11:41:09.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-18T11:41:11.897 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-18T11:41:11.898 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi169 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2023-10-18T11:41:11.898 INFO:tasks.ceph.mon.c:Stopped 2023-10-18T11:41:11.899 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-18T11:41:11.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-10-18T11:41:12.087 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:41:12.087 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-18T11:41:12.253 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:41:12.254 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-18T11:41:12.432 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:41:12.433 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-18T11:41:12.599 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:41:12.599 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-18T11:41:12.726 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:41:12.736 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:41:12.800 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:41:12.801 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-18T11:41:12.909 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:41:12.910 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-18T11:41:12.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:41:12.972 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-18T11:41:13.049 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:41:13.050 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-18T11:41:13.121 INFO:tasks.ceph:Archiving mon data... 2023-10-18T11:41:13.123 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/data/mon.a.tgz 2023-10-18T11:41:13.123 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-10-18T11:41:13.183 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.vjlLhK05jV 2023-10-18T11:41:13.184 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vjlLhK05jV 2023-10-18T11:41:13.375 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.vjlLhK05jV 2023-10-18T11:41:13.533 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.vjlLhK05jV is 366KB 2023-10-18T11:41:13.643 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.vjlLhK05jV 2023-10-18T11:41:13.705 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/data/mon.b.tgz 2023-10-18T11:41:13.705 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2023-10-18T11:41:13.723 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.ZAmW65v170 2023-10-18T11:41:13.723 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ZAmW65v170 2023-10-18T11:41:13.876 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.ZAmW65v170 2023-10-18T11:41:13.962 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.ZAmW65v170 is 370KB 2023-10-18T11:41:14.059 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.ZAmW65v170 2023-10-18T11:41:14.074 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/data/mon.c.tgz 2023-10-18T11:41:14.074 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2023-10-18T11:41:14.127 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.6yh7Km3LWW 2023-10-18T11:41:14.128 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.6yh7Km3LWW 2023-10-18T11:41:14.260 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.6yh7Km3LWW 2023-10-18T11:41:14.345 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.6yh7Km3LWW is 370KB 2023-10-18T11:41:14.441 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.6yh7Km3LWW 2023-10-18T11:41:14.455 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-18T11:41:14.456 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-18T11:41:14.465 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-18T11:41:14.558 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-18T11:41:14.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-18T11:41:14.568 DEBUG:teuthology.orchestra.run.smithi169:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-18T11:41:14.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-18T11:41:14.607 INFO:teuthology.orchestra.run.smithi169.stdout:/var/log/ceph/valgrind/mds.d.log: Leak_PossiblyLost 2023-10-18T11:41:14.608 INFO:teuthology.orchestra.run.smithi169.stdout:/var/log/ceph/valgrind/mds.f.log: Leak_PossiblyLost 2023-10-18T11:41:14.608 INFO:teuthology.orchestra.run.smithi169.stdout:/var/log/ceph/valgrind/mon.b.log: Leak_StillReachable 2023-10-18T11:41:14.608 INFO:teuthology.orchestra.run.smithi169.stdout:/var/log/ceph/valgrind/mon.c.log: Leak_StillReachable 2023-10-18T11:41:14.686 INFO:teuthology.orchestra.run.smithi151.stdout:/var/log/ceph/valgrind/mds.a.log: Leak_PossiblyLost 2023-10-18T11:41:14.687 INFO:teuthology.orchestra.run.smithi151.stdout:/var/log/ceph/valgrind/mds.c.log: Leak_PossiblyLost 2023-10-18T11:41:14.687 INFO:teuthology.orchestra.run.smithi151.stdout:/var/log/ceph/valgrind/mds.e.log: Leak_PossiblyLost 2023-10-18T11:41:14.687 INFO:teuthology.orchestra.run.smithi151.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2023-10-18T11:41:14.688 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.a.log kind Leak_PossiblyLost 2023-10-18T11:41:14.689 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.c.log kind Leak_PossiblyLost 2023-10-18T11:41:14.689 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.e.log kind Leak_PossiblyLost 2023-10-18T11:41:14.689 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2023-10-18T11:41:14.689 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2023-10-18T11:41:14.690 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.d.log kind Leak_PossiblyLost 2023-10-18T11:41:14.690 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.f.log kind Leak_PossiblyLost 2023-10-18T11:41:14.690 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.b.log kind Leak_StillReachable 2023-10-18T11:41:14.690 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.b.log 2023-10-18T11:41:14.691 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.c.log kind Leak_StillReachable 2023-10-18T11:41:14.691 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.c.log 2023-10-18T11:41:14.691 INFO:tasks.ceph:Archiving crash dumps... 2023-10-18T11:41:14.693 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/remote/smithi151/crash 2023-10-18T11:41:14.694 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-18T11:41:14.778 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/remote/smithi169/crash 2023-10-18T11:41:14.779 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-18T11:41:14.805 INFO:tasks.ceph:Shutting down logrotate 2023-10-18T11:41:14.806 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:41:14.815 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T11:41:15.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-18T11:41:15.212 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-18T11:41:15.239 INFO:tasks.ceph:Compressing logs... 2023-10-18T11:41:15.240 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-18T11:41:15.249 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-18T11:41:15.312 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-18T11:41:15.312 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118976.log 2023-10-18T11:41:15.313 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-10-18T11:41:15.313 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.118976.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-10-18T11:41:15.313 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-10-18T11:41:15.313 INFO:teuthology.orchestra.run.smithi169.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118976.log.gz 2023-10-18T11:41:15.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/valgrind/mds.f.log: 74.7% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-10-18T11:41:15.314 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-10-18T11:41:15.314 INFO:teuthology.orchestra.run.smithi169.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-10-18T11:41:15.314 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-10-18T11:41:15.314 INFO:teuthology.orchestra.run.smithi169.stderr: 57.4% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-10-18T11:41:15.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118639.log 2023-10-18T11:41:15.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/valgrind/mds.d.log: 74.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-10-18T11:41:15.315 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118868.log 2023-10-18T11:41:15.315 INFO:teuthology.orchestra.run.smithi169.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-10-18T11:41:15.315 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.118639.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-18T11:41:15.316 INFO:teuthology.orchestra.run.smithi169.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118639.log.gz 2023-10-18T11:41:15.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.118868.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-18T11:41:15.316 INFO:teuthology.orchestra.run.smithi169.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118868.log.gz 2023-10-18T11:41:15.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-18T11:41:15.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118819.log 2023-10-18T11:41:15.316 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-18T11:41:15.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.118819.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-18T11:41:15.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118679.log 2023-10-18T11:41:15.317 INFO:teuthology.orchestra.run.smithi169.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118819.log.gz 2023-10-18T11:41:15.317 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118719.log 2023-10-18T11:41:15.317 INFO:teuthology.orchestra.run.smithi169.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-18T11:41:15.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.118679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118936.log 2023-10-18T11:41:15.318 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-10-18T11:41:15.318 INFO:teuthology.orchestra.run.smithi169.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.118679.log.gz 2023-10-18T11:41:15.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.118719.log: /var/log/ceph/ceph-client.admin.118936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118777.log 2023-10-18T11:41:15.318 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.f.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.118719.log.gz 2023-10-18T11:41:15.319 INFO:teuthology.orchestra.run.smithi169.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118936.log.gz 2023-10-18T11:41:15.319 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-18T11:41:15.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.118777.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-18T11:41:15.319 INFO:teuthology.orchestra.run.smithi169.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118777.log.gz 2023-10-18T11:41:15.319 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-18T11:41:15.321 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-18T11:41:15.322 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-18T11:41:15.322 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.b.log: 93.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-18T11:41:15.322 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-18T11:41:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94370.log 2023-10-18T11:41:15.337 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97768.log 2023-10-18T11:41:15.338 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94370.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94370.log.gz 2023-10-18T11:41:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94967.log 2023-10-18T11:41:15.340 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.97768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95513.log 2023-10-18T11:41:15.340 INFO:teuthology.orchestra.run.smithi151.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97768.log.gz 2023-10-18T11:41:15.341 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94967.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94967.log.gz 2023-10-18T11:41:15.341 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-18T11:41:15.342 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95513.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95513.log.gz 2023-10-18T11:41:15.342 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91744.log 2023-10-18T11:41:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95177.log 2023-10-18T11:41:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97810.log 2023-10-18T11:41:15.345 INFO:teuthology.orchestra.run.smithi151.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91744.log.gz 2023-10-18T11:41:15.346 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95177.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95177.log.gz 2023-10-18T11:41:15.346 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91524.log 2023-10-18T11:41:15.347 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.97810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90920.log 2023-10-18T11:41:15.347 INFO:teuthology.orchestra.run.smithi151.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97810.log.gz 2023-10-18T11:41:15.348 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91524.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91524.log.gz 2023-10-18T11:41:15.349 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92104.log 2023-10-18T11:41:15.349 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.90920.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90920.log.gz 2023-10-18T11:41:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99191.log 2023-10-18T11:41:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.92104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94791.log 2023-10-18T11:41:15.351 INFO:teuthology.orchestra.run.smithi151.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92104.log.gz 2023-10-18T11:41:15.352 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98777.log 87.1% 2023-10-18T11:41:15.352 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99191.log.gz 2023-10-18T11:41:15.353 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94925.log 2023-10-18T11:41:15.353 INFO:teuthology.orchestra.run.smithi151.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94791.log.gz 2023-10-18T11:41:15.354 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98777.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.98777.log.gz 2023-10-18T11:41:15.354 INFO:teuthology.orchestra.run.smithi151.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95597.log 2023-10-18T11:41:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94925.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94925.log.gz 2023-10-18T11:41:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98117.log 2023-10-18T11:41:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91335.log 2023-10-18T11:41:15.357 INFO:teuthology.orchestra.run.smithi151.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.95597.log.gz 2023-10-18T11:41:15.358 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98117.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98117.log.gz 2023-10-18T11:41:15.358 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91828.log 2023-10-18T11:41:15.359 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98735.log 2023-10-18T11:41:15.360 INFO:teuthology.orchestra.run.smithi151.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91335.log.gz 2023-10-18T11:41:15.360 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91828.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91828.log.gz 2023-10-18T11:41:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94022.log 2023-10-18T11:41:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98735.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98735.log.gz 2023-10-18T11:41:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87019.log 2023-10-18T11:41:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92748.log 2023-10-18T11:41:15.363 INFO:teuthology.orchestra.run.smithi151.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94022.log.gz 2023-10-18T11:41:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.87019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91239.log 2023-10-18T11:41:15.364 INFO:teuthology.orchestra.run.smithi151.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.87019.log.gz 2023-10-18T11:41:15.365 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.92748.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-10-18T11:41:15.365 INFO:teuthology.orchestra.run.smithi151.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92748.log.gz 2023-10-18T11:41:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91239.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-10-18T11:41:15.367 INFO:teuthology.orchestra.run.smithi151.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91239.log.gz 2023-10-18T11:41:15.367 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/valgrind/mds.c.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-10-18T11:41:15.368 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-10-18T11:41:15.369 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-10-18T11:41:15.369 INFO:teuthology.orchestra.run.smithi151.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-10-18T11:41:15.370 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/valgrind/mon.a.log: 74.7% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-10-18T11:41:15.370 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93257.log 2023-10-18T11:41:15.371 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/valgrind/mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97894.log 2023-10-18T11:41:15.371 INFO:teuthology.orchestra.run.smithi151.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-10-18T11:41:15.372 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93257.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93257.log.gz 2023-10-18T11:41:15.372 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98507.log 2023-10-18T11:41:15.373 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.97894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93679.log 2023-10-18T11:41:15.373 INFO:teuthology.orchestra.run.smithi151.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97894.log.gz 2023-10-18T11:41:15.374 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98507.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98507.log.gz 2023-10-18T11:41:15.374 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94023.log 2023-10-18T11:41:15.376 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92989.log 2023-10-18T11:41:15.376 INFO:teuthology.orchestra.run.smithi151.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93679.log.gz 2023-10-18T11:41:15.377 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94023.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94023.log.gz 2023-10-18T11:41:15.377 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93811.log 2023-10-18T11:41:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.92989.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92989.log.gz 2023-10-18T11:41:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98693.log 2023-10-18T11:41:15.380 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93377.log 2023-10-18T11:41:15.380 INFO:teuthology.orchestra.run.smithi151.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93811.log.gz 2023-10-18T11:41:15.381 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98693.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98693.log.gz -5 2023-10-18T11:41:15.381 INFO:teuthology.orchestra.run.smithi151.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93553.log 2023-10-18T11:41:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93377.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93377.log.gz 2023-10-18T11:41:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94038.log 2023-10-18T11:41:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98549.log 2023-10-18T11:41:15.386 INFO:teuthology.orchestra.run.smithi151.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93553.log.gz 2023-10-18T11:41:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98339.log 2023-10-18T11:41:15.387 INFO:teuthology.orchestra.run.smithi151.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94038.log.gz 2023-10-18T11:41:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95471.log 2023-10-18T11:41:15.387 INFO:teuthology.orchestra.run.smithi151.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98549.log.gz 2023-10-18T11:41:15.388 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98339.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98339.log.gz 2023-10-18T11:41:15.388 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94351.log 2023-10-18T11:41:15.388 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95471.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95471.log.gz 2023-10-18T11:41:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99375.log 2023-10-18T11:41:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91996.log 2023-10-18T11:41:15.390 INFO:teuthology.orchestra.run.smithi151.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94351.log.gz 2023-10-18T11:41:15.391 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98903.log 2023-10-18T11:41:15.391 INFO:teuthology.orchestra.run.smithi151.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99375.log.gz 2023-10-18T11:41:15.392 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91155.log 2023-10-18T11:41:15.392 INFO:teuthology.orchestra.run.smithi151.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91996.log.gz 2023-10-18T11:41:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98423.log 2023-10-18T11:41:15.393 INFO:teuthology.orchestra.run.smithi151.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98903.log.gz 2023-10-18T11:41:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95555.log 2023-10-18T11:41:15.394 INFO:teuthology.orchestra.run.smithi151.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91155.log.gz 2023-10-18T11:41:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92886.log 2023-10-18T11:41:15.395 INFO:teuthology.orchestra.run.smithi151.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98423.log.gz 2023-10-18T11:41:15.396 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94728.log 2023-10-18T11:41:15.397 INFO:teuthology.orchestra.run.smithi151.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95555.log.gz 2023-10-18T11:41:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.92886.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92886.log.gz 2023-10-18T11:41:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99417.log 2023-10-18T11:41:15.399 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94728.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94728.log.gz 2023-10-18T11:41:15.399 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97978.log 2023-10-18T11:41:15.400 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94343.log 2023-10-18T11:41:15.400 INFO:teuthology.orchestra.run.smithi151.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99417.log.gz 2023-10-18T11:41:15.401 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.97978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91912.log 2023-10-18T11:41:15.401 INFO:teuthology.orchestra.run.smithi151.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97978.log.gz 2023-10-18T11:41:15.402 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94731.log 2023-10-18T11:41:15.402 INFO:teuthology.orchestra.run.smithi151.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94343.log.gz 2023-10-18T11:41:15.403 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87413.log 87.7% 2023-10-18T11:41:15.403 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91912.log.gz 2023-10-18T11:41:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97936.log 2023-10-18T11:41:15.404 INFO:teuthology.orchestra.run.smithi151.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94731.log.gz 2023-10-18T11:41:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.87413.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87413.log.gz 2023-10-18T11:41:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-18T11:41:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.97936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93173.log 2023-10-18T11:41:15.407 INFO:teuthology.orchestra.run.smithi151.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97936.log.gz 2023-10-18T11:41:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98159.log 2023-10-18T11:41:15.409 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93173.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-18T11:41:15.409 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91652.log 2023-10-18T11:41:15.409 INFO:teuthology.orchestra.run.smithi151.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93173.log.gz 2023-10-18T11:41:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95429.log 2023-10-18T11:41:15.410 INFO:teuthology.orchestra.run.smithi151.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.98159.log.gz 2023-10-18T11:41:15.411 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91652.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91652.log.gz 2023-10-18T11:41:15.412 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95093.log 2023-10-18T11:41:15.412 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93047.log 2023-10-18T11:41:15.413 INFO:teuthology.orchestra.run.smithi151.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95429.log.gz 2023-10-18T11:41:15.413 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87303.log 2023-10-18T11:41:15.414 INFO:teuthology.orchestra.run.smithi151.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95093.log.gz 2023-10-18T11:41:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93335.log 2023-10-18T11:41:15.415 INFO:teuthology.orchestra.run.smithi151.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93047.log.gz 2023-10-18T11:41:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.87303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92947.log 2023-10-18T11:41:15.416 INFO:teuthology.orchestra.run.smithi151.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.87303.log.gz 2023-10-18T11:41:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92038.log 2023-10-18T11:41:15.417 INFO:teuthology.orchestra.run.smithi151.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93335.log.gz 2023-10-18T11:41:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.92947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95989.log 2023-10-18T11:41:15.419 INFO:teuthology.orchestra.run.smithi151.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92947.log.gz 2023-10-18T11:41:15.419 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.92038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91786.log 2023-10-18T11:41:15.420 INFO:teuthology.orchestra.run.smithi151.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.92038.log.gz 2023-10-18T11:41:15.421 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95989.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95989.log.gz 2023-10-18T11:41:15.421 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94883.log 2023-10-18T11:41:15.422 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95051.log 2023-10-18T11:41:15.422 INFO:teuthology.orchestra.run.smithi151.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91786.log.gz 2023-10-18T11:41:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94883.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94883.log.gz 2023-10-18T11:41:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98202.log 2023-10-18T11:41:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95051.log: gzip 88.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.95051.log.gz -- 2023-10-18T11:41:15.424 INFO:teuthology.orchestra.run.smithi151.stderr: /var/log/ceph/ceph-client.admin.91608.log 2023-10-18T11:41:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92791.log 2023-10-18T11:41:15.426 INFO:teuthology.orchestra.run.smithi151.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98202.log.gz 2023-10-18T11:41:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91608.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91608.log.gz 2023-10-18T11:41:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95861.log 2023-10-18T11:41:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.92791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95663.log 2023-10-18T11:41:15.428 INFO:teuthology.orchestra.run.smithi151.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92791.log.gz 2023-10-18T11:41:15.429 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95861.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-18T11:41:15.429 INFO:teuthology.orchestra.run.smithi151.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.95861.log.gz 2023-10-18T11:41:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99501.log 2023-10-18T11:41:15.431 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.1.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.95663.log.gz 2023-10-18T11:41:15.431 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93461.log 2023-10-18T11:41:15.433 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93089.log 2023-10-18T11:41:15.433 INFO:teuthology.orchestra.run.smithi151.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99501.log.gz 2023-10-18T11:41:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91870.log 2023-10-18T11:41:15.435 INFO:teuthology.orchestra.run.smithi151.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93461.log.gz 2023-10-18T11:41:15.435 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93089.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93089.log.gz 2023-10-18T11:41:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92842.log 2023-10-18T11:41:15.437 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93637.log 2023-10-18T11:41:15.437 INFO:teuthology.orchestra.run.smithi151.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91870.log.gz 2023-10-18T11:41:15.438 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.92842.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.92842.log.gz 2023-10-18T11:41:15.438 INFO:teuthology.orchestra.run.smithi151.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.91700.log 2023-10-18T11:41:15.440 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95345.log 2023-10-18T11:41:15.440 INFO:teuthology.orchestra.run.smithi151.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93637.log.gz 2023-10-18T11:41:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91700.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91700.log.gz 2023-10-18T11:41:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94286.log 2023-10-18T11:41:15.442 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99273.log 2023-10-18T11:41:15.443 INFO:teuthology.orchestra.run.smithi151.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95345.log.gz 2023-10-18T11:41:15.443 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94286.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94286.log.gz 2023-10-18T11:41:15.444 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91954.log 2023-10-18T11:41:15.446 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98819.log 2023-10-18T11:41:15.446 INFO:teuthology.orchestra.run.smithi151.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99273.log.gz 2023-10-18T11:41:15.447 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91954.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91954.log.gz 2023-10-18T11:41:15.447 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94709.log 2023-10-18T11:41:15.448 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91197.log 2023-10-18T11:41:15.448 INFO:teuthology.orchestra.run.smithi151.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98819.log.gz 2023-10-18T11:41:15.449 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94709.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94709.log.gz 2023-10-18T11:41:15.450 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99459.log 2023-10-18T11:41:15.451 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98381.log 2023-10-18T11:41:15.451 INFO:teuthology.orchestra.run.smithi151.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91197.log.gz 2023-10-18T11:41:15.452 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99459.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99459.log.gz 2023-10-18T11:41:15.452 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-18T11:41:15.453 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98297.log 2023-10-18T11:41:15.454 INFO:teuthology.orchestra.run.smithi151.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98381.log.gz 2023-10-18T11:41:15.455 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93215.log 2023-10-18T11:41:15.456 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98297.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98297.log.gz 2023-10-18T11:41:15.457 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93595.log 2023-10-18T11:41:15.458 INFO:teuthology.orchestra.run.smithi151.stderr:gzip/var/log/ceph/ceph-client.admin.93215.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99029.log 2023-10-18T11:41:15.458 INFO:teuthology.orchestra.run.smithi151.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93215.log.gz 2023-10-18T11:41:15.459 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93595.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93595.log.gz 2023-10-18T11:41:15.459 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93763.log 2023-10-18T11:41:15.460 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94434.log 2023-10-18T11:41:15.461 INFO:teuthology.orchestra.run.smithi151.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99029.log.gz 2023-10-18T11:41:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93763.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93763.log.gz 2023-10-18T11:41:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98987.log 2023-10-18T11:41:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97852.log 2023-10-18T11:41:15.464 INFO:teuthology.orchestra.run.smithi151.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94434.log.gz 2023-10-18T11:41:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98987.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98987.log.gz 2023-10-18T11:41:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99089.log 2023-10-18T11:41:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.97852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92524.log 2023-10-18T11:41:15.466 INFO:teuthology.orchestra.run.smithi151.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97852.log.gz 2023-10-18T11:41:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99089.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99089.log.gz 2023-10-18T11:41:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94610.log 2023-10-18T11:41:15.469 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.92524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95219.log 2023-10-18T11:41:15.470 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94610.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94610.log.gz 2023-10-18T11:41:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-10-18T11:41:15.471 INFO:teuthology.orchestra.run.smithi151.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.92524.log.gz 2023-10-18T11:41:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99149.log 2023-10-18T11:41:15.472 INFO:teuthology.orchestra.run.smithi151.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95219.log.gz 2023-10-18T11:41:15.474 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-18T11:41:15.475 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99149.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99149.log.gz 2023-10-18T11:41:15.475 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94029.log 2023-10-18T11:41:15.477 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90995.log 2023-10-18T11:41:15.479 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94029.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94029.log.gz 2023-10-18T11:41:15.479 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95009.log 2023-10-18T11:41:15.480 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.90995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99333.log 2023-10-18T11:41:15.481 INFO:teuthology.orchestra.run.smithi151.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.90995.log.gz 2023-10-18T11:41:15.482 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95009.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.93131.log 2023-10-18T11:41:15.482 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95009.log.gz 2023-10-18T11:41:15.484 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93419.log 2023-10-18T11:41:15.484 INFO:teuthology.orchestra.run.smithi151.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99333.log.gz 2023-10-18T11:41:15.485 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94611.log 2023-10-18T11:41:15.486 INFO:teuthology.orchestra.run.smithi151.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93131.log.gz 2023-10-18T11:41:15.486 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93419.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93419.log.gz 2023-10-18T11:41:15.487 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94320.log 2023-10-18T11:41:15.488 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93721.log 2023-10-18T11:41:15.489 INFO:teuthology.orchestra.run.smithi151.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94611.log.gz 2023-10-18T11:41:15.490 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95261.log 2023-10-18T11:41:15.490 INFO:teuthology.orchestra.run.smithi151.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94320.log.gz 2023-10-18T11:41:15.492 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93721.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-18T11:41:15.492 INFO:teuthology.orchestra.run.smithi151.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93721.log.gz 2023-10-18T11:41:15.493 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95261.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.98252.log 2023-10-18T11:41:15.493 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95261.log.gz 2023-10-18T11:41:15.495 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91566.log 2023-10-18T11:41:15.496 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98252.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98252.log.gz 2023-10-18T11:41:15.497 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95135.log 2023-10-18T11:41:15.497 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91566.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91566.log.gz 2023-10-18T11:41:15.499 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95729.log 2023-10-18T11:41:15.500 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95135.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95135.log.gz 2023-10-18T11:41:15.501 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96303.log 2023-10-18T11:41:15.502 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95729.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-18T11:41:15.502 INFO:teuthology.orchestra.run.smithi151.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.95729.log.gz 2023-10-18T11:41:15.503 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98591.log 2023-10-18T11:41:15.503 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.96303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96303.log.gz 2023-10-18T11:41:15.504 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95795.log 2023-10-18T11:41:15.505 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98591.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98591.log.gz 2023-10-18T11:41:15.506 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-18T11:41:15.508 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91380.log 2023-10-18T11:41:15.508 INFO:teuthology.orchestra.run.smithi151.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.95795.log.gz 2023-10-18T11:41:15.509 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94015.log 2023-10-18T11:41:15.510 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91380.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91380.log.gz 2023-10-18T11:41:15.511 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-18T11:41:15.512 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94015.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94015.log.gz 2023-10-18T11:41:15.513 INFO:teuthology.orchestra.run.smithi151.stderr: 87.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-18T11:41:15.514 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-18T11:41:15.515 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94031.log 2023-10-18T11:41:15.518 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.94031.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94031.log.gz 2023-10-18T11:41:15.519 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93856.log 2023-10-18T11:41:15.522 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.93856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91482.log 2023-10-18T11:41:15.523 INFO:teuthology.orchestra.run.smithi151.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93856.log.gz 2023-10-18T11:41:15.525 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99543.log 2023-10-18T11:41:15.530 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91482.log: /var/log/ceph/ceph-client.admin.99543.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98651.log 2023-10-18T11:41:15.530 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91482.log.gz 2023-10-18T11:41:15.531 INFO:teuthology.orchestra.run.smithi151.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99543.log.gz 2023-10-18T11:41:15.533 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98861.log 2023-10-18T11:41:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98651.log: /var/log/ceph/ceph-client.admin.98861.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98651.log.gz 2023-10-18T11:41:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98945.log 2023-10-18T11:41:15.542 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98945.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98861.log.gz 2023-10-18T11:41:15.542 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94350.log 2023-10-18T11:41:15.544 INFO:teuthology.orchestra.run.smithi151.stderr:gzip 88.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.95303.log 2023-10-18T11:41:15.546 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98945.log.gz 2023-10-18T11:41:15.547 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94350.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94350.log.gz 2023-10-18T11:41:15.549 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99585.log 2023-10-18T11:41:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95303.log: /var/log/ceph/ceph-client.admin.99585.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80988.log 2023-10-18T11:41:15.554 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95303.log.gz 2023-10-18T11:41:15.555 INFO:teuthology.orchestra.run.smithi151.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99585.log.gz 2023-10-18T11:41:15.556 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91110.log 2023-10-18T11:41:15.557 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.tmp-client.admin.80988.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80988.log.gz 2023-10-18T11:41:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.91110.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91110.log.gz 2023-10-18T11:41:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95387.log 2023-10-18T11:41:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.95387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94034.log 2023-10-18T11:41:15.565 INFO:teuthology.orchestra.run.smithi151.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95387.log.gz 2023-10-18T11:41:15.567 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91440.log 2023-10-18T11:41:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94034.log: /var/log/ceph/ceph-client.admin.91440.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94300.log 2023-10-18T11:41:15.572 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94034.log.gz 2023-10-18T11:41:15.573 INFO:teuthology.orchestra.run.smithi151.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91440.log.gz 2023-10-18T11:41:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93505.log 2023-10-18T11:41:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94300.log: /var/log/ceph/ceph-client.admin.93505.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93505.log.gz 2023-10-18T11:41:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94603.log 2023-10-18T11:41:15.579 INFO:teuthology.orchestra.run.smithi151.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94300.log.gz 2023-10-18T11:41:15.580 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99231.log 2023-10-18T11:41:15.582 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94603.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94603.log.gz 2023-10-18T11:41:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-18T11:41:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.99231.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99231.log.gz 2023-10-18T11:41:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98465.log 2023-10-18T11:41:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94035.log 2023-10-18T11:41:15.590 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.98465.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98465.log.gz 2023-10-18T11:41:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.94035.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94035.log.gz 2023-10-18T11:41:15.711 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-18T11:41:16.052 INFO:teuthology.orchestra.run.smithi169.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-18T11:41:16.081 INFO:teuthology.orchestra.run.smithi169.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-18T11:41:16.876 INFO:teuthology.orchestra.run.smithi151.stderr: 89.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-18T11:41:21.726 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-18T11:41:22.405 INFO:teuthology.orchestra.run.smithi169.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-18T11:41:23.304 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-18T11:41:23.787 INFO:teuthology.orchestra.run.smithi151.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-18T11:41:24.006 INFO:teuthology.orchestra.run.smithi151.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-18T11:41:24.289 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-18T11:41:24.466 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-18T11:41:25.361 INFO:teuthology.orchestra.run.smithi169.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-10-18T11:41:25.363 INFO:teuthology.orchestra.run.smithi169.stderr: 2023-10-18T11:41:25.363 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m10.070s 2023-10-18T11:41:25.363 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m49.716s 2023-10-18T11:41:25.364 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m1.432s 2023-10-18T11:41:25.685 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-18T11:41:25.986 INFO:teuthology.orchestra.run.smithi151.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-18T11:41:26.100 INFO:teuthology.orchestra.run.smithi151.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-18T11:41:27.697 INFO:teuthology.orchestra.run.smithi151.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-18T11:41:29.244 INFO:teuthology.orchestra.run.smithi151.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-10-18T11:41:29.249 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-10-18T11:41:29.249 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m13.956s 2023-10-18T11:41:29.249 INFO:teuthology.orchestra.run.smithi151.stderr:user 1m10.595s 2023-10-18T11:41:29.249 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m5.520s 2023-10-18T11:41:29.250 INFO:tasks.ceph:Archiving logs... 2023-10-18T11:41:29.251 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/remote/smithi151/log 2023-10-18T11:41:29.252 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-18T11:41:38.139 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/remote/smithi169/log 2023-10-18T11:41:38.140 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-18T11:41:44.667 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-10-18T11:41:44.668 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-18T11:41:44.677 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_189714d033726ae2ce7d2d105c75781f0aec48f4/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-10-18T11:41:44.678 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-18T11:41:44.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-18T11:41:44.688 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-18T11:41:44.830 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-18T11:41:44.840 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-18T11:41:44.841 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T11:41:44.850 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T11:41:44.867 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2023-10-18T11:41:44.871 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T11:41:44.872 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2023-10-18T11:41:44.872 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 +2756us[+2763us] +/- 47ms 2023-10-18T11:41:44.872 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -1881us[-1881us] +/- 49ms 2023-10-18T11:41:44.872 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 -2092us[-2086us] +/- 74ms 2023-10-18T11:41:44.872 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T11:41:44.898 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-10-18T11:41:44.908 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T11:41:44.908 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-10-18T11:41:44.909 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 +2744us[+2750us] +/- 47ms 2023-10-18T11:41:44.909 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -1911us[-1911us] +/- 49ms 2023-10-18T11:41:44.909 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 -2116us[-2110us] +/- 74ms 2023-10-18T11:41:44.909 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T11:41:44.910 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-18T11:41:44.920 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-18T11:41:44.920 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-18T11:41:44.933 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-18T11:41:45.248 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-18T11:41:45.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T11:41:45.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T11:41:45.460 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T11:41:45.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T11:41:45.495 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-18T11:41:45.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-18T11:41:45.541 INFO:teuthology.task.internal:Duration was 3264.317643 seconds 2023-10-18T11:41:45.541 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-18T11:41:45.573 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-18T11:41:45.574 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-18T11:41:45.583 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-18T11:41:45.627 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T11:41:45.750 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T11:41:46.274 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-18T11:41:46.274 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2023-10-18T11:41:46.275 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-18T11:41:46.342 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2023-10-18T11:41:46.343 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-18T11:41:46.367 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-18T11:41:46.367 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-18T11:41:46.372 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-18T11:41:46.461 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-18T11:41:46.461 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T11:41:46.468 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T11:41:46.656 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-18T11:41:46.666 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-18T11:41:46.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-18T11:41:46.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-18T11:41:46.935 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-18T11:41:47.332 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-18T11:41:47.342 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-18T11:41:47.370 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2023-10-18T11:41:47.447 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2023-10-18T11:41:47.500 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-18T11:41:47.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T11:41:47.551 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-18T11:41:47.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T11:41:47.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-18T11:41:47.580 INFO:teuthology.task.internal:Transferring archived files... 2023-10-18T11:41:47.581 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/remote/smithi151 2023-10-18T11:41:47.581 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-18T11:41:47.685 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303/remote/smithi169 2023-10-18T11:41:47.686 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-18T11:41:47.724 INFO:teuthology.task.internal:Removing archive directory... 2023-10-18T11:41:47.725 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-18T11:41:47.734 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-18T11:41:47.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-18T11:41:47.797 INFO:teuthology.task.internal:Not uploading archives. 2023-10-18T11:41:47.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-18T11:41:47.823 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-18T11:41:47.824 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-18T11:41:47.833 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-18T11:41:47.848 INFO:teuthology.orchestra.run.smithi169.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 11:41 /home/ubuntu/cephtest 2023-10-18T11:41:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: 393944 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 11:41 /home/ubuntu/cephtest 2023-10-18T11:41:47.886 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-18T11:41:47.897 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-18T11:41:47.924 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2023-10-18T11:41:47.924 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T11:41:47.952 DEBUG:teuthology.nuke:shortname: smithi151 2023-10-18T11:41:47.952 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T11:41:47.973 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 10:37:53.093062', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+obz1e7R6QP2qenWQIXMio16vXMm5EOLaNoRO+C5Io5yhLFk7H9GvwojfSrvi39nhPHCRenawVKB1AUDLwSpM='} 2023-10-18T11:41:47.979 DEBUG:teuthology.nuke:shortname: smithi169 2023-10-18T11:41:47.980 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T11:41:47.998 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-18_10:33:40-fs-wip-vshankar-testing-20231013.093215-1-testing-default-smithi/7431303', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 10:37:53.094983', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz6kA2y2qL6G3bCydVes/q74K36e4w2Bk4w0f/Uay1pakoMGKFE88xVrNBU9Gb8S9MvTekLxvqdQcs11txniWM='} 2023-10-18T11:41:48.023 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-18T11:41:48.024 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T11:41:48.048 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-18T11:41:48.048 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:41:48.062 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-18T11:41:48.063 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T11:41:48.071 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-18T11:41:48.085 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-18T11:41:48.085 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:41:48.109 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-18T11:41:52.072 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:41:52.110 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:41:52.184 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-18T11:41:52.219 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-18T11:41:56.186 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:41:56.221 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:41:56.296 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-18T11:41:56.330 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-18T11:41:56.431 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-18T11:42:00.298 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:42:00.408 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-18T11:42:00.509 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-18T11:42:00.613 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 3264.31764292717 failure_reason: saw valgrind issues flavor: default owner: scheduled_vshankar@teuthology status: fail success: false 2023-10-18T11:42:00.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:42:00.700 INFO:teuthology.run:FAIL